Test Report: QEMU_macOS 19865

                    
                      ea0ee45a01f2858c9d39f3a043254a677a6e039b:2024-10-28:36843
                    
                

Test fail (156/258)

Order failed test Duration
3 TestDownloadOnly/v1.20.0/json-events 12.62
7 TestDownloadOnly/v1.20.0/kubectl 0
22 TestOffline 10.01
27 TestAddons/Setup 10.15
28 TestCertOptions 10.17
29 TestCertExpiration 195.48
30 TestDockerFlags 10.27
31 TestForceSystemdFlag 10.05
32 TestForceSystemdEnv 10.28
38 TestErrorSpam/setup 9.91
47 TestFunctional/serial/StartWithProxy 9.94
49 TestFunctional/serial/SoftStart 5.27
50 TestFunctional/serial/KubeContext 0.06
51 TestFunctional/serial/KubectlGetPods 0.06
58 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.05
59 TestFunctional/serial/CacheCmd/cache/cache_reload 0.19
61 TestFunctional/serial/MinikubeKubectlCmd 0.74
62 TestFunctional/serial/MinikubeKubectlCmdDirectly 1.19
63 TestFunctional/serial/ExtraConfig 5.27
64 TestFunctional/serial/ComponentHealth 0.06
65 TestFunctional/serial/LogsCmd 0.08
66 TestFunctional/serial/LogsFileCmd 0.07
67 TestFunctional/serial/InvalidService 0.03
70 TestFunctional/parallel/DashboardCmd 0.21
73 TestFunctional/parallel/StatusCmd 0.14
77 TestFunctional/parallel/ServiceCmdConnect 0.14
79 TestFunctional/parallel/PersistentVolumeClaim 0.04
81 TestFunctional/parallel/SSHCmd 0.13
82 TestFunctional/parallel/CpCmd 0.29
84 TestFunctional/parallel/FileSync 0.09
85 TestFunctional/parallel/CertSync 0.31
89 TestFunctional/parallel/NodeLabels 0.06
91 TestFunctional/parallel/NonActiveRuntimeDisabled 0.04
95 TestFunctional/parallel/Version/components 0.05
96 TestFunctional/parallel/ImageCommands/ImageListShort 0.04
97 TestFunctional/parallel/ImageCommands/ImageListTable 0.04
98 TestFunctional/parallel/ImageCommands/ImageListJson 0.04
99 TestFunctional/parallel/ImageCommands/ImageListYaml 0.04
100 TestFunctional/parallel/ImageCommands/ImageBuild 0.13
102 TestFunctional/parallel/DockerEnv/bash 0.05
103 TestFunctional/parallel/UpdateContextCmd/no_changes 0.05
104 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.05
105 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.05
106 TestFunctional/parallel/ServiceCmd/DeployApp 0.03
107 TestFunctional/parallel/ServiceCmd/List 0.05
108 TestFunctional/parallel/ServiceCmd/JSONOutput 0.05
109 TestFunctional/parallel/ServiceCmd/HTTPS 0.05
110 TestFunctional/parallel/ServiceCmd/Format 0.05
111 TestFunctional/parallel/ServiceCmd/URL 0.05
113 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.08
116 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
117 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 100.5
118 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 0.32
119 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 0.28
120 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.16
121 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.04
123 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.08
131 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.07
133 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 30.05
141 TestMultiControlPlane/serial/StartCluster 10.02
142 TestMultiControlPlane/serial/DeployApp 80.82
143 TestMultiControlPlane/serial/PingHostFromPods 0.1
144 TestMultiControlPlane/serial/AddWorkerNode 0.08
145 TestMultiControlPlane/serial/NodeLabels 0.06
146 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.09
147 TestMultiControlPlane/serial/CopyFile 0.07
148 TestMultiControlPlane/serial/StopSecondaryNode 0.12
149 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.08
150 TestMultiControlPlane/serial/RestartSecondaryNode 51.13
151 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.09
152 TestMultiControlPlane/serial/RestartClusterKeepsNodes 9
153 TestMultiControlPlane/serial/DeleteSecondaryNode 0.12
154 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.09
155 TestMultiControlPlane/serial/StopCluster 2.04
156 TestMultiControlPlane/serial/RestartCluster 5.26
157 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.09
158 TestMultiControlPlane/serial/AddSecondaryNode 0.08
159 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.09
162 TestImageBuild/serial/Setup 10.12
165 TestJSONOutput/start/Command 9.84
171 TestJSONOutput/pause/Command 0.08
177 TestJSONOutput/unpause/Command 0.05
194 TestMinikubeProfile 10.24
197 TestMountStart/serial/StartWithMountFirst 9.97
200 TestMultiNode/serial/FreshStart2Nodes 10.21
201 TestMultiNode/serial/DeployApp2Nodes 71.7
202 TestMultiNode/serial/PingHostFrom2Pods 0.1
203 TestMultiNode/serial/AddNode 0.09
204 TestMultiNode/serial/MultiNodeLabels 0.06
205 TestMultiNode/serial/ProfileList 0.09
206 TestMultiNode/serial/CopyFile 0.07
207 TestMultiNode/serial/StopNode 0.16
208 TestMultiNode/serial/StartAfterStop 44.85
209 TestMultiNode/serial/RestartKeepsNodes 9.03
210 TestMultiNode/serial/DeleteNode 0.12
211 TestMultiNode/serial/StopMultiNode 4.04
212 TestMultiNode/serial/RestartMultiNode 5.27
213 TestMultiNode/serial/ValidateNameConflict 20.03
217 TestPreload 9.96
219 TestScheduledStopUnix 9.94
220 TestSkaffold 12.39
223 TestRunningBinaryUpgrade 589.49
225 TestKubernetesUpgrade 19.08
238 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 1
239 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 1.01
241 TestStoppedBinaryUpgrade/Upgrade 572.19
243 TestPause/serial/Start 9.97
253 TestNoKubernetes/serial/StartWithK8s 9.95
254 TestNoKubernetes/serial/StartWithStopK8s 5.28
255 TestNoKubernetes/serial/Start 5.31
259 TestNoKubernetes/serial/StartNoArgs 5.3
261 TestNetworkPlugins/group/auto/Start 9.81
262 TestNetworkPlugins/group/kindnet/Start 9.9
263 TestNetworkPlugins/group/calico/Start 9.77
264 TestNetworkPlugins/group/custom-flannel/Start 9.83
265 TestNetworkPlugins/group/false/Start 9.93
266 TestNetworkPlugins/group/enable-default-cni/Start 9.82
267 TestNetworkPlugins/group/flannel/Start 9.9
268 TestNetworkPlugins/group/bridge/Start 9.94
269 TestNetworkPlugins/group/kubenet/Start 10
271 TestStartStop/group/old-k8s-version/serial/FirstStart 10.17
273 TestStartStop/group/old-k8s-version/serial/DeployApp 0.1
274 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.12
277 TestStartStop/group/old-k8s-version/serial/SecondStart 5.26
278 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.04
279 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.06
280 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.08
281 TestStartStop/group/old-k8s-version/serial/Pause 0.13
283 TestStartStop/group/no-preload/serial/FirstStart 10.18
284 TestStartStop/group/no-preload/serial/DeployApp 0.1
285 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.12
288 TestStartStop/group/no-preload/serial/SecondStart 5.27
290 TestStartStop/group/embed-certs/serial/FirstStart 9.99
291 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.04
292 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.06
293 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.07
294 TestStartStop/group/no-preload/serial/Pause 0.11
296 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 10.06
297 TestStartStop/group/embed-certs/serial/DeployApp 0.1
298 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.12
301 TestStartStop/group/embed-certs/serial/SecondStart 5.93
302 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.1
303 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.12
306 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 5.28
307 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.03
308 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.06
309 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.07
310 TestStartStop/group/embed-certs/serial/Pause 0.11
312 TestStartStop/group/newest-cni/serial/FirstStart 10.32
313 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.04
314 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.06
315 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.08
316 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.11
321 TestStartStop/group/newest-cni/serial/SecondStart 5.27
324 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.08
325 TestStartStop/group/newest-cni/serial/Pause 0.12
x
+
TestDownloadOnly/v1.20.0/json-events (12.62s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-116000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-116000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (12.618330709s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4549986a-3ecc-4efe-bede-867ee3aa6947","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-116000] minikube v1.34.0 on Darwin 15.0.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"5bc7e0de-801d-4422-9760-81776f9b3098","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19865"}}
	{"specversion":"1.0","id":"dc5fac87-db7c-47a3-bea3-3edd494da140","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig"}}
	{"specversion":"1.0","id":"e796711e-fb34-41ea-bf91-90c307f82127","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"a55703c9-92bb-46e9-84a9-f508e9e1bfba","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"025481f8-db66-41d4-89cd-06d9c69f4220","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube"}}
	{"specversion":"1.0","id":"858cb8d1-4291-4e28-983d-9d423d77841c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}
	{"specversion":"1.0","id":"5ba00f07-d274-4b1c-85df-0d600c9294dd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"b102ba76-0ad8-4e07-aff3-2e58006e7ed7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"07ac47b3-7f70-438a-b229-32cc7a23a3fa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"94eb144d-9c05-4cca-b980-acbf52294f01","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-116000\" primary control-plane node in \"download-only-116000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"f968060c-d7d3-4b78-a98b-4f490befcab1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"6523e3cc-a141-4572-a77f-4d4fdb3fb743","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320] Decompressors:map[bz2:0x14000121810 gz:0x14000121818 tar:0x14000121790 tar.bz2:0x140001217a0 tar.gz:0x140001217c0 tar.xz:0x140001217d0 tar.zst:0x14000121800 tbz2:0x140001217a0 tgz:0x1
40001217c0 txz:0x140001217d0 tzst:0x14000121800 xz:0x14000121820 zip:0x14000121830 zst:0x14000121828] Getters:map[file:0x14000086df0 http:0x1400065c780 https:0x1400065c7d0] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}
	{"specversion":"1.0","id":"69072706-a043-4f04-b897-3f1f6bc92dc5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:20:15.729272   11910 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:20:15.729479   11910 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:15.729482   11910 out.go:358] Setting ErrFile to fd 2...
	I1028 05:20:15.729484   11910 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:15.729598   11910 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	W1028 05:20:15.729680   11910 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19865-11397/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19865-11397/.minikube/config/config.json: no such file or directory
	I1028 05:20:15.731080   11910 out.go:352] Setting JSON to true
	I1028 05:20:15.749192   11910 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6586,"bootTime":1730111429,"procs":528,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:20:15.749286   11910 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:20:15.754997   11910 out.go:97] [download-only-116000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:20:15.755123   11910 notify.go:220] Checking for updates...
	W1028 05:20:15.755141   11910 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball: no such file or directory
	I1028 05:20:15.758992   11910 out.go:169] MINIKUBE_LOCATION=19865
	I1028 05:20:15.762077   11910 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:20:15.766962   11910 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:20:15.769991   11910 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:20:15.773053   11910 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	W1028 05:20:15.778986   11910 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1028 05:20:15.779218   11910 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:20:15.781912   11910 out.go:97] Using the qemu2 driver based on user configuration
	I1028 05:20:15.781933   11910 start.go:297] selected driver: qemu2
	I1028 05:20:15.781947   11910 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:20:15.782011   11910 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:20:15.784929   11910 out.go:169] Automatically selected the socket_vmnet network
	I1028 05:20:15.790489   11910 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I1028 05:20:15.790590   11910 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:20:15.790648   11910 cni.go:84] Creating CNI manager for ""
	I1028 05:20:15.790690   11910 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1028 05:20:15.790744   11910 start.go:340] cluster config:
	{Name:download-only-116000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-116000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo
ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:20:15.795737   11910 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:20:15.800033   11910 out.go:97] Downloading VM boot image ...
	I1028 05:20:15.800052   11910 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso
	I1028 05:20:21.113425   11910 out.go:97] Starting "download-only-116000" primary control-plane node in "download-only-116000" cluster
	I1028 05:20:21.113462   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:21.175184   11910 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:20:21.175204   11910 cache.go:56] Caching tarball of preloaded images
	I1028 05:20:21.175420   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:21.179522   11910 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I1028 05:20:21.179529   11910 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:21.258738   11910 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:20:27.082179   11910 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:27.082372   11910 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:27.776647   11910 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I1028 05:20:27.776874   11910 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/download-only-116000/config.json ...
	I1028 05:20:27.776893   11910 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/download-only-116000/config.json: {Name:mkcfbe7d897a4adee526ee4de110626984ca579f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:20:27.778071   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:27.778319   11910 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl
	I1028 05:20:28.261421   11910 out.go:193] 
	W1028 05:20:28.268361   11910 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320] Decompressors:map[bz2:0x14000121810 gz:0x14000121818 tar:0x14000121790 tar.bz2:0x140001217a0 tar.gz:0x140001217c0 tar.xz:0x140001217d0 tar.zst:0x14000121800 tbz2:0x140001217a0 tgz:0x140001217c0 txz:0x140001217d0 tzst:0x14000121800 xz:0x14000121820 zip:0x14000121830 zst:0x14000121828] Getters:map[file:0x14000086df0 http:0x1400065c780 https:0x1400065c7d0] Dir:false ProgressLis
tener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W1028 05:20:28.268392   11910 out_reason.go:110] 
	W1028 05:20:28.274476   11910 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:20:28.279380   11910 out.go:193] 

                                                
                                                
** /stderr **
aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-116000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40
--- FAIL: TestDownloadOnly/v1.20.0/json-events (12.62s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory
--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestOffline (10.01s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-685000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-685000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.852837541s)

                                                
                                                
-- stdout --
	* [offline-docker-685000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "offline-docker-685000" primary control-plane node in "offline-docker-685000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "offline-docker-685000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:30:51.608464   13589 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:30:51.608647   13589 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:30:51.608650   13589 out.go:358] Setting ErrFile to fd 2...
	I1028 05:30:51.608653   13589 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:30:51.608805   13589 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:30:51.610138   13589 out.go:352] Setting JSON to false
	I1028 05:30:51.629822   13589 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7222,"bootTime":1730111429,"procs":527,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:30:51.629928   13589 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:30:51.635503   13589 out.go:177] * [offline-docker-685000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:30:51.643465   13589 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:30:51.643457   13589 notify.go:220] Checking for updates...
	I1028 05:30:51.648525   13589 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:30:51.663525   13589 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:30:51.666461   13589 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:30:51.669498   13589 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:30:51.672478   13589 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:30:51.675747   13589 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:30:51.675804   13589 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:30:51.679440   13589 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:30:51.686419   13589 start.go:297] selected driver: qemu2
	I1028 05:30:51.686427   13589 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:30:51.686434   13589 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:30:51.688692   13589 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:30:51.691421   13589 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:30:51.694550   13589 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:30:51.694579   13589 cni.go:84] Creating CNI manager for ""
	I1028 05:30:51.694605   13589 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:30:51.694609   13589 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:30:51.694660   13589 start.go:340] cluster config:
	{Name:offline-docker-685000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:offline-docker-685000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi
n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:30:51.699354   13589 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:51.707445   13589 out.go:177] * Starting "offline-docker-685000" primary control-plane node in "offline-docker-685000" cluster
	I1028 05:30:51.710410   13589 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:30:51.710431   13589 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:30:51.710437   13589 cache.go:56] Caching tarball of preloaded images
	I1028 05:30:51.710518   13589 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:30:51.710524   13589 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:30:51.710583   13589 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/offline-docker-685000/config.json ...
	I1028 05:30:51.710593   13589 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/offline-docker-685000/config.json: {Name:mkff5b88e415a5463e596281331e2a9c3673b7fb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:30:51.710870   13589 start.go:360] acquireMachinesLock for offline-docker-685000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:30:51.710921   13589 start.go:364] duration metric: took 38.291µs to acquireMachinesLock for "offline-docker-685000"
	I1028 05:30:51.710932   13589 start.go:93] Provisioning new machine with config: &{Name:offline-docker-685000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.2 ClusterName:offline-docker-685000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou
ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:30:51.710964   13589 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:30:51.715494   13589 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:30:51.730699   13589 start.go:159] libmachine.API.Create for "offline-docker-685000" (driver="qemu2")
	I1028 05:30:51.730727   13589 client.go:168] LocalClient.Create starting
	I1028 05:30:51.730825   13589 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:30:51.730865   13589 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:51.730878   13589 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:51.730916   13589 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:30:51.730946   13589 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:51.730954   13589 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:51.731339   13589 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:30:51.889728   13589 main.go:141] libmachine: Creating SSH key...
	I1028 05:30:51.980126   13589 main.go:141] libmachine: Creating Disk image...
	I1028 05:30:51.980136   13589 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:30:51.980338   13589 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:51.991266   13589 main.go:141] libmachine: STDOUT: 
	I1028 05:30:51.991303   13589 main.go:141] libmachine: STDERR: 
	I1028 05:30:51.991393   13589 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2 +20000M
	I1028 05:30:52.004250   13589 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:30:52.004270   13589 main.go:141] libmachine: STDERR: 
	I1028 05:30:52.004290   13589 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:52.004299   13589 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:30:52.004309   13589 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:30:52.004339   13589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/qemu.pid -device virtio-net-pci,netdev=net0,mac=66:01:0d:b4:01:b4 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:52.006304   13589 main.go:141] libmachine: STDOUT: 
	I1028 05:30:52.006319   13589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:30:52.006337   13589 client.go:171] duration metric: took 275.604709ms to LocalClient.Create
	I1028 05:30:54.008425   13589 start.go:128] duration metric: took 2.297446459s to createHost
	I1028 05:30:54.008440   13589 start.go:83] releasing machines lock for "offline-docker-685000", held for 2.297510125s
	W1028 05:30:54.008451   13589 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:30:54.013043   13589 out.go:177] * Deleting "offline-docker-685000" in qemu2 ...
	W1028 05:30:54.026211   13589 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:30:54.026221   13589 start.go:729] Will try again in 5 seconds ...
	I1028 05:30:59.028505   13589 start.go:360] acquireMachinesLock for offline-docker-685000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:30:59.029073   13589 start.go:364] duration metric: took 451.208µs to acquireMachinesLock for "offline-docker-685000"
	I1028 05:30:59.029229   13589 start.go:93] Provisioning new machine with config: &{Name:offline-docker-685000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.2 ClusterName:offline-docker-685000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou
ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:30:59.029461   13589 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:30:59.041056   13589 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:30:59.093666   13589 start.go:159] libmachine.API.Create for "offline-docker-685000" (driver="qemu2")
	I1028 05:30:59.093718   13589 client.go:168] LocalClient.Create starting
	I1028 05:30:59.093863   13589 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:30:59.093969   13589 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:59.093987   13589 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:59.094078   13589 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:30:59.094140   13589 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:59.094156   13589 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:59.094800   13589 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:30:59.267907   13589 main.go:141] libmachine: Creating SSH key...
	I1028 05:30:59.356262   13589 main.go:141] libmachine: Creating Disk image...
	I1028 05:30:59.356269   13589 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:30:59.356444   13589 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:59.366182   13589 main.go:141] libmachine: STDOUT: 
	I1028 05:30:59.366205   13589 main.go:141] libmachine: STDERR: 
	I1028 05:30:59.366274   13589 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2 +20000M
	I1028 05:30:59.374763   13589 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:30:59.374783   13589 main.go:141] libmachine: STDERR: 
	I1028 05:30:59.374802   13589 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:59.374808   13589 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:30:59.374820   13589 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:30:59.374848   13589 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9e:df:f0:b1:ca:27 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/offline-docker-685000/disk.qcow2
	I1028 05:30:59.376697   13589 main.go:141] libmachine: STDOUT: 
	I1028 05:30:59.376720   13589 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:30:59.376734   13589 client.go:171] duration metric: took 283.009167ms to LocalClient.Create
	I1028 05:31:01.378948   13589 start.go:128] duration metric: took 2.349416792s to createHost
	I1028 05:31:01.379106   13589 start.go:83] releasing machines lock for "offline-docker-685000", held for 2.349952209s
	W1028 05:31:01.379546   13589 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-685000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-685000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:01.393394   13589 out.go:201] 
	W1028 05:31:01.397366   13589 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:31:01.397403   13589 out.go:270] * 
	* 
	W1028 05:31:01.399467   13589 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:31:01.413276   13589 out.go:201] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-685000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80
panic.go:629: *** TestOffline FAILED at 2024-10-28 05:31:01.426799 -0700 PDT m=+645.704652501
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-685000 -n offline-docker-685000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-685000 -n offline-docker-685000: exit status 7 (75.793125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-685000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-685000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-685000
--- FAIL: TestOffline (10.01s)

                                                
                                    
x
+
TestAddons/Setup (10.15s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:107: (dbg) Run:  out/minikube-darwin-arm64 start -p addons-782000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:107: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p addons-782000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: exit status 80 (10.150806459s)

                                                
                                                
-- stdout --
	* [addons-782000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "addons-782000" primary control-plane node in "addons-782000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "addons-782000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:20:36.547257   11984 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:20:36.547445   11984 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:36.547449   11984 out.go:358] Setting ErrFile to fd 2...
	I1028 05:20:36.547451   11984 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:36.547599   11984 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:20:36.548794   11984 out.go:352] Setting JSON to false
	I1028 05:20:36.566364   11984 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6607,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:20:36.566444   11984 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:20:36.571465   11984 out.go:177] * [addons-782000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:20:36.578405   11984 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:20:36.578473   11984 notify.go:220] Checking for updates...
	I1028 05:20:36.585364   11984 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:20:36.588397   11984 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:20:36.591419   11984 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:20:36.594367   11984 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:20:36.597372   11984 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:20:36.600617   11984 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:20:36.603323   11984 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:20:36.610455   11984 start.go:297] selected driver: qemu2
	I1028 05:20:36.610462   11984 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:20:36.610469   11984 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:20:36.612878   11984 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:20:36.613974   11984 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:20:36.616422   11984 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:20:36.616443   11984 cni.go:84] Creating CNI manager for ""
	I1028 05:20:36.616466   11984 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:20:36.616470   11984 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:20:36.616503   11984 start.go:340] cluster config:
	{Name:addons-782000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:addons-782000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c
lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:20:36.621020   11984 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:20:36.628343   11984 out.go:177] * Starting "addons-782000" primary control-plane node in "addons-782000" cluster
	I1028 05:20:36.632319   11984 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:20:36.632335   11984 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:20:36.632344   11984 cache.go:56] Caching tarball of preloaded images
	I1028 05:20:36.632416   11984 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:20:36.632422   11984 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:20:36.632623   11984 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/addons-782000/config.json ...
	I1028 05:20:36.632637   11984 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/addons-782000/config.json: {Name:mkb62b1c2bd7b7b6d3f80dda41b7ad7948e52030 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:20:36.632999   11984 start.go:360] acquireMachinesLock for addons-782000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:20:36.633088   11984 start.go:364] duration metric: took 83.417µs to acquireMachinesLock for "addons-782000"
	I1028 05:20:36.633100   11984 start.go:93] Provisioning new machine with config: &{Name:addons-782000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:addons-782000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:20:36.633132   11984 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:20:36.641389   11984 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	I1028 05:20:36.658682   11984 start.go:159] libmachine.API.Create for "addons-782000" (driver="qemu2")
	I1028 05:20:36.658739   11984 client.go:168] LocalClient.Create starting
	I1028 05:20:36.658887   11984 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:20:36.737191   11984 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:20:36.855864   11984 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:20:37.013498   11984 main.go:141] libmachine: Creating SSH key...
	I1028 05:20:37.152750   11984 main.go:141] libmachine: Creating Disk image...
	I1028 05:20:37.152766   11984 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:20:37.152997   11984 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:37.163198   11984 main.go:141] libmachine: STDOUT: 
	I1028 05:20:37.163228   11984 main.go:141] libmachine: STDERR: 
	I1028 05:20:37.163291   11984 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2 +20000M
	I1028 05:20:37.171718   11984 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:20:37.171735   11984 main.go:141] libmachine: STDERR: 
	I1028 05:20:37.171754   11984 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:37.171761   11984 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:20:37.171799   11984 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:20:37.171843   11984 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:4f:e4:4a:9a:d3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:37.173706   11984 main.go:141] libmachine: STDOUT: 
	I1028 05:20:37.173721   11984 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:20:37.173748   11984 client.go:171] duration metric: took 515.005917ms to LocalClient.Create
	I1028 05:20:39.175880   11984 start.go:128] duration metric: took 2.542785792s to createHost
	I1028 05:20:39.175922   11984 start.go:83] releasing machines lock for "addons-782000", held for 2.542880125s
	W1028 05:20:39.175987   11984 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:20:39.187282   11984 out.go:177] * Deleting "addons-782000" in qemu2 ...
	W1028 05:20:39.219539   11984 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:20:39.219564   11984 start.go:729] Will try again in 5 seconds ...
	I1028 05:20:44.221652   11984 start.go:360] acquireMachinesLock for addons-782000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:20:44.222233   11984 start.go:364] duration metric: took 483.208µs to acquireMachinesLock for "addons-782000"
	I1028 05:20:44.222420   11984 start.go:93] Provisioning new machine with config: &{Name:addons-782000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:addons-782000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:20:44.222668   11984 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:20:44.239080   11984 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	I1028 05:20:44.286312   11984 start.go:159] libmachine.API.Create for "addons-782000" (driver="qemu2")
	I1028 05:20:44.286382   11984 client.go:168] LocalClient.Create starting
	I1028 05:20:44.286566   11984 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:20:44.286661   11984 main.go:141] libmachine: Decoding PEM data...
	I1028 05:20:44.286682   11984 main.go:141] libmachine: Parsing certificate...
	I1028 05:20:44.286762   11984 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:20:44.286824   11984 main.go:141] libmachine: Decoding PEM data...
	I1028 05:20:44.286845   11984 main.go:141] libmachine: Parsing certificate...
	I1028 05:20:44.287610   11984 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:20:44.455785   11984 main.go:141] libmachine: Creating SSH key...
	I1028 05:20:44.599328   11984 main.go:141] libmachine: Creating Disk image...
	I1028 05:20:44.599334   11984 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:20:44.599560   11984 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:44.610159   11984 main.go:141] libmachine: STDOUT: 
	I1028 05:20:44.610180   11984 main.go:141] libmachine: STDERR: 
	I1028 05:20:44.610262   11984 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2 +20000M
	I1028 05:20:44.618898   11984 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:20:44.618927   11984 main.go:141] libmachine: STDERR: 
	I1028 05:20:44.618944   11984 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:44.618948   11984 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:20:44.618956   11984 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:20:44.618985   11984 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/qemu.pid -device virtio-net-pci,netdev=net0,mac=52:3c:cf:20:8e:bd -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/addons-782000/disk.qcow2
	I1028 05:20:44.620787   11984 main.go:141] libmachine: STDOUT: 
	I1028 05:20:44.620808   11984 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:20:44.620822   11984 client.go:171] duration metric: took 334.429375ms to LocalClient.Create
	I1028 05:20:46.622954   11984 start.go:128] duration metric: took 2.40031075s to createHost
	I1028 05:20:46.623007   11984 start.go:83] releasing machines lock for "addons-782000", held for 2.400755416s
	W1028 05:20:46.623461   11984 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p addons-782000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p addons-782000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:20:46.632919   11984 out.go:201] 
	W1028 05:20:46.639907   11984 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:20:46.639943   11984 out.go:270] * 
	* 
	W1028 05:20:46.642869   11984 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:20:46.650917   11984 out.go:201] 

                                                
                                                
** /stderr **
addons_test.go:109: out/minikube-darwin-arm64 start -p addons-782000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher failed: exit status 80
--- FAIL: TestAddons/Setup (10.15s)

                                                
                                    
x
+
TestCertOptions (10.17s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-127000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-127000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.881311s)

                                                
                                                
-- stdout --
	* [cert-options-127000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "cert-options-127000" primary control-plane node in "cert-options-127000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-options-127000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-127000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-127000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-127000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-127000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (86.952791ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-127000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-127000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-127000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-127000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-127000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-127000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (46.946417ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-127000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-127000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-127000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-127000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-127000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-10-28 05:31:32.184319 -0700 PDT m=+676.462108543
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-127000 -n cert-options-127000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-127000 -n cert-options-127000: exit status 7 (35.413667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-127000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-127000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-127000
--- FAIL: TestCertOptions (10.17s)

                                                
                                    
x
+
TestCertExpiration (195.48s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=3m --driver=qemu2 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (10.126256667s)

                                                
                                                
-- stdout --
	* [cert-expiration-656000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "cert-expiration-656000" primary control-plane node in "cert-expiration-656000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-expiration-656000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-656000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=8760h --driver=qemu2 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.197165958s)

                                                
                                                
-- stdout --
	* [cert-expiration-656000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "cert-expiration-656000" primary control-plane node in "cert-expiration-656000" cluster
	* Restarting existing qemu2 VM for "cert-expiration-656000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-656000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-656000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-656000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-656000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "cert-expiration-656000" primary control-plane node in "cert-expiration-656000" cluster
	* Restarting existing qemu2 VM for "cert-expiration-656000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-656000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-656000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-10-28 05:34:32.281905 -0700 PDT m=+856.559317751
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-656000 -n cert-expiration-656000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-656000 -n cert-expiration-656000: exit status 7 (65.877334ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-656000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-656000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-656000
--- FAIL: TestCertExpiration (195.48s)

                                                
                                    
x
+
TestDockerFlags (10.27s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-510000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-510000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.031930125s)

                                                
                                                
-- stdout --
	* [docker-flags-510000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "docker-flags-510000" primary control-plane node in "docker-flags-510000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "docker-flags-510000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:31:11.896358   13784 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:31:11.896505   13784 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:11.896509   13784 out.go:358] Setting ErrFile to fd 2...
	I1028 05:31:11.896511   13784 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:11.896635   13784 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:31:11.897806   13784 out.go:352] Setting JSON to false
	I1028 05:31:11.915467   13784 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7242,"bootTime":1730111429,"procs":526,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:31:11.915527   13784 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:31:11.923710   13784 out.go:177] * [docker-flags-510000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:31:11.932624   13784 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:31:11.932674   13784 notify.go:220] Checking for updates...
	I1028 05:31:11.944525   13784 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:31:11.947595   13784 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:31:11.950532   13784 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:31:11.953569   13784 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:31:11.956589   13784 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:31:11.959911   13784 config.go:182] Loaded profile config "force-systemd-flag-548000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:31:11.959990   13784 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:31:11.960045   13784 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:31:11.964549   13784 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:31:11.971565   13784 start.go:297] selected driver: qemu2
	I1028 05:31:11.971572   13784 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:31:11.971579   13784 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:31:11.974194   13784 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:31:11.977535   13784 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:31:11.980685   13784 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I1028 05:31:11.980717   13784 cni.go:84] Creating CNI manager for ""
	I1028 05:31:11.980743   13784 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:31:11.980747   13784 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:31:11.980791   13784 start.go:340] cluster config:
	{Name:docker-flags-510000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:docker-flags-510000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn
etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:31:11.985737   13784 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:31:11.993587   13784 out.go:177] * Starting "docker-flags-510000" primary control-plane node in "docker-flags-510000" cluster
	I1028 05:31:11.996539   13784 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:31:11.996560   13784 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:31:11.996569   13784 cache.go:56] Caching tarball of preloaded images
	I1028 05:31:11.996657   13784 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:31:11.996663   13784 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:31:11.996730   13784 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/docker-flags-510000/config.json ...
	I1028 05:31:11.996741   13784 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/docker-flags-510000/config.json: {Name:mkaf27ae19bd674b8a1ce44a22d61829d6087eeb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:31:11.997131   13784 start.go:360] acquireMachinesLock for docker-flags-510000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:11.997183   13784 start.go:364] duration metric: took 45.958µs to acquireMachinesLock for "docker-flags-510000"
	I1028 05:31:11.997196   13784 start.go:93] Provisioning new machine with config: &{Name:docker-flags-510000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey
: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:docker-flags-510000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock
er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:11.997243   13784 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:12.004417   13784 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:12.022849   13784 start.go:159] libmachine.API.Create for "docker-flags-510000" (driver="qemu2")
	I1028 05:31:12.022884   13784 client.go:168] LocalClient.Create starting
	I1028 05:31:12.022964   13784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:12.023001   13784 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:12.023014   13784 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:12.023057   13784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:12.023088   13784 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:12.023097   13784 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:12.023515   13784 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:12.184561   13784 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:12.337902   13784 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:12.337910   13784 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:12.338118   13784 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:12.348404   13784 main.go:141] libmachine: STDOUT: 
	I1028 05:31:12.348421   13784 main.go:141] libmachine: STDERR: 
	I1028 05:31:12.348478   13784 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2 +20000M
	I1028 05:31:12.356886   13784 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:12.356902   13784 main.go:141] libmachine: STDERR: 
	I1028 05:31:12.356915   13784 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:12.356918   13784 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:12.356929   13784 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:12.356961   13784 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:3f:db:8c:77:6b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:12.358767   13784 main.go:141] libmachine: STDOUT: 
	I1028 05:31:12.358784   13784 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:12.358804   13784 client.go:171] duration metric: took 335.910125ms to LocalClient.Create
	I1028 05:31:14.361021   13784 start.go:128] duration metric: took 2.363740375s to createHost
	I1028 05:31:14.361084   13784 start.go:83] releasing machines lock for "docker-flags-510000", held for 2.363885625s
	W1028 05:31:14.361139   13784 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:14.376252   13784 out.go:177] * Deleting "docker-flags-510000" in qemu2 ...
	W1028 05:31:14.401824   13784 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:14.401853   13784 start.go:729] Will try again in 5 seconds ...
	I1028 05:31:19.404080   13784 start.go:360] acquireMachinesLock for docker-flags-510000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:19.404579   13784 start.go:364] duration metric: took 378.583µs to acquireMachinesLock for "docker-flags-510000"
	I1028 05:31:19.404714   13784 start.go:93] Provisioning new machine with config: &{Name:docker-flags-510000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey
: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:docker-flags-510000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock
er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:19.404992   13784 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:19.418206   13784 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:19.466566   13784 start.go:159] libmachine.API.Create for "docker-flags-510000" (driver="qemu2")
	I1028 05:31:19.466620   13784 client.go:168] LocalClient.Create starting
	I1028 05:31:19.466776   13784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:19.466865   13784 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:19.466888   13784 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:19.466964   13784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:19.467023   13784 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:19.467033   13784 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:19.467794   13784 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:19.641037   13784 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:19.830310   13784 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:19.830322   13784 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:19.830513   13784 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:19.840730   13784 main.go:141] libmachine: STDOUT: 
	I1028 05:31:19.840756   13784 main.go:141] libmachine: STDERR: 
	I1028 05:31:19.840822   13784 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2 +20000M
	I1028 05:31:19.849387   13784 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:19.849404   13784 main.go:141] libmachine: STDERR: 
	I1028 05:31:19.849421   13784 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:19.849426   13784 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:19.849433   13784 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:19.849469   13784 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/qemu.pid -device virtio-net-pci,netdev=net0,mac=46:1f:51:e3:51:61 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/docker-flags-510000/disk.qcow2
	I1028 05:31:19.851286   13784 main.go:141] libmachine: STDOUT: 
	I1028 05:31:19.851301   13784 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:19.851314   13784 client.go:171] duration metric: took 384.687792ms to LocalClient.Create
	I1028 05:31:21.853493   13784 start.go:128] duration metric: took 2.448449333s to createHost
	I1028 05:31:21.853556   13784 start.go:83] releasing machines lock for "docker-flags-510000", held for 2.448944375s
	W1028 05:31:21.853985   13784 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-510000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-510000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:21.864407   13784 out.go:201] 
	W1028 05:31:21.869665   13784 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:31:21.869700   13784 out.go:270] * 
	* 
	W1028 05:31:21.872381   13784 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:31:21.881601   13784 out.go:201] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-510000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-510000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-510000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (79.108125ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-510000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-510000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-510000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-510000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-510000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-510000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-510000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-510000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-510000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (46.698083ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-510000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-510000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-510000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-510000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-510000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-510000\"\n"
panic.go:629: *** TestDockerFlags FAILED at 2024-10-28 05:31:22.025077 -0700 PDT m=+666.302887626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-510000 -n docker-flags-510000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-510000 -n docker-flags-510000: exit status 7 (33.335125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-510000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-510000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-510000
--- FAIL: TestDockerFlags (10.27s)

                                                
                                    
x
+
TestForceSystemdFlag (10.05s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-548000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-548000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.844045042s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-548000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "force-systemd-flag-548000" primary control-plane node in "force-systemd-flag-548000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-flag-548000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:31:06.933215   13758 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:31:06.933407   13758 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:06.933410   13758 out.go:358] Setting ErrFile to fd 2...
	I1028 05:31:06.933412   13758 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:06.933529   13758 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:31:06.934704   13758 out.go:352] Setting JSON to false
	I1028 05:31:06.952266   13758 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7237,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:31:06.952340   13758 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:31:06.959680   13758 out.go:177] * [force-systemd-flag-548000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:31:06.974663   13758 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:31:06.974700   13758 notify.go:220] Checking for updates...
	I1028 05:31:06.983602   13758 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:31:06.987603   13758 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:31:06.990603   13758 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:31:06.993636   13758 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:31:06.996619   13758 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:31:06.999935   13758 config.go:182] Loaded profile config "force-systemd-env-120000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:31:07.000018   13758 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:31:07.000070   13758 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:31:07.004594   13758 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:31:07.010573   13758 start.go:297] selected driver: qemu2
	I1028 05:31:07.010579   13758 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:31:07.010585   13758 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:31:07.013260   13758 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:31:07.016603   13758 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:31:07.019653   13758 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:31:07.019668   13758 cni.go:84] Creating CNI manager for ""
	I1028 05:31:07.019690   13758 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:31:07.019700   13758 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:31:07.019728   13758 start.go:340] cluster config:
	{Name:force-systemd-flag-548000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-flag-548000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:31:07.024634   13758 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:31:07.032622   13758 out.go:177] * Starting "force-systemd-flag-548000" primary control-plane node in "force-systemd-flag-548000" cluster
	I1028 05:31:07.036594   13758 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:31:07.036613   13758 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:31:07.036622   13758 cache.go:56] Caching tarball of preloaded images
	I1028 05:31:07.036711   13758 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:31:07.036718   13758 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:31:07.036777   13758 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/force-systemd-flag-548000/config.json ...
	I1028 05:31:07.036789   13758 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/force-systemd-flag-548000/config.json: {Name:mkc7e626b6bf7401a61304a231ce907f3f1f5fd2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:31:07.037270   13758 start.go:360] acquireMachinesLock for force-systemd-flag-548000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:07.037330   13758 start.go:364] duration metric: took 49µs to acquireMachinesLock for "force-systemd-flag-548000"
	I1028 05:31:07.037344   13758 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-548000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-flag-548000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:07.037371   13758 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:07.045574   13758 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:07.064419   13758 start.go:159] libmachine.API.Create for "force-systemd-flag-548000" (driver="qemu2")
	I1028 05:31:07.064447   13758 client.go:168] LocalClient.Create starting
	I1028 05:31:07.064530   13758 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:07.064572   13758 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:07.064585   13758 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:07.064626   13758 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:07.064659   13758 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:07.064670   13758 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:07.065136   13758 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:07.223068   13758 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:07.287085   13758 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:07.287091   13758 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:07.287284   13758 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:07.297169   13758 main.go:141] libmachine: STDOUT: 
	I1028 05:31:07.297192   13758 main.go:141] libmachine: STDERR: 
	I1028 05:31:07.297242   13758 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2 +20000M
	I1028 05:31:07.305700   13758 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:07.305714   13758 main.go:141] libmachine: STDERR: 
	I1028 05:31:07.305735   13758 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:07.305744   13758 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:07.305756   13758 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:07.305783   13758 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:b7:e9:dc:ba:76 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:07.307613   13758 main.go:141] libmachine: STDOUT: 
	I1028 05:31:07.307647   13758 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:07.307668   13758 client.go:171] duration metric: took 243.213ms to LocalClient.Create
	I1028 05:31:09.309863   13758 start.go:128] duration metric: took 2.272464917s to createHost
	I1028 05:31:09.309946   13758 start.go:83] releasing machines lock for "force-systemd-flag-548000", held for 2.272600375s
	W1028 05:31:09.310049   13758 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:09.336202   13758 out.go:177] * Deleting "force-systemd-flag-548000" in qemu2 ...
	W1028 05:31:09.359652   13758 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:09.359674   13758 start.go:729] Will try again in 5 seconds ...
	I1028 05:31:14.361808   13758 start.go:360] acquireMachinesLock for force-systemd-flag-548000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:14.362233   13758 start.go:364] duration metric: took 348.917µs to acquireMachinesLock for "force-systemd-flag-548000"
	I1028 05:31:14.362321   13758 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-548000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-flag-548000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:14.362529   13758 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:14.376252   13758 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:14.425114   13758 start.go:159] libmachine.API.Create for "force-systemd-flag-548000" (driver="qemu2")
	I1028 05:31:14.425162   13758 client.go:168] LocalClient.Create starting
	I1028 05:31:14.425316   13758 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:14.425398   13758 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:14.425415   13758 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:14.425474   13758 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:14.425530   13758 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:14.425546   13758 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:14.426313   13758 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:14.601275   13758 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:14.670235   13758 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:14.670240   13758 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:14.670445   13758 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:14.680506   13758 main.go:141] libmachine: STDOUT: 
	I1028 05:31:14.680526   13758 main.go:141] libmachine: STDERR: 
	I1028 05:31:14.680596   13758 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2 +20000M
	I1028 05:31:14.689189   13758 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:14.689211   13758 main.go:141] libmachine: STDERR: 
	I1028 05:31:14.689227   13758 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:14.689233   13758 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:14.689242   13758 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:14.689269   13758 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/qemu.pid -device virtio-net-pci,netdev=net0,mac=da:34:67:58:d6:90 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-flag-548000/disk.qcow2
	I1028 05:31:14.691175   13758 main.go:141] libmachine: STDOUT: 
	I1028 05:31:14.691188   13758 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:14.691201   13758 client.go:171] duration metric: took 266.033791ms to LocalClient.Create
	I1028 05:31:16.693420   13758 start.go:128] duration metric: took 2.330851209s to createHost
	I1028 05:31:16.693514   13758 start.go:83] releasing machines lock for "force-systemd-flag-548000", held for 2.331241s
	W1028 05:31:16.693854   13758 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-548000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-548000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:16.706572   13758 out.go:201] 
	W1028 05:31:16.717578   13758 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:31:16.717607   13758 out.go:270] * 
	* 
	W1028 05:31:16.720091   13758 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:31:16.731506   13758 out.go:201] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-548000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-548000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-548000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (87.705958ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-548000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-548000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-548000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-10-28 05:31:16.836626 -0700 PDT m=+661.114447543
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-548000 -n force-systemd-flag-548000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-548000 -n force-systemd-flag-548000: exit status 7 (36.82325ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-548000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-548000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-548000
--- FAIL: TestForceSystemdFlag (10.05s)

                                                
                                    
x
+
TestForceSystemdEnv (10.28s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-120000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 
I1028 05:31:01.715937   11909 install.go:79] stdout: 
W1028 05:31:01.716039   11909 out.go:174] [unset outFile]: * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
I1028 05:31:01.716059   11909 install.go:99] testing: [sudo -n chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit]
I1028 05:31:01.731437   11909 install.go:106] running: [sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit]
I1028 05:31:01.744086   11909 install.go:99] testing: [sudo -n chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit]
I1028 05:31:01.754674   11909 install.go:106] running: [sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit]
I1028 05:31:01.781287   11909 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1028 05:31:01.781415   11909 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/workspace/testdata/hyperkit-driver-older-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin:/opt/homebrew/bin
I1028 05:31:03.576807   11909 install.go:137] /Users/jenkins/workspace/testdata/hyperkit-driver-older-version/docker-machine-driver-hyperkit version is 1.2.0
W1028 05:31:03.576825   11909 install.go:62] docker-machine-driver-hyperkit: docker-machine-driver-hyperkit is version 1.2.0, want 1.11.0
W1028 05:31:03.576881   11909 out.go:174] [unset outFile]: * Downloading driver docker-machine-driver-hyperkit:
I1028 05:31:03.576909   11909 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64.sha256 -> /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit
I1028 05:31:03.982373   11909 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64.sha256 Dst:/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0] Decompressors:map[bz2:0x140005cce10 gz:0x140005cce18 tar:0x140005ccdc0 tar.bz2:0x140005ccdd0 tar.gz:0x140005ccde0 tar.xz:0x140005ccdf0 tar.zst:0x140005cce00 tbz2:0x140005ccdd0 tgz:0x140005ccde0 txz:0x140005ccdf0 tzst:0x140005cce00 xz:0x140005cce20 zip:0x140005cce30 zst:0x140005cce28] Getters:map[file:0x1400088e400 http:0x140008a04b0 https:0x140008a0500] Dir:false ProgressListener:<nil> Insecure:false DisableSy
mlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404. trying to get the common version
I1028 05:31:03.982485   11909 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit.sha256 -> /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit
I1028 05:31:06.850260   11909 install.go:79] stdout: 
W1028 05:31:06.850508   11909 out.go:174] [unset outFile]: * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
I1028 05:31:06.850536   11909 install.go:99] testing: [sudo -n chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit]
I1028 05:31:06.867161   11909 install.go:106] running: [sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit]
I1028 05:31:06.879878   11909 install.go:99] testing: [sudo -n chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit]
I1028 05:31:06.890205   11909 install.go:106] running: [sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/002/docker-machine-driver-hyperkit]
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-120000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.067567083s)

                                                
                                                
-- stdout --
	* [force-systemd-env-120000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "force-systemd-env-120000" primary control-plane node in "force-systemd-env-120000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-env-120000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:31:01.619457   13726 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:31:01.619606   13726 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:01.619609   13726 out.go:358] Setting ErrFile to fd 2...
	I1028 05:31:01.619612   13726 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:31:01.619743   13726 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:31:01.620945   13726 out.go:352] Setting JSON to false
	I1028 05:31:01.639151   13726 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7232,"bootTime":1730111429,"procs":527,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:31:01.639218   13726 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:31:01.644436   13726 out.go:177] * [force-systemd-env-120000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:31:01.651314   13726 notify.go:220] Checking for updates...
	I1028 05:31:01.655249   13726 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:31:01.663243   13726 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:31:01.671238   13726 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:31:01.680121   13726 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:31:01.688360   13726 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:31:01.696306   13726 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I1028 05:31:01.699606   13726 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:31:01.699659   13726 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:31:01.703254   13726 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:31:01.711289   13726 start.go:297] selected driver: qemu2
	I1028 05:31:01.711299   13726 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:31:01.711306   13726 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:31:01.713930   13726 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:31:01.718245   13726 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:31:01.721336   13726 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:31:01.721355   13726 cni.go:84] Creating CNI manager for ""
	I1028 05:31:01.721385   13726 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:31:01.721396   13726 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:31:01.721440   13726 start.go:340] cluster config:
	{Name:force-systemd-env-120000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-env-120000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP
: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:31:01.725553   13726 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:31:01.734310   13726 out.go:177] * Starting "force-systemd-env-120000" primary control-plane node in "force-systemd-env-120000" cluster
	I1028 05:31:01.738304   13726 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:31:01.738333   13726 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:31:01.738343   13726 cache.go:56] Caching tarball of preloaded images
	I1028 05:31:01.738421   13726 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:31:01.738427   13726 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:31:01.738487   13726 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/force-systemd-env-120000/config.json ...
	I1028 05:31:01.738497   13726 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/force-systemd-env-120000/config.json: {Name:mka18656fc61ce44ba75cc186ef925a4930037b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:31:01.738716   13726 start.go:360] acquireMachinesLock for force-systemd-env-120000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:01.738759   13726 start.go:364] duration metric: took 37.292µs to acquireMachinesLock for "force-systemd-env-120000"
	I1028 05:31:01.738771   13726 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-120000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-env-120000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:01.738798   13726 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:01.743299   13726 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:01.758295   13726 start.go:159] libmachine.API.Create for "force-systemd-env-120000" (driver="qemu2")
	I1028 05:31:01.758323   13726 client.go:168] LocalClient.Create starting
	I1028 05:31:01.758392   13726 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:01.758429   13726 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:01.758441   13726 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:01.758479   13726 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:01.758507   13726 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:01.758516   13726 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:01.758870   13726 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:01.915589   13726 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:01.997070   13726 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:01.997079   13726 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:01.997301   13726 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:02.007455   13726 main.go:141] libmachine: STDOUT: 
	I1028 05:31:02.007476   13726 main.go:141] libmachine: STDERR: 
	I1028 05:31:02.007534   13726 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2 +20000M
	I1028 05:31:02.016304   13726 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:02.016359   13726 main.go:141] libmachine: STDERR: 
	I1028 05:31:02.016374   13726 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:02.016380   13726 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:02.016400   13726 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:02.016429   13726 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:ca:f8:1b:a0:df -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:02.018275   13726 main.go:141] libmachine: STDOUT: 
	I1028 05:31:02.018338   13726 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:02.018356   13726 client.go:171] duration metric: took 260.028667ms to LocalClient.Create
	I1028 05:31:04.020576   13726 start.go:128] duration metric: took 2.28174125s to createHost
	I1028 05:31:04.020656   13726 start.go:83] releasing machines lock for "force-systemd-env-120000", held for 2.281880959s
	W1028 05:31:04.020749   13726 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:04.028970   13726 out.go:177] * Deleting "force-systemd-env-120000" in qemu2 ...
	W1028 05:31:04.066305   13726 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:04.066332   13726 start.go:729] Will try again in 5 seconds ...
	I1028 05:31:09.068609   13726 start.go:360] acquireMachinesLock for force-systemd-env-120000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:31:09.310072   13726 start.go:364] duration metric: took 241.31625ms to acquireMachinesLock for "force-systemd-env-120000"
	I1028 05:31:09.310261   13726 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-120000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.31.2 ClusterName:force-systemd-env-120000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:31:09.310541   13726 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:31:09.324194   13726 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1028 05:31:09.374010   13726 start.go:159] libmachine.API.Create for "force-systemd-env-120000" (driver="qemu2")
	I1028 05:31:09.374065   13726 client.go:168] LocalClient.Create starting
	I1028 05:31:09.374202   13726 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:31:09.374291   13726 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:09.374309   13726 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:09.374377   13726 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:31:09.374439   13726 main.go:141] libmachine: Decoding PEM data...
	I1028 05:31:09.374454   13726 main.go:141] libmachine: Parsing certificate...
	I1028 05:31:09.375082   13726 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:31:09.546098   13726 main.go:141] libmachine: Creating SSH key...
	I1028 05:31:09.577346   13726 main.go:141] libmachine: Creating Disk image...
	I1028 05:31:09.577352   13726 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:31:09.577541   13726 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:09.587479   13726 main.go:141] libmachine: STDOUT: 
	I1028 05:31:09.587501   13726 main.go:141] libmachine: STDERR: 
	I1028 05:31:09.587592   13726 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2 +20000M
	I1028 05:31:09.596095   13726 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:31:09.596109   13726 main.go:141] libmachine: STDERR: 
	I1028 05:31:09.596122   13726 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:09.596134   13726 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:31:09.596143   13726 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:31:09.596190   13726 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:22:a2:2e:ff:92 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/force-systemd-env-120000/disk.qcow2
	I1028 05:31:09.597997   13726 main.go:141] libmachine: STDOUT: 
	I1028 05:31:09.598016   13726 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:31:09.598027   13726 client.go:171] duration metric: took 223.955ms to LocalClient.Create
	I1028 05:31:11.600262   13726 start.go:128] duration metric: took 2.289673083s to createHost
	I1028 05:31:11.600341   13726 start.go:83] releasing machines lock for "force-systemd-env-120000", held for 2.290234875s
	W1028 05:31:11.600796   13726 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-120000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-120000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:31:11.613610   13726 out.go:201] 
	W1028 05:31:11.624845   13726 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:31:11.624870   13726 out.go:270] * 
	* 
	W1028 05:31:11.627308   13726 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:31:11.637516   13726 out.go:201] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-120000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-120000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-120000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (91.755917ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-120000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-120000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-120000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-10-28 05:31:11.747595 -0700 PDT m=+656.025426959
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-120000 -n force-systemd-env-120000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-120000 -n force-systemd-env-120000: exit status 7 (35.520125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-120000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-120000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-120000
--- FAIL: TestForceSystemdEnv (10.28s)

                                                
                                    
x
+
TestErrorSpam/setup (9.91s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -p nospam-784000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 --driver=qemu2 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p nospam-784000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 --driver=qemu2 : exit status 80 (9.9097145s)

                                                
                                                
-- stdout --
	* [nospam-784000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "nospam-784000" primary control-plane node in "nospam-784000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "nospam-784000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p nospam-784000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-arm64 start -p nospam-784000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 --driver=qemu2 " failed: exit status 80
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"
error_spam_test.go:96: unexpected stderr: "* Failed to start qemu2 VM. Running \"minikube delete -p nospam-784000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"
error_spam_test.go:96: unexpected stderr: "* "
error_spam_test.go:96: unexpected stderr: "╭─────────────────────────────────────────────────────────────────────────────────────────────╮"
error_spam_test.go:96: unexpected stderr: "│                                                                                             │"
error_spam_test.go:96: unexpected stderr: "│    * If the above advice does not help, please let us know:                                 │"
error_spam_test.go:96: unexpected stderr: "│      https://github.com/kubernetes/minikube/issues/new/choose                               │"
error_spam_test.go:96: unexpected stderr: "│                                                                                             │"
error_spam_test.go:96: unexpected stderr: "│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │"
error_spam_test.go:96: unexpected stderr: "│                                                                                             │"
error_spam_test.go:96: unexpected stderr: "╰─────────────────────────────────────────────────────────────────────────────────────────────╯"
error_spam_test.go:110: minikube stdout:
* [nospam-784000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
- MINIKUBE_LOCATION=19865
- KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the qemu2 driver based on user configuration
* Automatically selected the socket_vmnet network
* Starting "nospam-784000" primary control-plane node in "nospam-784000" cluster
* Creating qemu2 VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
OUTPUT: 
ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
* Deleting "nospam-784000" in qemu2 ...
* Creating qemu2 VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
OUTPUT: 
ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
* Failed to start qemu2 VM. Running "minikube delete -p nospam-784000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
* 
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (9.91s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (9.94s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2234: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 
functional_test.go:2234: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-382000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 : exit status 80 (9.863984416s)

                                                
                                                
-- stdout --
	* [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "functional-382000" primary control-plane node in "functional-382000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "functional-382000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
	* Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2236: failed minikube start. args "out/minikube-darwin-arm64 start -p functional-382000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 ": exit status 80
functional_test.go:2241: start stdout=* [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
- MINIKUBE_LOCATION=19865
- KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the qemu2 driver based on user configuration
* Automatically selected the socket_vmnet network
* Starting "functional-382000" primary control-plane node in "functional-382000" cluster
* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
OUTPUT: 
ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
* Deleting "functional-382000" in qemu2 ...
* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
OUTPUT: 
ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2246: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
! Local proxy ignored: not passing HTTP_PROXY=localhost:58832 to docker env.
* Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
* 
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (77.238042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (9.94s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.27s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
I1028 05:21:16.670459   11909 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test.go:659: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --alsologtostderr -v=8
functional_test.go:659: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-382000 --alsologtostderr -v=8: exit status 80 (5.192404084s)

                                                
                                                
-- stdout --
	* [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "functional-382000" primary control-plane node in "functional-382000" cluster
	* Restarting existing qemu2 VM for "functional-382000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "functional-382000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:21:16.703575   12136 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:21:16.703721   12136 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:21:16.703725   12136 out.go:358] Setting ErrFile to fd 2...
	I1028 05:21:16.703727   12136 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:21:16.703862   12136 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:21:16.704939   12136 out.go:352] Setting JSON to false
	I1028 05:21:16.722518   12136 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6647,"bootTime":1730111429,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:21:16.722623   12136 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:21:16.726959   12136 out.go:177] * [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:21:16.734825   12136 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:21:16.734862   12136 notify.go:220] Checking for updates...
	I1028 05:21:16.741719   12136 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:21:16.745746   12136 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:21:16.749771   12136 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:21:16.752732   12136 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:21:16.755870   12136 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:21:16.759112   12136 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:21:16.759170   12136 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:21:16.763739   12136 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:21:16.770829   12136 start.go:297] selected driver: qemu2
	I1028 05:21:16.770836   12136 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:21:16.770900   12136 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:21:16.773464   12136 cni.go:84] Creating CNI manager for ""
	I1028 05:21:16.773501   12136 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:21:16.773547   12136 start.go:340] cluster config:
	{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:f
alse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:21:16.778014   12136 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:21:16.785754   12136 out.go:177] * Starting "functional-382000" primary control-plane node in "functional-382000" cluster
	I1028 05:21:16.789643   12136 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:21:16.789663   12136 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:21:16.789671   12136 cache.go:56] Caching tarball of preloaded images
	I1028 05:21:16.789746   12136 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:21:16.789757   12136 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:21:16.789812   12136 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/functional-382000/config.json ...
	I1028 05:21:16.790281   12136 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:21:16.790311   12136 start.go:364] duration metric: took 24.292µs to acquireMachinesLock for "functional-382000"
	I1028 05:21:16.790319   12136 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:21:16.790323   12136 fix.go:54] fixHost starting: 
	I1028 05:21:16.790446   12136 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
	W1028 05:21:16.790454   12136 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:21:16.798810   12136 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
	I1028 05:21:16.802735   12136 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:21:16.802772   12136 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
	I1028 05:21:16.804943   12136 main.go:141] libmachine: STDOUT: 
	I1028 05:21:16.804962   12136 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:21:16.804993   12136 fix.go:56] duration metric: took 14.667334ms for fixHost
	I1028 05:21:16.804998   12136 start.go:83] releasing machines lock for "functional-382000", held for 14.683458ms
	W1028 05:21:16.805004   12136 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:21:16.805038   12136 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:21:16.805042   12136 start.go:729] Will try again in 5 seconds ...
	I1028 05:21:21.807145   12136 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:21:21.807641   12136 start.go:364] duration metric: took 408.708µs to acquireMachinesLock for "functional-382000"
	I1028 05:21:21.807769   12136 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:21:21.807789   12136 fix.go:54] fixHost starting: 
	I1028 05:21:21.808542   12136 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
	W1028 05:21:21.808569   12136 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:21:21.812772   12136 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
	I1028 05:21:21.816955   12136 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:21:21.817204   12136 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
	I1028 05:21:21.827367   12136 main.go:141] libmachine: STDOUT: 
	I1028 05:21:21.827435   12136 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:21:21.827502   12136 fix.go:56] duration metric: took 19.714541ms for fixHost
	I1028 05:21:21.827521   12136 start.go:83] releasing machines lock for "functional-382000", held for 19.860917ms
	W1028 05:21:21.827680   12136 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:21:21.835880   12136 out.go:201] 
	W1028 05:21:21.839064   12136 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:21:21.839090   12136 out.go:270] * 
	* 
	W1028 05:21:21.841881   12136 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:21:21.848832   12136 out.go:201] 

                                                
                                                
** /stderr **
functional_test.go:661: failed to soft start minikube. args "out/minikube-darwin-arm64 start -p functional-382000 --alsologtostderr -v=8": exit status 80
functional_test.go:663: soft start took 5.194294875s for "functional-382000" cluster.
I1028 05:21:21.865042   11909 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (72.3535ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.27s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:681: (dbg) Run:  kubectl config current-context
functional_test.go:681: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (28.727416ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:683: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:687: expected current-context = "functional-382000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.943708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.06s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:696: (dbg) Run:  kubectl --context functional-382000 get po -A
functional_test.go:696: (dbg) Non-zero exit: kubectl --context functional-382000 get po -A: exit status 1 (26.823791ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:698: failed to get kubectl pods: args "kubectl --context functional-382000 get po -A" : exit status 1
functional_test.go:702: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-382000\n"*: args "kubectl --context functional-382000 get po -A"
functional_test.go:705: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-382000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.849584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1124: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl images
functional_test.go:1124: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl images: exit status 83 (48.465208ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1126: failed to get images by "out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl images" ssh exit status 83
functional_test.go:1130: expected sha for pause:3.3 "3d18732f8686c" to be in the output but got *
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.19s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1147: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1147: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 83 (56.764ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1150: failed to manually delete image "out/minikube-darwin-arm64 -p functional-382000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 83
functional_test.go:1153: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (46.852542ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1158: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache reload
functional_test.go:1163: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1163: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (46.838291ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1165: expected "out/minikube-darwin-arm64 -p functional-382000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 83
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.19s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.74s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:716: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 kubectl -- --context functional-382000 get pods
functional_test.go:716: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 kubectl -- --context functional-382000 get pods: exit status 1 (702.956459ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-382000
	* no server found for cluster "functional-382000"

                                                
                                                
** /stderr **
functional_test.go:719: failed to get pods. args "out/minikube-darwin-arm64 -p functional-382000 kubectl -- --context functional-382000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (35.85425ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.74s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (1.19s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:741: (dbg) Run:  out/kubectl --context functional-382000 get pods
functional_test.go:741: (dbg) Non-zero exit: out/kubectl --context functional-382000 get pods: exit status 1 (1.161036417s)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-382000
	* no server found for cluster "functional-382000"

                                                
                                                
** /stderr **
functional_test.go:744: failed to run kubectl directly. args "out/kubectl --context functional-382000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (33.162792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (1.19s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.27s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:757: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:757: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-382000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 80 (5.190037792s)

                                                
                                                
-- stdout --
	* [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "functional-382000" primary control-plane node in "functional-382000" cluster
	* Restarting existing qemu2 VM for "functional-382000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "functional-382000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:759: failed to restart minikube. args "out/minikube-darwin-arm64 start -p functional-382000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 80
functional_test.go:761: restart took 5.19054675s for "functional-382000" cluster.
I1028 05:21:32.645637   11909 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (75.139583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.27s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:810: (dbg) Run:  kubectl --context functional-382000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:810: (dbg) Non-zero exit: kubectl --context functional-382000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (28.335625ms)

                                                
                                                
** stderr ** 
	error: context "functional-382000" does not exist

                                                
                                                
** /stderr **
functional_test.go:812: failed to get components. args "kubectl --context functional-382000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.569791ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.06s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1236: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 logs
functional_test.go:1236: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 logs: exit status 83 (83.678584ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                   Args                                   |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | -p download-only-116000                                                  |                      |         |         |                     |                     |
	|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                                             |                      |         |         |                     |                     |
	|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
	| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| start   | -o=json --download-only                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | -p download-only-575000                                                  |                      |         |         |                     |                     |
	|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2                                             |                      |         |         |                     |                     |
	|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
	| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| start   | --download-only -p                                                       | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | binary-mirror-410000                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                        |                      |         |         |                     |                     |
	|         | --binary-mirror                                                          |                      |         |         |                     |                     |
	|         | http://127.0.0.1:58797                                                   |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-410000                                                  | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| addons  | disable dashboard -p                                                     | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | addons-782000                                                            |                      |         |         |                     |                     |
	| addons  | enable dashboard -p                                                      | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | addons-782000                                                            |                      |         |         |                     |                     |
	| start   | -p addons-782000 --wait=true                                             | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | --memory=4000 --alsologtostderr                                          |                      |         |         |                     |                     |
	|         | --addons=registry                                                        |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                  |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                 |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                             |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                        |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                   |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                            |                      |         |         |                     |                     |
	|         | --addons=yakd --addons=volcano                                           |                      |         |         |                     |                     |
	|         | --addons=amd-gpu-device-plugin                                           |                      |         |         |                     |                     |
	|         | --driver=qemu2  --addons=ingress                                         |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                     |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                     |                      |         |         |                     |                     |
	| delete  | -p addons-782000                                                         | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| start   | -p nospam-784000 -n=1 --memory=2250 --wait=false                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
	| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | start --dry-run                                                          |                      |         |         |                     |                     |
	| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | start --dry-run                                                          |                      |         |         |                     |                     |
	| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | start --dry-run                                                          |                      |         |         |                     |                     |
	| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | pause                                                                    |                      |         |         |                     |                     |
	| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | pause                                                                    |                      |         |         |                     |                     |
	| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | pause                                                                    |                      |         |         |                     |                     |
	| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | unpause                                                                  |                      |         |         |                     |                     |
	| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | unpause                                                                  |                      |         |         |                     |                     |
	| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | unpause                                                                  |                      |         |         |                     |                     |
	| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:21 PDT |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | stop                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | stop                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
	|         | stop                                                                     |                      |         |         |                     |                     |
	| delete  | -p nospam-784000                                                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | --memory=4000                                                            |                      |         |         |                     |                     |
	|         | --apiserver-port=8441                                                    |                      |         |         |                     |                     |
	|         | --wait=all --driver=qemu2                                                |                      |         |         |                     |                     |
	| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | --alsologtostderr -v=8                                                   |                      |         |         |                     |                     |
	| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
	| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
	| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
	| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
	| cache   | functional-382000 cache delete                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
	| cache   | list                                                                     | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	| ssh     | functional-382000 ssh sudo                                               | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | crictl images                                                            |                      |         |         |                     |                     |
	| ssh     | functional-382000                                                        | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | ssh sudo docker rmi                                                      |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
	| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
	| cache   | functional-382000 cache reload                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
	|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
	| kubectl | functional-382000 kubectl --                                             | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | --context functional-382000                                              |                      |         |         |                     |                     |
	|         | get pods                                                                 |                      |         |         |                     |                     |
	| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |         |                     |                     |
	|         | --wait=all                                                               |                      |         |         |                     |                     |
	|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 05:21:27
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.23.2 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 05:21:27.485547   12211 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:21:27.485699   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:21:27.485701   12211 out.go:358] Setting ErrFile to fd 2...
	I1028 05:21:27.485702   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:21:27.485816   12211 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:21:27.486914   12211 out.go:352] Setting JSON to false
	I1028 05:21:27.504224   12211 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6658,"bootTime":1730111429,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:21:27.504300   12211 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:21:27.509751   12211 out.go:177] * [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:21:27.518017   12211 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:21:27.518051   12211 notify.go:220] Checking for updates...
	I1028 05:21:27.525951   12211 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:21:27.528914   12211 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:21:27.531931   12211 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:21:27.534982   12211 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:21:27.536252   12211 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:21:27.539265   12211 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:21:27.539311   12211 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:21:27.543919   12211 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:21:27.548966   12211 start.go:297] selected driver: qemu2
	I1028 05:21:27.548971   12211 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:21:27.549029   12211 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:21:27.551587   12211 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:21:27.551609   12211 cni.go:84] Creating CNI manager for ""
	I1028 05:21:27.551637   12211 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:21:27.551683   12211 start.go:340] cluster config:
	{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:21:27.556156   12211 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:21:27.562922   12211 out.go:177] * Starting "functional-382000" primary control-plane node in "functional-382000" cluster
	I1028 05:21:27.566929   12211 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:21:27.566943   12211 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:21:27.566952   12211 cache.go:56] Caching tarball of preloaded images
	I1028 05:21:27.567038   12211 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:21:27.567042   12211 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:21:27.567087   12211 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/functional-382000/config.json ...
	I1028 05:21:27.567534   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:21:27.567579   12211 start.go:364] duration metric: took 40.708µs to acquireMachinesLock for "functional-382000"
	I1028 05:21:27.567586   12211 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:21:27.567588   12211 fix.go:54] fixHost starting: 
	I1028 05:21:27.567697   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
	W1028 05:21:27.567703   12211 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:21:27.575931   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
	I1028 05:21:27.579944   12211 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:21:27.579980   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
	I1028 05:21:27.582220   12211 main.go:141] libmachine: STDOUT: 
	I1028 05:21:27.582234   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:21:27.582263   12211 fix.go:56] duration metric: took 14.673875ms for fixHost
	I1028 05:21:27.582267   12211 start.go:83] releasing machines lock for "functional-382000", held for 14.685542ms
	W1028 05:21:27.582271   12211 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:21:27.582315   12211 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:21:27.582319   12211 start.go:729] Will try again in 5 seconds ...
	I1028 05:21:32.584422   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:21:32.584774   12211 start.go:364] duration metric: took 292.917µs to acquireMachinesLock for "functional-382000"
	I1028 05:21:32.584876   12211 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:21:32.584889   12211 fix.go:54] fixHost starting: 
	I1028 05:21:32.585554   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
	W1028 05:21:32.585571   12211 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:21:32.589031   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
	I1028 05:21:32.597008   12211 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:21:32.597236   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
	I1028 05:21:32.607093   12211 main.go:141] libmachine: STDOUT: 
	I1028 05:21:32.607137   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:21:32.607214   12211 fix.go:56] duration metric: took 22.330209ms for fixHost
	I1028 05:21:32.607231   12211 start.go:83] releasing machines lock for "functional-382000", held for 22.445417ms
	W1028 05:21:32.607405   12211 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:21:32.615959   12211 out.go:201] 
	W1028 05:21:32.620059   12211 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:21:32.620080   12211 out.go:270] * 
	W1028 05:21:32.622853   12211 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:21:32.631071   12211 out.go:201] 
	
	
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1238: out/minikube-darwin-arm64 -p functional-382000 logs failed: exit status 83
functional_test.go:1228: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                   Args                                   |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start   | -o=json --download-only                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | -p download-only-116000                                                  |                      |         |         |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
|         | --kubernetes-version=v1.20.0                                             |                      |         |         |                     |                     |
|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | -o=json --download-only                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | -p download-only-575000                                                  |                      |         |         |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
|         | --kubernetes-version=v1.31.2                                             |                      |         |         |                     |                     |
|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | --download-only -p                                                       | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | binary-mirror-410000                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr                                                        |                      |         |         |                     |                     |
|         | --binary-mirror                                                          |                      |         |         |                     |                     |
|         | http://127.0.0.1:58797                                                   |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-410000                                                  | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| addons  | disable dashboard -p                                                     | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | addons-782000                                                            |                      |         |         |                     |                     |
| addons  | enable dashboard -p                                                      | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | addons-782000                                                            |                      |         |         |                     |                     |
| start   | -p addons-782000 --wait=true                                             | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | --memory=4000 --alsologtostderr                                          |                      |         |         |                     |                     |
|         | --addons=registry                                                        |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                  |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                 |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                             |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                        |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                   |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                            |                      |         |         |                     |                     |
|         | --addons=yakd --addons=volcano                                           |                      |         |         |                     |                     |
|         | --addons=amd-gpu-device-plugin                                           |                      |         |         |                     |                     |
|         | --driver=qemu2  --addons=ingress                                         |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                     |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                     |                      |         |         |                     |                     |
| delete  | -p addons-782000                                                         | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | -p nospam-784000 -n=1 --memory=2250 --wait=false                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| delete  | -p nospam-784000                                                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --memory=4000                                                            |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                    |                      |         |         |                     |                     |
|         | --wait=all --driver=qemu2                                                |                      |         |         |                     |                     |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --alsologtostderr -v=8                                                   |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
| cache   | functional-382000 cache delete                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
| cache   | list                                                                     | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| ssh     | functional-382000 ssh sudo                                               | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | crictl images                                                            |                      |         |         |                     |                     |
| ssh     | functional-382000                                                        | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | ssh sudo docker rmi                                                      |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | functional-382000 cache reload                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| kubectl | functional-382000 kubectl --                                             | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --context functional-382000                                              |                      |         |         |                     |                     |
|         | get pods                                                                 |                      |         |         |                     |                     |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |         |                     |                     |
|         | --wait=all                                                               |                      |         |         |                     |                     |
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/10/28 05:21:27
Running on machine: MacOS-M1-Agent-1
Binary: Built with gc go1.23.2 for darwin/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1028 05:21:27.485547   12211 out.go:345] Setting OutFile to fd 1 ...
I1028 05:21:27.485699   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:27.485701   12211 out.go:358] Setting ErrFile to fd 2...
I1028 05:21:27.485702   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:27.485816   12211 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:21:27.486914   12211 out.go:352] Setting JSON to false
I1028 05:21:27.504224   12211 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6658,"bootTime":1730111429,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
W1028 05:21:27.504300   12211 start.go:137] gopshost.Virtualization returned error: not implemented yet
I1028 05:21:27.509751   12211 out.go:177] * [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
I1028 05:21:27.518017   12211 out.go:177]   - MINIKUBE_LOCATION=19865
I1028 05:21:27.518051   12211 notify.go:220] Checking for updates...
I1028 05:21:27.525951   12211 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
I1028 05:21:27.528914   12211 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
I1028 05:21:27.531931   12211 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1028 05:21:27.534982   12211 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
I1028 05:21:27.536252   12211 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I1028 05:21:27.539265   12211 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:21:27.539311   12211 driver.go:394] Setting default libvirt URI to qemu:///system
I1028 05:21:27.543919   12211 out.go:177] * Using the qemu2 driver based on existing profile
I1028 05:21:27.548966   12211 start.go:297] selected driver: qemu2
I1028 05:21:27.548971   12211 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1028 05:21:27.549029   12211 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1028 05:21:27.551587   12211 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1028 05:21:27.551609   12211 cni.go:84] Creating CNI manager for ""
I1028 05:21:27.551637   12211 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1028 05:21:27.551683   12211 start.go:340] cluster config:
{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1028 05:21:27.556156   12211 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1028 05:21:27.562922   12211 out.go:177] * Starting "functional-382000" primary control-plane node in "functional-382000" cluster
I1028 05:21:27.566929   12211 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1028 05:21:27.566943   12211 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
I1028 05:21:27.566952   12211 cache.go:56] Caching tarball of preloaded images
I1028 05:21:27.567038   12211 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I1028 05:21:27.567042   12211 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
I1028 05:21:27.567087   12211 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/functional-382000/config.json ...
I1028 05:21:27.567534   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1028 05:21:27.567579   12211 start.go:364] duration metric: took 40.708µs to acquireMachinesLock for "functional-382000"
I1028 05:21:27.567586   12211 start.go:96] Skipping create...Using existing machine configuration
I1028 05:21:27.567588   12211 fix.go:54] fixHost starting: 
I1028 05:21:27.567697   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
W1028 05:21:27.567703   12211 fix.go:138] unexpected machine state, will restart: <nil>
I1028 05:21:27.575931   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
I1028 05:21:27.579944   12211 qemu.go:418] Using hvf for hardware acceleration
I1028 05:21:27.579980   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
I1028 05:21:27.582220   12211 main.go:141] libmachine: STDOUT: 
I1028 05:21:27.582234   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I1028 05:21:27.582263   12211 fix.go:56] duration metric: took 14.673875ms for fixHost
I1028 05:21:27.582267   12211 start.go:83] releasing machines lock for "functional-382000", held for 14.685542ms
W1028 05:21:27.582271   12211 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W1028 05:21:27.582315   12211 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I1028 05:21:27.582319   12211 start.go:729] Will try again in 5 seconds ...
I1028 05:21:32.584422   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1028 05:21:32.584774   12211 start.go:364] duration metric: took 292.917µs to acquireMachinesLock for "functional-382000"
I1028 05:21:32.584876   12211 start.go:96] Skipping create...Using existing machine configuration
I1028 05:21:32.584889   12211 fix.go:54] fixHost starting: 
I1028 05:21:32.585554   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
W1028 05:21:32.585571   12211 fix.go:138] unexpected machine state, will restart: <nil>
I1028 05:21:32.589031   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
I1028 05:21:32.597008   12211 qemu.go:418] Using hvf for hardware acceleration
I1028 05:21:32.597236   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
I1028 05:21:32.607093   12211 main.go:141] libmachine: STDOUT: 
I1028 05:21:32.607137   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I1028 05:21:32.607214   12211 fix.go:56] duration metric: took 22.330209ms for fixHost
I1028 05:21:32.607231   12211 start.go:83] releasing machines lock for "functional-382000", held for 22.445417ms
W1028 05:21:32.607405   12211 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I1028 05:21:32.615959   12211 out.go:201] 
W1028 05:21:32.620059   12211 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W1028 05:21:32.620080   12211 out.go:270] * 
W1028 05:21:32.622853   12211 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1028 05:21:32.631071   12211 out.go:201] 

                                                
                                                

                                                
                                                
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.08s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1250: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 logs --file /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalserialLogsFileCmd54596665/001/logs.txt
functional_test.go:1228: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                   Args                                   |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| start   | -o=json --download-only                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | -p download-only-116000                                                  |                      |         |         |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
|         | --kubernetes-version=v1.20.0                                             |                      |         |         |                     |                     |
|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | -o=json --download-only                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | -p download-only-575000                                                  |                      |         |         |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |         |                     |                     |
|         | --kubernetes-version=v1.31.2                                             |                      |         |         |                     |                     |
|         | --container-runtime=docker                                               |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-116000                                                  | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| delete  | -p download-only-575000                                                  | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | --download-only -p                                                       | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | binary-mirror-410000                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr                                                        |                      |         |         |                     |                     |
|         | --binary-mirror                                                          |                      |         |         |                     |                     |
|         | http://127.0.0.1:58797                                                   |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-410000                                                  | binary-mirror-410000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| addons  | disable dashboard -p                                                     | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | addons-782000                                                            |                      |         |         |                     |                     |
| addons  | enable dashboard -p                                                      | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | addons-782000                                                            |                      |         |         |                     |                     |
| start   | -p addons-782000 --wait=true                                             | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | --memory=4000 --alsologtostderr                                          |                      |         |         |                     |                     |
|         | --addons=registry                                                        |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                  |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                 |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                             |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                        |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                   |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                            |                      |         |         |                     |                     |
|         | --addons=yakd --addons=volcano                                           |                      |         |         |                     |                     |
|         | --addons=amd-gpu-device-plugin                                           |                      |         |         |                     |                     |
|         | --driver=qemu2  --addons=ingress                                         |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                     |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                     |                      |         |         |                     |                     |
| delete  | -p addons-782000                                                         | addons-782000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
| start   | -p nospam-784000 -n=1 --memory=2250 --wait=false                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 |                      |         |         |                     |                     |
|         | --driver=qemu2                                                           |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| start   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | start --dry-run                                                          |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| pause   | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | pause                                                                    |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| unpause | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | unpause                                                                  |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| stop    | nospam-784000 --log_dir                                                  | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000           |                      |         |         |                     |                     |
|         | stop                                                                     |                      |         |         |                     |                     |
| delete  | -p nospam-784000                                                         | nospam-784000        | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --memory=4000                                                            |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                    |                      |         |         |                     |                     |
|         | --wait=all --driver=qemu2                                                |                      |         |         |                     |                     |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --alsologtostderr -v=8                                                   |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | functional-382000 cache add                                              | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
| cache   | functional-382000 cache delete                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | minikube-local-cache-test:functional-382000                              |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |         |                     |                     |
| cache   | list                                                                     | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| ssh     | functional-382000 ssh sudo                                               | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | crictl images                                                            |                      |         |         |                     |                     |
| ssh     | functional-382000                                                        | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | ssh sudo docker rmi                                                      |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | functional-382000 cache reload                                           | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
| ssh     | functional-382000 ssh                                                    | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |         |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT | 28 Oct 24 05:21 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |         |                     |                     |
| kubectl | functional-382000 kubectl --                                             | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --context functional-382000                                              |                      |         |         |                     |                     |
|         | get pods                                                                 |                      |         |         |                     |                     |
| start   | -p functional-382000                                                     | functional-382000    | jenkins | v1.34.0 | 28 Oct 24 05:21 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |         |                     |                     |
|         | --wait=all                                                               |                      |         |         |                     |                     |
|---------|--------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/10/28 05:21:27
Running on machine: MacOS-M1-Agent-1
Binary: Built with gc go1.23.2 for darwin/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1028 05:21:27.485547   12211 out.go:345] Setting OutFile to fd 1 ...
I1028 05:21:27.485699   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:27.485701   12211 out.go:358] Setting ErrFile to fd 2...
I1028 05:21:27.485702   12211 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:27.485816   12211 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:21:27.486914   12211 out.go:352] Setting JSON to false
I1028 05:21:27.504224   12211 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6658,"bootTime":1730111429,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
W1028 05:21:27.504300   12211 start.go:137] gopshost.Virtualization returned error: not implemented yet
I1028 05:21:27.509751   12211 out.go:177] * [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
I1028 05:21:27.518017   12211 out.go:177]   - MINIKUBE_LOCATION=19865
I1028 05:21:27.518051   12211 notify.go:220] Checking for updates...
I1028 05:21:27.525951   12211 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
I1028 05:21:27.528914   12211 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
I1028 05:21:27.531931   12211 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1028 05:21:27.534982   12211 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
I1028 05:21:27.536252   12211 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I1028 05:21:27.539265   12211 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:21:27.539311   12211 driver.go:394] Setting default libvirt URI to qemu:///system
I1028 05:21:27.543919   12211 out.go:177] * Using the qemu2 driver based on existing profile
I1028 05:21:27.548966   12211 start.go:297] selected driver: qemu2
I1028 05:21:27.548971   12211 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1028 05:21:27.549029   12211 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1028 05:21:27.551587   12211 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1028 05:21:27.551609   12211 cni.go:84] Creating CNI manager for ""
I1028 05:21:27.551637   12211 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1028 05:21:27.551683   12211 start.go:340] cluster config:
{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1028 05:21:27.556156   12211 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1028 05:21:27.562922   12211 out.go:177] * Starting "functional-382000" primary control-plane node in "functional-382000" cluster
I1028 05:21:27.566929   12211 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1028 05:21:27.566943   12211 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
I1028 05:21:27.566952   12211 cache.go:56] Caching tarball of preloaded images
I1028 05:21:27.567038   12211 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I1028 05:21:27.567042   12211 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
I1028 05:21:27.567087   12211 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/functional-382000/config.json ...
I1028 05:21:27.567534   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1028 05:21:27.567579   12211 start.go:364] duration metric: took 40.708µs to acquireMachinesLock for "functional-382000"
I1028 05:21:27.567586   12211 start.go:96] Skipping create...Using existing machine configuration
I1028 05:21:27.567588   12211 fix.go:54] fixHost starting: 
I1028 05:21:27.567697   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
W1028 05:21:27.567703   12211 fix.go:138] unexpected machine state, will restart: <nil>
I1028 05:21:27.575931   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
I1028 05:21:27.579944   12211 qemu.go:418] Using hvf for hardware acceleration
I1028 05:21:27.579980   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
I1028 05:21:27.582220   12211 main.go:141] libmachine: STDOUT: 
I1028 05:21:27.582234   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I1028 05:21:27.582263   12211 fix.go:56] duration metric: took 14.673875ms for fixHost
I1028 05:21:27.582267   12211 start.go:83] releasing machines lock for "functional-382000", held for 14.685542ms
W1028 05:21:27.582271   12211 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W1028 05:21:27.582315   12211 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I1028 05:21:27.582319   12211 start.go:729] Will try again in 5 seconds ...
I1028 05:21:32.584422   12211 start.go:360] acquireMachinesLock for functional-382000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1028 05:21:32.584774   12211 start.go:364] duration metric: took 292.917µs to acquireMachinesLock for "functional-382000"
I1028 05:21:32.584876   12211 start.go:96] Skipping create...Using existing machine configuration
I1028 05:21:32.584889   12211 fix.go:54] fixHost starting: 
I1028 05:21:32.585554   12211 fix.go:112] recreateIfNeeded on functional-382000: state=Stopped err=<nil>
W1028 05:21:32.585571   12211 fix.go:138] unexpected machine state, will restart: <nil>
I1028 05:21:32.589031   12211 out.go:177] * Restarting existing qemu2 VM for "functional-382000" ...
I1028 05:21:32.597008   12211 qemu.go:418] Using hvf for hardware acceleration
I1028 05:21:32.597236   12211 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:9f:8d:99:ba:f1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/functional-382000/disk.qcow2
I1028 05:21:32.607093   12211 main.go:141] libmachine: STDOUT: 
I1028 05:21:32.607137   12211 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

                                                
                                                
I1028 05:21:32.607214   12211 fix.go:56] duration metric: took 22.330209ms for fixHost
I1028 05:21:32.607231   12211 start.go:83] releasing machines lock for "functional-382000", held for 22.445417ms
W1028 05:21:32.607405   12211 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p functional-382000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
I1028 05:21:32.615959   12211 out.go:201] 
W1028 05:21:32.620059   12211 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
W1028 05:21:32.620080   12211 out.go:270] * 
W1028 05:21:32.622853   12211 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1028 05:21:32.631071   12211 out.go:201] 

                                                
                                                

                                                
                                                
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.07s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.03s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2321: (dbg) Run:  kubectl --context functional-382000 apply -f testdata/invalidsvc.yaml
functional_test.go:2321: (dbg) Non-zero exit: kubectl --context functional-382000 apply -f testdata/invalidsvc.yaml: exit status 1 (27.210375ms)

                                                
                                                
** stderr ** 
	error: context "functional-382000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2323: kubectl --context functional-382000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.03s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:905: (dbg) daemon: [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-382000 --alsologtostderr -v=1]
functional_test.go:918: output didn't produce a URL
functional_test.go:910: (dbg) stopping [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-382000 --alsologtostderr -v=1] ...
functional_test.go:910: (dbg) [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-382000 --alsologtostderr -v=1] stdout:
functional_test.go:910: (dbg) [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-382000 --alsologtostderr -v=1] stderr:
I1028 05:22:13.355111   12515 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:13.355583   12515 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.355586   12515 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:13.355589   12515 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.355770   12515 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:13.355983   12515 mustload.go:65] Loading cluster: functional-382000
I1028 05:22:13.356197   12515 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:13.360426   12515 out.go:177] * The control-plane node functional-382000 host is not running: state=Stopped
I1028 05:22:13.364457   12515 out.go:177]   To start a cluster, run: "minikube start -p functional-382000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (47.028542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:854: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 status
functional_test.go:854: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 status: exit status 7 (33.902041ms)

                                                
                                                
-- stdout --
	functional-382000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:856: failed to run minikube status. args "out/minikube-darwin-arm64 -p functional-382000 status" : exit status 7
functional_test.go:860: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:860: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (33.647625ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:862: failed to run minikube status with custom format: args "out/minikube-darwin-arm64 -p functional-382000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:872: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 status -o json
functional_test.go:872: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 status -o json: exit status 7 (33.905292ms)

                                                
                                                
-- stdout --
	{"Name":"functional-382000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:874: failed to run minikube status with json output. args "out/minikube-darwin-arm64 -p functional-382000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (33.440792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1627: (dbg) Run:  kubectl --context functional-382000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1627: (dbg) Non-zero exit: kubectl --context functional-382000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8: exit status 1 (26.951125ms)

                                                
                                                
** stderr ** 
	error: context "functional-382000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1633: failed to create hello-node deployment with this command "kubectl --context functional-382000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8": exit status 1.
functional_test.go:1598: service test failed - dumping debug information
functional_test.go:1599: -----------------------service failure post-mortem--------------------------------
functional_test.go:1602: (dbg) Run:  kubectl --context functional-382000 describe po hello-node-connect
functional_test.go:1602: (dbg) Non-zero exit: kubectl --context functional-382000 describe po hello-node-connect: exit status 1 (26.720792ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:1604: "kubectl --context functional-382000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1606: hello-node pod describe:
functional_test.go:1608: (dbg) Run:  kubectl --context functional-382000 logs -l app=hello-node-connect
I1028 05:21:37.464922   11909 retry.go:31] will retry after 2.326674842s: Temporary Error: Get "http:": http: no Host in request URL
functional_test.go:1608: (dbg) Non-zero exit: kubectl --context functional-382000 logs -l app=hello-node-connect: exit status 1 (27.587417ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:1610: "kubectl --context functional-382000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1612: hello-node logs:
functional_test.go:1614: (dbg) Run:  kubectl --context functional-382000 describe svc hello-node-connect
functional_test.go:1614: (dbg) Non-zero exit: kubectl --context functional-382000 describe svc hello-node-connect: exit status 1 (26.062791ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:1616: "kubectl --context functional-382000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1618: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.311375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-382000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.861625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1725: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "echo hello"
functional_test.go:1725: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "echo hello": exit status 83 (46.579792ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1730: failed to run an ssh command. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"echo hello\"" : exit status 83
functional_test.go:1734: expected minikube ssh command output to be -"hello"- but got *"* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n"*. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"echo hello\""
functional_test.go:1742: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "cat /etc/hostname"
functional_test.go:1742: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "cat /etc/hostname": exit status 83 (50.917208ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1748: failed to run an ssh command. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"cat /etc/hostname\"" : exit status 83
functional_test.go:1752: expected minikube ssh command output to be -"functional-382000"- but got *"* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n"*. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (35.051875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 83 (54.66975ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /home/docker/cp-test.txt": exit status 83 (48.792125ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-382000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-382000\"\n",
  }, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cp functional-382000:/home/docker/cp-test.txt /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelCpCmd546657828/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 cp functional-382000:/home/docker/cp-test.txt /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelCpCmd546657828/001/cp-test.txt: exit status 83 (45.685542ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 cp functional-382000:/home/docker/cp-test.txt /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelCpCmd546657828/001/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /home/docker/cp-test.txt": exit status 83 (45.003667ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelCpCmd546657828/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  string(
- 	"* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n",
+ 	"",
  )
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt: exit status 83 (46.765959ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /tmp/does/not/exist/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 "sudo cat /tmp/does/not/exist/cp-test.txt": exit status 83 (48.773792ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-arm64 -p functional-382000 ssh -n functional-382000 \"sudo cat /tmp/does/not/exist/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-382000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-382000\"\n",
  }, "")
--- FAIL: TestFunctional/parallel/CpCmd (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1929: Checking for existence of /etc/test/nested/copy/11909/hosts within VM
functional_test.go:1931: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/test/nested/copy/11909/hosts"
functional_test.go:1931: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/test/nested/copy/11909/hosts": exit status 83 (52.941833ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1933: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/test/nested/copy/11909/hosts" failed: exit status 83
functional_test.go:1936: file sync test content: * The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:1946: /etc/sync.test content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file sync process",
+ 	"he control-plane node functional-382000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-382000\"\n",
  }, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (34.852334ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1972: Checking for existence of /etc/ssl/certs/11909.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/11909.pem"
functional_test.go:1973: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/11909.pem": exit status 83 (44.3195ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1975: failed to check existence of "/etc/ssl/certs/11909.pem" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /etc/ssl/certs/11909.pem\"": exit status 83
functional_test.go:1981: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/11909.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
functional_test.go:1972: Checking for existence of /usr/share/ca-certificates/11909.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /usr/share/ca-certificates/11909.pem"
functional_test.go:1973: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /usr/share/ca-certificates/11909.pem": exit status 83 (48.505292ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1975: failed to check existence of "/usr/share/ca-certificates/11909.pem" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /usr/share/ca-certificates/11909.pem\"": exit status 83
functional_test.go:1981: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/11909.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
functional_test.go:1972: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1973: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1973: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 83 (42.692875ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1975: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 83
functional_test.go:1981: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
functional_test.go:1999: Checking for existence of /etc/ssl/certs/119092.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/119092.pem"
functional_test.go:2000: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/119092.pem": exit status 83 (50.413667ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:2002: failed to check existence of "/etc/ssl/certs/119092.pem" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /etc/ssl/certs/119092.pem\"": exit status 83
functional_test.go:2008: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/119092.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
functional_test.go:1999: Checking for existence of /usr/share/ca-certificates/119092.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /usr/share/ca-certificates/119092.pem"
functional_test.go:2000: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /usr/share/ca-certificates/119092.pem": exit status 83 (44.654583ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:2002: failed to check existence of "/usr/share/ca-certificates/119092.pem" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /usr/share/ca-certificates/119092.pem\"": exit status 83
functional_test.go:2008: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/119092.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
functional_test.go:1999: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2000: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:2000: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 83 (45.820334ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:2002: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 83
functional_test.go:2008: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-382000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-382000"
  	"""
  )
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (35.251083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:219: (dbg) Run:  kubectl --context functional-382000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:219: (dbg) Non-zero exit: kubectl --context functional-382000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (26.7475ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:221: failed to 'kubectl get nodes' with args "kubectl --context functional-382000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:227: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:227: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:227: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:227: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test.go:227: expected to have label "minikube.k8s.io/primary" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-382000 -n functional-382000: exit status 7 (35.430833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-382000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2027: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo systemctl is-active crio"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo systemctl is-active crio": exit status 83 (44.38525ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:2030: output of 
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --: exit status 83
functional_test.go:2033: For runtime "docker": expected "crio" to be inactive but got "* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2270: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 version -o=json --components
functional_test.go:2270: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 version -o=json --components: exit status 83 (47.05275ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:2272: error version: exit status 83
functional_test.go:2277: expected to see "buildctl" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "commit" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "containerd" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "crictl" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "crio" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "ctr" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "docker" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "minikubeVersion" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "podman" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:2277: expected to see "crun" in the minikube version --components but got:
* The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
--- FAIL: TestFunctional/parallel/Version/components (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls --format short --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-382000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-382000 image ls --format short --alsologtostderr:
I1028 05:22:13.790760   12530 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:13.790986   12530 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.790989   12530 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:13.790992   12530 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.791128   12530 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:13.791542   12530 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:13.791604   12530 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test.go:275: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls --format table --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-382000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-382000 image ls --format table --alsologtostderr:
I1028 05:22:14.039723   12542 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:14.039906   12542 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:14.039910   12542 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:14.039912   12542 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:14.040053   12542 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:14.040476   12542 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:14.040538   12542 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test.go:275: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
I1028 05:22:30.110936   11909 retry.go:31] will retry after 44.933893612s: Temporary Error: Get "http:": http: no Host in request URL
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls --format json --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-382000 image ls --format json --alsologtostderr:
[]
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-382000 image ls --format json --alsologtostderr:
I1028 05:22:13.999324   12540 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:13.999501   12540 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.999505   12540 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:13.999507   12540 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.999641   12540 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:14.000084   12540 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:14.000147   12540 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test.go:275: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls --format yaml --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-382000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-382000 image ls --format yaml --alsologtostderr:
I1028 05:22:13.831348   12532 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:13.831526   12532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.831529   12532 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:13.831531   12532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.831650   12532 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:13.832151   12532 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:13.832210   12532 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test.go:275: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:308: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh pgrep buildkitd
functional_test.go:308: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh pgrep buildkitd: exit status 83 (45.7825ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:315: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image build -t localhost/my-image:functional-382000 testdata/build --alsologtostderr
functional_test.go:323: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-382000 image build -t localhost/my-image:functional-382000 testdata/build --alsologtostderr:
I1028 05:22:13.918104   12536 out.go:345] Setting OutFile to fd 1 ...
I1028 05:22:13.918898   12536 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.918902   12536 out.go:358] Setting ErrFile to fd 2...
I1028 05:22:13.918904   12536 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:22:13.919055   12536 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:22:13.919475   12536 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:13.919913   12536 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:22:13.920146   12536 build_images.go:133] succeeded building to: 
I1028 05:22:13.920150   12536 build_images.go:134] failed building to: 
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
functional_test.go:446: expected "localhost/my-image:functional-382000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:499: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-382000 docker-env) && out/minikube-darwin-arm64 status -p functional-382000"
functional_test.go:499: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-382000 docker-env) && out/minikube-darwin-arm64 status -p functional-382000": exit status 1 (47.731667ms)
functional_test.go:505: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2
functional_test.go:2119: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2: exit status 83 (46.740125ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:22:13.650779   12524 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:22:13.651771   12524 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.651775   12524 out.go:358] Setting ErrFile to fd 2...
	I1028 05:22:13.651777   12524 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.651927   12524 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:22:13.652153   12524 mustload.go:65] Loading cluster: functional-382000
	I1028 05:22:13.652370   12524 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:22:13.655595   12524 out.go:177] * The control-plane node functional-382000 host is not running: state=Stopped
	I1028 05:22:13.659462   12524 out.go:177]   To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
** /stderr **
functional_test.go:2121: failed to run minikube update-context: args "out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2126: update-context: got="* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2
functional_test.go:2119: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2: exit status 83 (46.64925ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:22:13.743951   12528 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:22:13.744132   12528 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.744135   12528 out.go:358] Setting ErrFile to fd 2...
	I1028 05:22:13.744138   12528 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.744288   12528 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:22:13.744522   12528 mustload.go:65] Loading cluster: functional-382000
	I1028 05:22:13.744736   12528 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:22:13.748588   12528 out.go:177] * The control-plane node functional-382000 host is not running: state=Stopped
	I1028 05:22:13.752366   12528 out.go:177]   To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
** /stderr **
functional_test.go:2121: failed to run minikube update-context: args "out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2126: update-context: got="* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2119: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2
functional_test.go:2119: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2: exit status 83 (45.372125ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:22:13.697286   12526 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:22:13.697474   12526 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.697478   12526 out.go:358] Setting ErrFile to fd 2...
	I1028 05:22:13.697480   12526 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.697622   12526 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:22:13.697853   12526 mustload.go:65] Loading cluster: functional-382000
	I1028 05:22:13.698060   12526 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:22:13.701473   12526 out.go:177] * The control-plane node functional-382000 host is not running: state=Stopped
	I1028 05:22:13.705483   12526 out.go:177]   To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
** /stderr **
functional_test.go:2121: failed to run minikube update-context: args "out/minikube-darwin-arm64 -p functional-382000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2126: update-context: got="* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1437: (dbg) Run:  kubectl --context functional-382000 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1437: (dbg) Non-zero exit: kubectl --context functional-382000 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8: exit status 1 (26.63ms)

                                                
                                                
** stderr ** 
	error: context "functional-382000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1443: failed to create hello-node deployment with this command "kubectl --context functional-382000 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.03s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1459: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 service list
functional_test.go:1459: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 service list: exit status 83 (48.153333ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1461: failed to do service list. args "out/minikube-darwin-arm64 -p functional-382000 service list" : exit status 83
functional_test.go:1464: expected 'service list' to contain *hello-node* but got -"* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1489: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 service list -o json
functional_test.go:1489: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 service list -o json: exit status 83 (45.764708ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1491: failed to list services with json format. args "out/minikube-darwin-arm64 -p functional-382000 service list -o json": exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1509: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 service --namespace=default --https --url hello-node
functional_test.go:1509: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 service --namespace=default --https --url hello-node: exit status 83 (47.573ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1511: failed to get service url. args "out/minikube-darwin-arm64 -p functional-382000 service --namespace=default --https --url hello-node" : exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1540: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 service hello-node --url --format={{.IP}}
functional_test.go:1540: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 service hello-node --url --format={{.IP}}: exit status 83 (45.875208ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1542: failed to get service url with custom format. args "out/minikube-darwin-arm64 -p functional-382000 service hello-node --url --format={{.IP}}": exit status 83
functional_test.go:1548: "* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1559: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 service hello-node --url
functional_test.go:1559: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 service hello-node --url: exit status 83 (46.652166ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test.go:1561: failed to get service url. args: "out/minikube-darwin-arm64 -p functional-382000 service hello-node --url": exit status 83
functional_test.go:1565: found endpoint for hello-node: * The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test.go:1569: failed to parse "* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"": parse "* The control-plane node functional-382000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-382000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 83. stderr: I1028 05:21:34.557974   12328 out.go:345] Setting OutFile to fd 1 ...
I1028 05:21:34.558195   12328 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:34.558199   12328 out.go:358] Setting ErrFile to fd 2...
I1028 05:21:34.558202   12328 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:21:34.558365   12328 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:21:34.558583   12328 mustload.go:65] Loading cluster: functional-382000
I1028 05:21:34.558813   12328 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:21:34.563473   12328 out.go:177] * The control-plane node functional-382000 host is not running: state=Stopped
I1028 05:21:34.571465   12328 out.go:177]   To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
stdout: * The control-plane node functional-382000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-382000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] ...
helpers_test.go:502: unable to terminate pid 12329: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-382000": client config: context "functional-382000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (100.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
I1028 05:21:34.635388   11909 retry.go:31] will retry after 2.829068209s: Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-382000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-382000 get svc nginx-svc: exit status 1 (69.654708ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-382000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-382000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (100.50s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:355: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image load --daemon kicbase/echo-server:functional-382000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
functional_test.go:446: expected "kicbase/echo-server:functional-382000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:365: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image load --daemon kicbase/echo-server:functional-382000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
functional_test.go:446: expected "kicbase/echo-server:functional-382000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:235: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:240: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-382000
functional_test.go:245: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image load --daemon kicbase/echo-server:functional-382000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
functional_test.go:446: expected "kicbase/echo-server:functional-382000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.16s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:380: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image save kicbase/echo-server:functional-382000 /Users/jenkins/workspace/echo-server-save.tar --alsologtostderr
functional_test.go:386: expected "/Users/jenkins/workspace/echo-server-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:409: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image load /Users/jenkins/workspace/echo-server-save.tar --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
functional_test.go:446: expected "kicbase/echo-server:functional-382000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
I1028 05:23:15.132705   11909 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.032879417s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
if_index : 12 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.07s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (30.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
I1028 05:23:40.272149   11909 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:23:50.274252   11909 retry.go:31] will retry after 2.142445904s: Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I1028 05:24:02.420894   11909 retry.go:31] will retry after 6.68681826s: Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": dial tcp: lookup nginx-svc.default.svc.cluster.local. on 8.8.8.8:53: read udp 207.254.73.72:49997->10.96.0.10:53: i/o timeout
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (30.05s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (10.02s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-630000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 
ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-630000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (9.956519833s)

                                                
                                                
-- stdout --
	* [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "ha-630000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:24:10.684397   12577 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:24:10.684558   12577 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:24:10.684562   12577 out.go:358] Setting ErrFile to fd 2...
	I1028 05:24:10.684564   12577 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:24:10.684706   12577 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:24:10.685918   12577 out.go:352] Setting JSON to false
	I1028 05:24:10.703501   12577 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6821,"bootTime":1730111429,"procs":516,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:24:10.703573   12577 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:24:10.709618   12577 out.go:177] * [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:24:10.717628   12577 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:24:10.717697   12577 notify.go:220] Checking for updates...
	I1028 05:24:10.723585   12577 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:24:10.726586   12577 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:24:10.727925   12577 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:24:10.730598   12577 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:24:10.733578   12577 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:24:10.736809   12577 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:24:10.740538   12577 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:24:10.747574   12577 start.go:297] selected driver: qemu2
	I1028 05:24:10.747582   12577 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:24:10.747589   12577 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:24:10.750010   12577 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:24:10.752531   12577 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:24:10.756628   12577 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:24:10.756651   12577 cni.go:84] Creating CNI manager for ""
	I1028 05:24:10.756673   12577 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I1028 05:24:10.756677   12577 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I1028 05:24:10.756708   12577 start.go:340] cluster config:
	{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C
RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client Soc
ketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:24:10.761346   12577 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:24:10.769563   12577 out.go:177] * Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	I1028 05:24:10.773552   12577 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:24:10.773574   12577 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:24:10.773581   12577 cache.go:56] Caching tarball of preloaded images
	I1028 05:24:10.773652   12577 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:24:10.773658   12577 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:24:10.773854   12577 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/ha-630000/config.json ...
	I1028 05:24:10.773865   12577 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/ha-630000/config.json: {Name:mkdf848161d7cdd468cd5686fcb0bb23c8d1aa53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:24:10.774143   12577 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:24:10.774192   12577 start.go:364] duration metric: took 43.042µs to acquireMachinesLock for "ha-630000"
	I1028 05:24:10.774204   12577 start.go:93] Provisioning new machine with config: &{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernet
esVersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:24:10.774230   12577 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:24:10.782600   12577 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:24:10.800310   12577 start.go:159] libmachine.API.Create for "ha-630000" (driver="qemu2")
	I1028 05:24:10.800341   12577 client.go:168] LocalClient.Create starting
	I1028 05:24:10.800417   12577 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:24:10.800455   12577 main.go:141] libmachine: Decoding PEM data...
	I1028 05:24:10.800464   12577 main.go:141] libmachine: Parsing certificate...
	I1028 05:24:10.800505   12577 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:24:10.800545   12577 main.go:141] libmachine: Decoding PEM data...
	I1028 05:24:10.800555   12577 main.go:141] libmachine: Parsing certificate...
	I1028 05:24:10.800951   12577 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:24:10.958807   12577 main.go:141] libmachine: Creating SSH key...
	I1028 05:24:11.019336   12577 main.go:141] libmachine: Creating Disk image...
	I1028 05:24:11.019346   12577 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:24:11.019533   12577 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:11.029235   12577 main.go:141] libmachine: STDOUT: 
	I1028 05:24:11.029275   12577 main.go:141] libmachine: STDERR: 
	I1028 05:24:11.029335   12577 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2 +20000M
	I1028 05:24:11.037732   12577 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:24:11.037749   12577 main.go:141] libmachine: STDERR: 
	I1028 05:24:11.037771   12577 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:11.037777   12577 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:24:11.037786   12577 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:24:11.037813   12577 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:cc:7c:cc:31:c9 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:11.039595   12577 main.go:141] libmachine: STDOUT: 
	I1028 05:24:11.039617   12577 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:24:11.039639   12577 client.go:171] duration metric: took 239.296542ms to LocalClient.Create
	I1028 05:24:13.041763   12577 start.go:128] duration metric: took 2.267565541s to createHost
	I1028 05:24:13.041834   12577 start.go:83] releasing machines lock for "ha-630000", held for 2.267681958s
	W1028 05:24:13.041892   12577 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:24:13.053161   12577 out.go:177] * Deleting "ha-630000" in qemu2 ...
	W1028 05:24:13.081301   12577 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:24:13.081328   12577 start.go:729] Will try again in 5 seconds ...
	I1028 05:24:18.083479   12577 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:24:18.083951   12577 start.go:364] duration metric: took 398.666µs to acquireMachinesLock for "ha-630000"
	I1028 05:24:18.084084   12577 start.go:93] Provisioning new machine with config: &{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernet
esVersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:24:18.084361   12577 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:24:18.089107   12577 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:24:18.141038   12577 start.go:159] libmachine.API.Create for "ha-630000" (driver="qemu2")
	I1028 05:24:18.141095   12577 client.go:168] LocalClient.Create starting
	I1028 05:24:18.141245   12577 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:24:18.141334   12577 main.go:141] libmachine: Decoding PEM data...
	I1028 05:24:18.141357   12577 main.go:141] libmachine: Parsing certificate...
	I1028 05:24:18.141432   12577 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:24:18.141499   12577 main.go:141] libmachine: Decoding PEM data...
	I1028 05:24:18.141523   12577 main.go:141] libmachine: Parsing certificate...
	I1028 05:24:18.142672   12577 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:24:18.318561   12577 main.go:141] libmachine: Creating SSH key...
	I1028 05:24:18.534741   12577 main.go:141] libmachine: Creating Disk image...
	I1028 05:24:18.534750   12577 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:24:18.534995   12577 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:18.545499   12577 main.go:141] libmachine: STDOUT: 
	I1028 05:24:18.545515   12577 main.go:141] libmachine: STDERR: 
	I1028 05:24:18.545577   12577 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2 +20000M
	I1028 05:24:18.554090   12577 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:24:18.554105   12577 main.go:141] libmachine: STDERR: 
	I1028 05:24:18.554118   12577 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:18.554122   12577 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:24:18.554130   12577 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:24:18.554156   12577 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:b4:07:c1:a5:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:24:18.555922   12577 main.go:141] libmachine: STDOUT: 
	I1028 05:24:18.555947   12577 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:24:18.555973   12577 client.go:171] duration metric: took 414.871708ms to LocalClient.Create
	I1028 05:24:20.558129   12577 start.go:128] duration metric: took 2.473785625s to createHost
	I1028 05:24:20.558193   12577 start.go:83] releasing machines lock for "ha-630000", held for 2.474273958s
	W1028 05:24:20.558543   12577 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:24:20.573029   12577 out.go:201] 
	W1028 05:24:20.577183   12577 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:24:20.577211   12577 out.go:270] * 
	* 
	W1028 05:24:20.588331   12577 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:24:20.599365   12577 out.go:201] 

                                                
                                                
** /stderr **
ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 start -p ha-630000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (60.143958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/StartCluster (10.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (80.82s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (63.739041ms)

                                                
                                                
** stderr ** 
	error: cluster "ha-630000" does not exist

                                                
                                                
** /stderr **
ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster
ha_test.go:133: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- rollout status deployment/busybox: exit status 1 (62.218042ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (62.305417ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:20.858941   11909 retry.go:31] will retry after 1.196999324s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.737125ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:22.167007   11909 retry.go:31] will retry after 1.79534825s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.902958ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:24.075139   11909 retry.go:31] will retry after 2.404275678s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.3055ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:26.590010   11909 retry.go:31] will retry after 2.434212253s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.823291ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:29.134859   11909 retry.go:31] will retry after 5.158372959s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.322ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:34.403846   11909 retry.go:31] will retry after 7.719761724s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.415083ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:42.235303   11909 retry.go:31] will retry after 13.245055954s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.557959ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:24:55.591332   11909 retry.go:31] will retry after 17.421013886s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.0785ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:25:13.123549   11909 retry.go:31] will retry after 27.967019273s: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.631292ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:163: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (63.268334ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:165: failed get Pod names
ha_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.io
ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.io: exit status 1 (62.06725ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1
ha_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.default
ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.default: exit status 1 (61.627458ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1
ha_test.go:189: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (61.699334ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.066042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DeployApp (80.82s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (0.1s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-630000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (62.375875ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-630000"

                                                
                                                
** /stderr **
ha_test.go:201: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.134667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/PingHostFromPods (0.10s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-630000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-630000 -v=7 --alsologtostderr: exit status 83 (46.168125ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-630000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:41.614444   12657 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:41.614850   12657 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.614854   12657 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:41.614856   12657 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.615017   12657 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:41.615252   12657 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:41.615490   12657 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:41.620644   12657 out.go:177] * The control-plane node ha-630000 host is not running: state=Stopped
	I1028 05:25:41.623547   12657 out.go:177]   To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-630000 -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.171458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/AddWorkerNode (0.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-630000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-630000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (26.720792ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: ha-630000

                                                
                                                
** /stderr **
ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-630000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-630000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.4455ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/NodeLabels (0.06s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.09s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:305: expected profile "ha-630000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerP
ort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerR
untime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSH
AgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
ha_test.go:309: expected profile "ha-630000" in json of 'profile list' to have "HAppy" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":
1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\
",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSoc
k\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.89875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.09s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (0.07s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status --output json -v=7 --alsologtostderr
ha_test.go:328: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status --output json -v=7 --alsologtostderr: exit status 7 (35.11775ms)

                                                
                                                
-- stdout --
	{"Name":"ha-630000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:41.846790   12669 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:41.846991   12669 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.846994   12669 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:41.846997   12669 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.847145   12669 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:41.847273   12669 out.go:352] Setting JSON to true
	I1028 05:25:41.847284   12669 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:41.847337   12669 notify.go:220] Checking for updates...
	I1028 05:25:41.847484   12669 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:41.847492   12669 status.go:174] checking status of ha-630000 ...
	I1028 05:25:41.847717   12669 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:41.847721   12669 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:41.847723   12669 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:335: failed to decode json from status: args "out/minikube-darwin-arm64 -p ha-630000 status --output json -v=7 --alsologtostderr": json: cannot unmarshal object into Go value of type []cluster.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.49925ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/CopyFile (0.07s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (0.12s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 node stop m02 -v=7 --alsologtostderr
ha_test.go:365: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 node stop m02 -v=7 --alsologtostderr: exit status 85 (54.020208ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:41.916405   12673 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:41.916822   12673 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.916826   12673 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:41.916829   12673 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.917039   12673 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:41.917273   12673 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:41.917484   12673 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:41.922272   12673 out.go:201] 
	W1028 05:25:41.926228   12673 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W1028 05:25:41.926237   12673 out.go:270] * 
	* 
	W1028 05:25:41.928315   12673 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:25:41.933266   12673 out.go:201] 

                                                
                                                
** /stderr **
ha_test.go:367: secondary control-plane node stop returned an error. args "out/minikube-darwin-arm64 -p ha-630000 node stop m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:371: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:371: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (34.992042ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:41.971279   12675 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:41.971455   12675 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.971458   12675 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:41.971461   12675 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:41.971578   12675 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:41.971683   12675 out.go:352] Setting JSON to false
	I1028 05:25:41.971695   12675 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:41.971748   12675 notify.go:220] Checking for updates...
	I1028 05:25:41.971903   12675 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:41.971914   12675 status.go:174] checking status of ha-630000 ...
	I1028 05:25:41.972171   12675 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:41.972174   12675 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:41.972176   12675 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:377: status says not all three control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:380: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:383: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:386: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.357459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (0.12s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:415: expected profile "ha-630000" in json of 'profile list' to have "Degraded" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount
\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31
.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuth
Sock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (33.945709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (51.13s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 node start m02 -v=7 --alsologtostderr
ha_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 node start m02 -v=7 --alsologtostderr: exit status 85 (51.701792ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:42.125015   12684 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:42.125431   12684 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:42.125435   12684 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:42.125438   12684 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:42.125603   12684 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:42.125815   12684 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:42.126010   12684 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:42.129344   12684 out.go:201] 
	W1028 05:25:42.133217   12684 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W1028 05:25:42.133223   12684 out.go:270] * 
	* 
	W1028 05:25:42.135328   12684 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:25:42.139175   12684 out.go:201] 

                                                
                                                
** /stderr **
ha_test.go:424: I1028 05:25:42.125015   12684 out.go:345] Setting OutFile to fd 1 ...
I1028 05:25:42.125431   12684 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:25:42.125435   12684 out.go:358] Setting ErrFile to fd 2...
I1028 05:25:42.125438   12684 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:25:42.125603   12684 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:25:42.125815   12684 mustload.go:65] Loading cluster: ha-630000
I1028 05:25:42.126010   12684 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:25:42.129344   12684 out.go:201] 
W1028 05:25:42.133217   12684 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
W1028 05:25:42.133223   12684 out.go:270] * 
* 
W1028 05:25:42.135328   12684 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I1028 05:25:42.139175   12684 out.go:201] 

                                                
                                                
ha_test.go:425: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-630000 node start m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (34.437625ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:42.176816   12686 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:42.177025   12686 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:42.177028   12686 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:42.177030   12686 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:42.177149   12686 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:42.177284   12686 out.go:352] Setting JSON to false
	I1028 05:25:42.177294   12686 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:42.177348   12686 notify.go:220] Checking for updates...
	I1028 05:25:42.177550   12686 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:42.177558   12686 status.go:174] checking status of ha-630000 ...
	I1028 05:25:42.177813   12686 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:42.177816   12686 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:42.177818   12686 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:42.178744   11909 retry.go:31] will retry after 911.913135ms: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (80.099959ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:43.170998   12688 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:43.171227   12688 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:43.171231   12688 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:43.171234   12688 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:43.171381   12688 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:43.171540   12688 out.go:352] Setting JSON to false
	I1028 05:25:43.171555   12688 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:43.171593   12688 notify.go:220] Checking for updates...
	I1028 05:25:43.171782   12688 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:43.171791   12688 status.go:174] checking status of ha-630000 ...
	I1028 05:25:43.172084   12688 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:43.172088   12688 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:43.172091   12688 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:43.173091   11909 retry.go:31] will retry after 942.605698ms: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (79.984667ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:44.195800   12690 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:44.196036   12690 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:44.196040   12690 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:44.196043   12690 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:44.196227   12690 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:44.196367   12690 out.go:352] Setting JSON to false
	I1028 05:25:44.196381   12690 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:44.196416   12690 notify.go:220] Checking for updates...
	I1028 05:25:44.196638   12690 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:44.196647   12690 status.go:174] checking status of ha-630000 ...
	I1028 05:25:44.196948   12690 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:44.196952   12690 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:44.196955   12690 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:44.197984   11909 retry.go:31] will retry after 1.605924492s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (78.987166ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:45.883018   12692 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:45.883274   12692 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:45.883279   12692 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:45.883282   12692 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:45.883453   12692 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:45.883618   12692 out.go:352] Setting JSON to false
	I1028 05:25:45.883633   12692 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:45.883681   12692 notify.go:220] Checking for updates...
	I1028 05:25:45.883904   12692 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:45.883914   12692 status.go:174] checking status of ha-630000 ...
	I1028 05:25:45.884206   12692 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:45.884211   12692 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:45.884213   12692 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:45.885204   11909 retry.go:31] will retry after 4.283887065s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (82.114ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:50.251499   12694 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:50.251704   12694 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:50.251708   12694 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:50.251711   12694 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:50.251867   12694 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:50.252035   12694 out.go:352] Setting JSON to false
	I1028 05:25:50.252048   12694 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:50.252085   12694 notify.go:220] Checking for updates...
	I1028 05:25:50.252310   12694 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:50.252320   12694 status.go:174] checking status of ha-630000 ...
	I1028 05:25:50.252624   12694 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:50.252629   12694 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:50.252631   12694 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:50.253591   11909 retry.go:31] will retry after 3.936276942s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (80.612208ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:25:54.270569   12696 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:25:54.270797   12696 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:54.270800   12696 out.go:358] Setting ErrFile to fd 2...
	I1028 05:25:54.270803   12696 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:25:54.270975   12696 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:25:54.271124   12696 out.go:352] Setting JSON to false
	I1028 05:25:54.271137   12696 mustload.go:65] Loading cluster: ha-630000
	I1028 05:25:54.271174   12696 notify.go:220] Checking for updates...
	I1028 05:25:54.271390   12696 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:25:54.271400   12696 status.go:174] checking status of ha-630000 ...
	I1028 05:25:54.271705   12696 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:25:54.271709   12696 status.go:384] host is not running, skipping remaining checks
	I1028 05:25:54.271712   12696 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:25:54.272767   11909 retry.go:31] will retry after 6.243250484s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (79.025666ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:00.595099   12698 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:00.595324   12698 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:00.595335   12698 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:00.595338   12698 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:00.595508   12698 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:00.595662   12698 out.go:352] Setting JSON to false
	I1028 05:26:00.595675   12698 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:00.595717   12698 notify.go:220] Checking for updates...
	I1028 05:26:00.595936   12698 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:00.595946   12698 status.go:174] checking status of ha-630000 ...
	I1028 05:26:00.596237   12698 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:26:00.596241   12698 status.go:384] host is not running, skipping remaining checks
	I1028 05:26:00.596243   12698 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:26:00.597244   11909 retry.go:31] will retry after 14.420623189s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (79.226541ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:15.096980   12704 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:15.097204   12704 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:15.097208   12704 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:15.097211   12704 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:15.097356   12704 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:15.097518   12704 out.go:352] Setting JSON to false
	I1028 05:26:15.097532   12704 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:15.097583   12704 notify.go:220] Checking for updates...
	I1028 05:26:15.097787   12704 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:15.097796   12704 status.go:174] checking status of ha-630000 ...
	I1028 05:26:15.098090   12704 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:26:15.098096   12704 status.go:384] host is not running, skipping remaining checks
	I1028 05:26:15.098098   12704 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:26:15.099203   11909 retry.go:31] will retry after 18.002842161s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:430: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (79.510709ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:33.181443   12706 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:33.181647   12706 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:33.181651   12706 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:33.181654   12706 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:33.181836   12706 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:33.181983   12706 out.go:352] Setting JSON to false
	I1028 05:26:33.181996   12706 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:33.182045   12706 notify.go:220] Checking for updates...
	I1028 05:26:33.182237   12706 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:33.182247   12706 status.go:174] checking status of ha-630000 ...
	I1028 05:26:33.182569   12706 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:26:33.182574   12706 status.go:384] host is not running, skipping remaining checks
	I1028 05:26:33.182576   12706 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:434: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.892833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (51.13s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.09s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:305: expected profile "ha-630000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerP
ort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerR
untime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSH
AgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
ha_test.go:309: expected profile "ha-630000" in json of 'profile list' to have "HAppy" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":
1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\
",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSoc
k\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.712959ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.09s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (9s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-630000 -v=7 --alsologtostderr
ha_test.go:464: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-630000 -v=7 --alsologtostderr
ha_test.go:464: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-630000 -v=7 --alsologtostderr: (3.612992833s)
ha_test.go:469: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-630000 --wait=true -v=7 --alsologtostderr
ha_test.go:469: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-630000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.24060175s)

                                                
                                                
-- stdout --
	* [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	* Restarting existing qemu2 VM for "ha-630000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "ha-630000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:37.024943   12735 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:37.025137   12735 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:37.025141   12735 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:37.025145   12735 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:37.025295   12735 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:37.026498   12735 out.go:352] Setting JSON to false
	I1028 05:26:37.046113   12735 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6968,"bootTime":1730111429,"procs":516,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:26:37.046187   12735 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:26:37.050569   12735 out.go:177] * [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:26:37.058434   12735 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:26:37.058468   12735 notify.go:220] Checking for updates...
	I1028 05:26:37.066464   12735 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:26:37.069424   12735 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:26:37.072460   12735 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:26:37.075478   12735 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:26:37.078474   12735 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:26:37.085796   12735 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:37.085851   12735 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:26:37.090485   12735 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:26:37.097477   12735 start.go:297] selected driver: qemu2
	I1028 05:26:37.097483   12735 start.go:901] validating driver "qemu2" against &{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV
ersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:26:37.097548   12735 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:26:37.100023   12735 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:26:37.100050   12735 cni.go:84] Creating CNI manager for ""
	I1028 05:26:37.100070   12735 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I1028 05:26:37.100116   12735 start.go:340] cluster config:
	{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:26:37.104720   12735 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:26:37.111446   12735 out.go:177] * Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	I1028 05:26:37.123195   12735 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:26:37.123213   12735 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:26:37.123224   12735 cache.go:56] Caching tarball of preloaded images
	I1028 05:26:37.123307   12735 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:26:37.123314   12735 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:26:37.123374   12735 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/ha-630000/config.json ...
	I1028 05:26:37.123938   12735 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:26:37.123994   12735 start.go:364] duration metric: took 48.958µs to acquireMachinesLock for "ha-630000"
	I1028 05:26:37.124003   12735 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:26:37.124006   12735 fix.go:54] fixHost starting: 
	I1028 05:26:37.124132   12735 fix.go:112] recreateIfNeeded on ha-630000: state=Stopped err=<nil>
	W1028 05:26:37.124140   12735 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:26:37.132414   12735 out.go:177] * Restarting existing qemu2 VM for "ha-630000" ...
	I1028 05:26:37.135470   12735 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:26:37.135513   12735 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:b4:07:c1:a5:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:26:37.137845   12735 main.go:141] libmachine: STDOUT: 
	I1028 05:26:37.137869   12735 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:26:37.137900   12735 fix.go:56] duration metric: took 13.893ms for fixHost
	I1028 05:26:37.137906   12735 start.go:83] releasing machines lock for "ha-630000", held for 13.907917ms
	W1028 05:26:37.137914   12735 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:26:37.137957   12735 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:26:37.137962   12735 start.go:729] Will try again in 5 seconds ...
	I1028 05:26:42.140082   12735 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:26:42.140422   12735 start.go:364] duration metric: took 276.625µs to acquireMachinesLock for "ha-630000"
	I1028 05:26:42.140533   12735 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:26:42.140552   12735 fix.go:54] fixHost starting: 
	I1028 05:26:42.141243   12735 fix.go:112] recreateIfNeeded on ha-630000: state=Stopped err=<nil>
	W1028 05:26:42.141269   12735 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:26:42.149777   12735 out.go:177] * Restarting existing qemu2 VM for "ha-630000" ...
	I1028 05:26:42.153694   12735 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:26:42.153858   12735 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:b4:07:c1:a5:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:26:42.163427   12735 main.go:141] libmachine: STDOUT: 
	I1028 05:26:42.163477   12735 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:26:42.163540   12735 fix.go:56] duration metric: took 22.991875ms for fixHost
	I1028 05:26:42.163559   12735 start.go:83] releasing machines lock for "ha-630000", held for 23.113417ms
	W1028 05:26:42.163768   12735 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:26:42.169753   12735 out.go:201] 
	W1028 05:26:42.173799   12735 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:26:42.173824   12735 out.go:270] * 
	* 
	W1028 05:26:42.176309   12735 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:26:42.184756   12735 out.go:201] 

                                                
                                                
** /stderr **
ha_test.go:471: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-630000 -v=7 --alsologtostderr" : exit status 80
ha_test.go:474: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-630000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (36.972625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (9.00s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (0.12s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 node delete m03 -v=7 --alsologtostderr
ha_test.go:489: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 node delete m03 -v=7 --alsologtostderr: exit status 83 (47.54ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-630000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:42.344255   12747 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:42.344701   12747 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:42.344704   12747 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:42.344706   12747 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:42.344844   12747 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:42.345068   12747 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:42.345290   12747 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:42.349601   12747 out.go:177] * The control-plane node ha-630000 host is not running: state=Stopped
	I1028 05:26:42.353505   12747 out.go:177]   To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
** /stderr **
ha_test.go:491: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-630000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:495: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:495: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (35.296416ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:42.391976   12749 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:42.392159   12749 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:42.392162   12749 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:42.392165   12749 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:42.392297   12749 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:42.392421   12749 out.go:352] Setting JSON to false
	I1028 05:26:42.392432   12749 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:42.392500   12749 notify.go:220] Checking for updates...
	I1028 05:26:42.392644   12749 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:42.392652   12749 status.go:174] checking status of ha-630000 ...
	I1028 05:26:42.392899   12749 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:26:42.392903   12749 status.go:384] host is not running, skipping remaining checks
	I1028 05:26:42.392905   12749 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:497: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.02425ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.12s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.09s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:415: expected profile "ha-630000" in json of 'profile list' to have "Degraded" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount
\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31
.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuth
Sock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.429667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.09s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (2.04s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 stop -v=7 --alsologtostderr
ha_test.go:533: (dbg) Done: out/minikube-darwin-arm64 -p ha-630000 stop -v=7 --alsologtostderr: (1.933834625s)
ha_test.go:539: (dbg) Run:  out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr
ha_test.go:539: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr: exit status 7 (73.618834ms)

                                                
                                                
-- stdout --
	ha-630000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:44.521592   12768 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:44.521825   12768 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:44.521829   12768 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:44.521832   12768 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:44.522002   12768 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:44.522162   12768 out.go:352] Setting JSON to false
	I1028 05:26:44.522175   12768 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:44.522202   12768 notify.go:220] Checking for updates...
	I1028 05:26:44.523174   12768 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:44.523223   12768 status.go:174] checking status of ha-630000 ...
	I1028 05:26:44.523637   12768 status.go:371] ha-630000 host status = "Stopped" (err=<nil>)
	I1028 05:26:44.523644   12768 status.go:384] host is not running, skipping remaining checks
	I1028 05:26:44.523647   12768 status.go:176] ha-630000 status: &{Name:ha-630000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:545: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:551: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:554: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-630000 status -v=7 --alsologtostderr": ha-630000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (36.292917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/StopCluster (2.04s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (5.26s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-630000 --wait=true -v=7 --alsologtostderr --driver=qemu2 
ha_test.go:562: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-630000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.187507792s)

                                                
                                                
-- stdout --
	* [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	* Restarting existing qemu2 VM for "ha-630000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "ha-630000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:44.594210   12772 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:44.594385   12772 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:44.594388   12772 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:44.594390   12772 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:44.594527   12772 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:44.595568   12772 out.go:352] Setting JSON to false
	I1028 05:26:44.613173   12772 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6975,"bootTime":1730111429,"procs":516,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:26:44.613239   12772 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:26:44.617682   12772 out.go:177] * [ha-630000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:26:44.624690   12772 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:26:44.624743   12772 notify.go:220] Checking for updates...
	I1028 05:26:44.631626   12772 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:26:44.634758   12772 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:26:44.637630   12772 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:26:44.640676   12772 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:26:44.643651   12772 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:26:44.646943   12772 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:44.647218   12772 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:26:44.651594   12772 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:26:44.658602   12772 start.go:297] selected driver: qemu2
	I1028 05:26:44.658609   12772 start.go:901] validating driver "qemu2" against &{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV
ersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:26:44.658652   12772 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:26:44.661102   12772 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:26:44.661126   12772 cni.go:84] Creating CNI manager for ""
	I1028 05:26:44.661145   12772 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I1028 05:26:44.661211   12772 start.go:340] cluster config:
	{Name:ha-630000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-630000 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:26:44.665665   12772 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:26:44.673469   12772 out.go:177] * Starting "ha-630000" primary control-plane node in "ha-630000" cluster
	I1028 05:26:44.677599   12772 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:26:44.677615   12772 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:26:44.677624   12772 cache.go:56] Caching tarball of preloaded images
	I1028 05:26:44.677684   12772 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:26:44.677691   12772 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:26:44.677754   12772 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/ha-630000/config.json ...
	I1028 05:26:44.678232   12772 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:26:44.678262   12772 start.go:364] duration metric: took 24.625µs to acquireMachinesLock for "ha-630000"
	I1028 05:26:44.678274   12772 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:26:44.678278   12772 fix.go:54] fixHost starting: 
	I1028 05:26:44.678400   12772 fix.go:112] recreateIfNeeded on ha-630000: state=Stopped err=<nil>
	W1028 05:26:44.678408   12772 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:26:44.683740   12772 out.go:177] * Restarting existing qemu2 VM for "ha-630000" ...
	I1028 05:26:44.687682   12772 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:26:44.687725   12772 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:b4:07:c1:a5:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:26:44.690017   12772 main.go:141] libmachine: STDOUT: 
	I1028 05:26:44.690038   12772 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:26:44.690069   12772 fix.go:56] duration metric: took 11.789125ms for fixHost
	I1028 05:26:44.690075   12772 start.go:83] releasing machines lock for "ha-630000", held for 11.8085ms
	W1028 05:26:44.690081   12772 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:26:44.690121   12772 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:26:44.690127   12772 start.go:729] Will try again in 5 seconds ...
	I1028 05:26:49.692263   12772 start.go:360] acquireMachinesLock for ha-630000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:26:49.692740   12772 start.go:364] duration metric: took 355.5µs to acquireMachinesLock for "ha-630000"
	I1028 05:26:49.692897   12772 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:26:49.692918   12772 fix.go:54] fixHost starting: 
	I1028 05:26:49.693661   12772 fix.go:112] recreateIfNeeded on ha-630000: state=Stopped err=<nil>
	W1028 05:26:49.693689   12772 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:26:49.698083   12772 out.go:177] * Restarting existing qemu2 VM for "ha-630000" ...
	I1028 05:26:49.702256   12772 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:26:49.702626   12772 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:b4:07:c1:a5:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/ha-630000/disk.qcow2
	I1028 05:26:49.712960   12772 main.go:141] libmachine: STDOUT: 
	I1028 05:26:49.713016   12772 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:26:49.713085   12772 fix.go:56] duration metric: took 20.169541ms for fixHost
	I1028 05:26:49.713104   12772 start.go:83] releasing machines lock for "ha-630000", held for 20.338917ms
	W1028 05:26:49.713280   12772 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ha-630000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:26:49.722155   12772 out.go:201] 
	W1028 05:26:49.726273   12772 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:26:49.726297   12772 out.go:270] * 
	* 
	W1028 05:26:49.729150   12772 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:26:49.735221   12772 out.go:201] 

                                                
                                                
** /stderr **
ha_test.go:564: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-630000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (74.04275ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.26s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.09s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:415: expected profile "ha-630000" in json of 'profile list' to have "Degraded" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount
\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31
.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuth
Sock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.91775ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.09s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (0.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:607: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-630000 --control-plane -v=7 --alsologtostderr
ha_test.go:607: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-630000 --control-plane -v=7 --alsologtostderr: exit status 83 (46.795792ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-630000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:26:49.945677   12789 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:26:49.945868   12789 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:49.945871   12789 out.go:358] Setting ErrFile to fd 2...
	I1028 05:26:49.945873   12789 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:26:49.945990   12789 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:26:49.946219   12789 mustload.go:65] Loading cluster: ha-630000
	I1028 05:26:49.946410   12789 config.go:182] Loaded profile config "ha-630000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:26:49.951144   12789 out.go:177] * The control-plane node ha-630000 host is not running: state=Stopped
	I1028 05:26:49.955142   12789 out.go:177]   To start a cluster, run: "minikube start -p ha-630000"

                                                
                                                
** /stderr **
ha_test.go:609: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-630000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (35.333792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.09s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
ha_test.go:305: expected profile "ha-630000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerP
ort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerR
untime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSH
AgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
ha_test.go:309: expected profile "ha-630000" in json of 'profile list' to have "HAppy" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-630000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-630000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":
1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-630000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\
",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSoc
k\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-630000 -n ha-630000: exit status 7 (34.7295ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.09s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (10.12s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-150000 --driver=qemu2 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-150000 --driver=qemu2 : exit status 80 (10.0459945s)

                                                
                                                
-- stdout --
	* [image-150000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "image-150000" primary control-plane node in "image-150000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "image-150000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p image-150000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-150000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-150000 -n image-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-150000 -n image-150000: exit status 7 (73.561625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-150000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (10.12s)

                                                
                                    
x
+
TestJSONOutput/start/Command (9.84s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-060000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-060000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.836470125s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"defa06a7-98ce-4e73-878e-3292c7c7f0ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-060000] minikube v1.34.0 on Darwin 15.0.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"63880011-6c83-453e-96fe-84fd1e3a805d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19865"}}
	{"specversion":"1.0","id":"cc6a1cc7-7d59-4de1-b6ff-f3892c59afbb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig"}}
	{"specversion":"1.0","id":"afa2e6dd-0232-4d05-92c7-8855b21acc04","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"5df4f4ef-dfd6-4d68-a472-c3076334262b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"762cb4a1-f9b9-4f59-a280-ebcf46f61e87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube"}}
	{"specversion":"1.0","id":"c547e49f-9456-419e-919c-c48b6b822ada","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"99154075-1210-47ba-bdb1-c8ba86f88f15","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"bbb9e168-95fd-4af2-b170-50238f82f5c9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"131e53d8-67a3-4e21-8fee-d19076bfefe4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-060000\" primary control-plane node in \"json-output-060000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"bf6dc819-237b-4654-a87a-146a4258ccdb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"f9e22517-f45d-48b0-99b3-ecc8acc5efaa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-060000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"05e87420-4ee7-4597-a766-7eda91198727","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"a39c08c9-6025-4f31-bbfa-9e20a7b9bee1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"52590043-0478-4b2f-9738-ba72ed65297b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-060000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"00e034d2-f748-46d3-ab1e-bfc83434e771","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}
	{"specversion":"1.0","id":"73c25838-5081-4b4d-883d-312a57f7b806","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-060000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80
json_output_test.go:213: unable to marshal output: OUTPUT: 
json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value
--- FAIL: TestJSONOutput/start/Command (9.84s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.08s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-060000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-060000 --output=json --user=testUser: exit status 83 (84.346875ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4c5ee8aa-832c-4f1e-a860-60640b0b247a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-060000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"aaba44f6-1645-46ab-8390-1642783f8ecf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-060000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-060000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.08s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.05s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-060000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-060000 --output=json --user=testUser: exit status 83 (50.474833ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-060000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-060000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-060000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-060000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (10.24s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-393000 --driver=qemu2 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-393000 --driver=qemu2 : exit status 80 (9.927350541s)

                                                
                                                
-- stdout --
	* [first-393000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "first-393000" primary control-plane node in "first-393000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "first-393000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p first-393000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-393000 --driver=qemu2 ": exit status 80
panic.go:629: *** TestMinikubeProfile FAILED at 2024-10-28 05:27:22.777213 -0700 PDT m=+427.137752001
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-395000 -n second-395000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-395000 -n second-395000: exit status 85 (84.046959ms)

                                                
                                                
-- stdout --
	* Profile "second-395000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-395000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-395000" host is not running, skipping log retrieval (state="* Profile \"second-395000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-395000\"")
helpers_test.go:175: Cleaning up "second-395000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-395000
panic.go:629: *** TestMinikubeProfile FAILED at 2024-10-28 05:27:22.975639 -0700 PDT m=+427.336181793
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-393000 -n first-393000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-393000 -n first-393000: exit status 7 (34.075ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-393000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-393000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-393000
--- FAIL: TestMinikubeProfile (10.24s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (9.97s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-614000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-614000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.899520791s)

                                                
                                                
-- stdout --
	* [mount-start-1-614000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting minikube without Kubernetes in cluster mount-start-1-614000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "mount-start-1-614000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-614000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-614000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-614000 -n mount-start-1-614000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-614000 -n mount-start-1-614000: exit status 7 (74.133708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-614000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (9.97s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (10.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-379000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-379000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (10.13613425s)

                                                
                                                
-- stdout --
	* [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-379000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:27:33.295182   12931 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:27:33.295336   12931 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:27:33.295340   12931 out.go:358] Setting ErrFile to fd 2...
	I1028 05:27:33.295342   12931 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:27:33.295480   12931 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:27:33.296599   12931 out.go:352] Setting JSON to false
	I1028 05:27:33.314130   12931 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7024,"bootTime":1730111429,"procs":516,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:27:33.314201   12931 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:27:33.320504   12931 out.go:177] * [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:27:33.329444   12931 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:27:33.329513   12931 notify.go:220] Checking for updates...
	I1028 05:27:33.335451   12931 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:27:33.338459   12931 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:27:33.342460   12931 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:27:33.345360   12931 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:27:33.348483   12931 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:27:33.351664   12931 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:27:33.355389   12931 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:27:33.362455   12931 start.go:297] selected driver: qemu2
	I1028 05:27:33.362463   12931 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:27:33.362470   12931 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:27:33.364995   12931 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:27:33.367397   12931 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:27:33.370548   12931 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:27:33.370572   12931 cni.go:84] Creating CNI manager for ""
	I1028 05:27:33.370593   12931 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I1028 05:27:33.370601   12931 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I1028 05:27:33.370641   12931 start.go:340] cluster config:
	{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm
net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:27:33.375265   12931 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:27:33.383460   12931 out.go:177] * Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	I1028 05:27:33.387447   12931 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:27:33.387465   12931 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:27:33.387474   12931 cache.go:56] Caching tarball of preloaded images
	I1028 05:27:33.387562   12931 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:27:33.387572   12931 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:27:33.387775   12931 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/multinode-379000/config.json ...
	I1028 05:27:33.387786   12931 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/multinode-379000/config.json: {Name:mke2cfec934732a17bbd27ad622146bece5cb6ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:27:33.388173   12931 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:27:33.388231   12931 start.go:364] duration metric: took 51.083µs to acquireMachinesLock for "multinode-379000"
	I1028 05:27:33.388245   12931 start.go:93] Provisioning new machine with config: &{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:27:33.388278   12931 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:27:33.396508   12931 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:27:33.414925   12931 start.go:159] libmachine.API.Create for "multinode-379000" (driver="qemu2")
	I1028 05:27:33.414958   12931 client.go:168] LocalClient.Create starting
	I1028 05:27:33.415039   12931 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:27:33.415078   12931 main.go:141] libmachine: Decoding PEM data...
	I1028 05:27:33.415088   12931 main.go:141] libmachine: Parsing certificate...
	I1028 05:27:33.415130   12931 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:27:33.415161   12931 main.go:141] libmachine: Decoding PEM data...
	I1028 05:27:33.415174   12931 main.go:141] libmachine: Parsing certificate...
	I1028 05:27:33.415591   12931 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:27:33.572015   12931 main.go:141] libmachine: Creating SSH key...
	I1028 05:27:33.668755   12931 main.go:141] libmachine: Creating Disk image...
	I1028 05:27:33.668761   12931 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:27:33.668948   12931 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:33.678888   12931 main.go:141] libmachine: STDOUT: 
	I1028 05:27:33.678905   12931 main.go:141] libmachine: STDERR: 
	I1028 05:27:33.678962   12931 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2 +20000M
	I1028 05:27:33.687426   12931 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:27:33.687440   12931 main.go:141] libmachine: STDERR: 
	I1028 05:27:33.687453   12931 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:33.687457   12931 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:27:33.687468   12931 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:27:33.687504   12931 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:79:97:77:a8:03 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:33.689360   12931 main.go:141] libmachine: STDOUT: 
	I1028 05:27:33.689379   12931 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:27:33.689402   12931 client.go:171] duration metric: took 274.44075ms to LocalClient.Create
	I1028 05:27:35.691534   12931 start.go:128] duration metric: took 2.303281167s to createHost
	I1028 05:27:35.691642   12931 start.go:83] releasing machines lock for "multinode-379000", held for 2.30345s
	W1028 05:27:35.691706   12931 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:27:35.706804   12931 out.go:177] * Deleting "multinode-379000" in qemu2 ...
	W1028 05:27:35.734457   12931 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:27:35.734490   12931 start.go:729] Will try again in 5 seconds ...
	I1028 05:27:40.734948   12931 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:27:40.735545   12931 start.go:364] duration metric: took 492.625µs to acquireMachinesLock for "multinode-379000"
	I1028 05:27:40.735683   12931 start.go:93] Provisioning new machine with config: &{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:27:40.736005   12931 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:27:40.750733   12931 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:27:40.803149   12931 start.go:159] libmachine.API.Create for "multinode-379000" (driver="qemu2")
	I1028 05:27:40.803197   12931 client.go:168] LocalClient.Create starting
	I1028 05:27:40.803341   12931 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:27:40.803436   12931 main.go:141] libmachine: Decoding PEM data...
	I1028 05:27:40.803460   12931 main.go:141] libmachine: Parsing certificate...
	I1028 05:27:40.803549   12931 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:27:40.803626   12931 main.go:141] libmachine: Decoding PEM data...
	I1028 05:27:40.803646   12931 main.go:141] libmachine: Parsing certificate...
	I1028 05:27:40.804470   12931 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:27:40.973806   12931 main.go:141] libmachine: Creating SSH key...
	I1028 05:27:41.327392   12931 main.go:141] libmachine: Creating Disk image...
	I1028 05:27:41.327405   12931 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:27:41.327592   12931 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:41.337709   12931 main.go:141] libmachine: STDOUT: 
	I1028 05:27:41.337734   12931 main.go:141] libmachine: STDERR: 
	I1028 05:27:41.337801   12931 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2 +20000M
	I1028 05:27:41.346322   12931 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:27:41.346336   12931 main.go:141] libmachine: STDERR: 
	I1028 05:27:41.346354   12931 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:41.346363   12931 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:27:41.346371   12931 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:27:41.346410   12931 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:b2:c0:38:98:91 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:27:41.348242   12931 main.go:141] libmachine: STDOUT: 
	I1028 05:27:41.348254   12931 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:27:41.348267   12931 client.go:171] duration metric: took 545.074459ms to LocalClient.Create
	I1028 05:27:43.350462   12931 start.go:128] duration metric: took 2.614466125s to createHost
	I1028 05:27:43.350543   12931 start.go:83] releasing machines lock for "multinode-379000", held for 2.615029125s
	W1028 05:27:43.350877   12931 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:27:43.359552   12931 out.go:201] 
	W1028 05:27:43.369692   12931 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:27:43.369720   12931 out.go:270] * 
	* 
	W1028 05:27:43.372410   12931 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:27:43.382596   12931 out.go:201] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-379000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (72.921875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (10.21s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (71.7s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (65.30225ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-379000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- rollout status deployment/busybox: exit status 1 (62.148834ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (63.131709ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:43.663606   11909 retry.go:31] will retry after 1.029822131s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (110.717792ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:44.806435   11909 retry.go:31] will retry after 1.231135668s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (110.615958ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:46.150517   11909 retry.go:31] will retry after 1.157632848s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (110.126042ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:47.420601   11909 retry.go:31] will retry after 1.867271732s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.422416ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:49.399726   11909 retry.go:31] will retry after 2.790644839s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.58325ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:27:52.302251   11909 retry.go:31] will retry after 10.625660782s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.741792ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:28:03.119031   11909 retry.go:31] will retry after 10.300218527s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (110.909166ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:28:13.532577   11909 retry.go:31] will retry after 12.666500825s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.793917ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
I1028 05:28:26.310411   11909 retry.go:31] will retry after 28.546554695s: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.520959ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (61.98275ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.io: exit status 1 (61.336333ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.default: exit status 1 (62.50775ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (62.820083ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (35.00225ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (71.70s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-379000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (62.445917ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.023625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.10s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-379000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-379000 -v 3 --alsologtostderr: exit status 83 (57.610458ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-379000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-379000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:55.382891   13014 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:55.383129   13014 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.383132   13014 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:55.383134   13014 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.383279   13014 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:55.383525   13014 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:55.383741   13014 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:55.395803   13014 out.go:177] * The control-plane node multinode-379000 host is not running: state=Stopped
	I1028 05:28:55.401806   13014 out.go:177]   To start a cluster, run: "minikube start -p multinode-379000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-379000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (35.806791ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-379000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-379000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (26.862709ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-379000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-379000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-379000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.879833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
multinode_test.go:166: expected profile "multinode-379000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-379000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"multinode-379000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMN
UMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"multinode-379000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVe
rsion\":\"v1.31.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\"
:\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.944333ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.07s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status --output json --alsologtostderr: exit status 7 (34.707083ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-379000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:55.626674   13026 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:55.626873   13026 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.626876   13026 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:55.626879   13026 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.627047   13026 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:55.627173   13026 out.go:352] Setting JSON to true
	I1028 05:28:55.627184   13026 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:55.627240   13026 notify.go:220] Checking for updates...
	I1028 05:28:55.627411   13026 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:55.627419   13026 status.go:174] checking status of multinode-379000 ...
	I1028 05:28:55.627662   13026 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:28:55.627665   13026 status.go:384] host is not running, skipping remaining checks
	I1028 05:28:55.627667   13026 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-379000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cluster.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.544208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.07s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.16s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 node stop m03: exit status 85 (58.673167ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-379000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status: exit status 7 (35.178709ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr: exit status 7 (35.469959ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:55.791482   13036 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:55.791661   13036 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.791664   13036 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:55.791666   13036 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.791805   13036 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:55.791924   13036 out.go:352] Setting JSON to false
	I1028 05:28:55.791935   13036 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:55.791989   13036 notify.go:220] Checking for updates...
	I1028 05:28:55.792151   13036 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:55.792159   13036 status.go:174] checking status of multinode-379000 ...
	I1028 05:28:55.792407   13036 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:28:55.792410   13036 status.go:384] host is not running, skipping remaining checks
	I1028 05:28:55.792412   13036 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr": multinode-379000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.882125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.16s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (44.85s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 node start m03 -v=7 --alsologtostderr: exit status 85 (51.992458ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:55.861544   13040 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:55.861965   13040 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.861968   13040 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:55.861971   13040 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.862124   13040 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:55.862331   13040 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:55.862524   13040 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:55.866680   13040 out.go:201] 
	W1028 05:28:55.870597   13040 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W1028 05:28:55.870602   13040 out.go:270] * 
	* 
	W1028 05:28:55.872428   13040 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:28:55.875668   13040 out.go:201] 

                                                
                                                
** /stderr **
multinode_test.go:284: I1028 05:28:55.861544   13040 out.go:345] Setting OutFile to fd 1 ...
I1028 05:28:55.861965   13040 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:28:55.861968   13040 out.go:358] Setting ErrFile to fd 2...
I1028 05:28:55.861971   13040 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 05:28:55.862124   13040 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
I1028 05:28:55.862331   13040 mustload.go:65] Loading cluster: multinode-379000
I1028 05:28:55.862524   13040 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1028 05:28:55.866680   13040 out.go:201] 
W1028 05:28:55.870597   13040 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W1028 05:28:55.870602   13040 out.go:270] * 
* 
W1028 05:28:55.872428   13040 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I1028 05:28:55.875668   13040 out.go:201] 

                                                
                                                
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-379000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (34.962834ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:55.913716   13042 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:55.913905   13042 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.913908   13042 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:55.913911   13042 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:55.914054   13042 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:55.914167   13042 out.go:352] Setting JSON to false
	I1028 05:28:55.914178   13042 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:55.914245   13042 notify.go:220] Checking for updates...
	I1028 05:28:55.914396   13042 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:55.914404   13042 status.go:174] checking status of multinode-379000 ...
	I1028 05:28:55.914640   13042 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:28:55.914643   13042 status.go:384] host is not running, skipping remaining checks
	I1028 05:28:55.914645   13042 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:28:55.915571   11909 retry.go:31] will retry after 1.421999184s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (79.738917ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:57.417458   13047 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:57.417717   13047 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:57.417721   13047 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:57.417724   13047 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:57.417885   13047 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:57.418083   13047 out.go:352] Setting JSON to false
	I1028 05:28:57.418096   13047 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:57.418133   13047 notify.go:220] Checking for updates...
	I1028 05:28:57.418360   13047 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:57.418369   13047 status.go:174] checking status of multinode-379000 ...
	I1028 05:28:57.418691   13047 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:28:57.418695   13047 status.go:384] host is not running, skipping remaining checks
	I1028 05:28:57.418698   13047 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:28:57.419752   11909 retry.go:31] will retry after 1.949673867s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (78.671333ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:28:59.448273   13049 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:28:59.448506   13049 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:59.448510   13049 out.go:358] Setting ErrFile to fd 2...
	I1028 05:28:59.448513   13049 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:28:59.448685   13049 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:28:59.448839   13049 out.go:352] Setting JSON to false
	I1028 05:28:59.448852   13049 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:28:59.448901   13049 notify.go:220] Checking for updates...
	I1028 05:28:59.449112   13049 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:28:59.449121   13049 status.go:174] checking status of multinode-379000 ...
	I1028 05:28:59.449432   13049 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:28:59.449436   13049 status.go:384] host is not running, skipping remaining checks
	I1028 05:28:59.449439   13049 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:28:59.450477   11909 retry.go:31] will retry after 1.881631858s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (80.601667ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:01.412906   13051 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:01.413120   13051 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:01.413124   13051 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:01.413127   13051 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:01.413307   13051 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:01.413462   13051 out.go:352] Setting JSON to false
	I1028 05:29:01.413474   13051 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:01.413519   13051 notify.go:220] Checking for updates...
	I1028 05:29:01.413732   13051 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:01.413742   13051 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:01.414061   13051 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:01.414065   13051 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:01.414068   13051 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:29:01.415068   11909 retry.go:31] will retry after 3.57068041s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (78.405333ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:05.064364   13053 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:05.064603   13053 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:05.064607   13053 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:05.064610   13053 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:05.064769   13053 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:05.064950   13053 out.go:352] Setting JSON to false
	I1028 05:29:05.064966   13053 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:05.065005   13053 notify.go:220] Checking for updates...
	I1028 05:29:05.065214   13053 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:05.065224   13053 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:05.065526   13053 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:05.065530   13053 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:05.065533   13053 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:29:05.066534   11909 retry.go:31] will retry after 6.226989479s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (78.90625ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:11.372892   13059 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:11.373100   13059 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:11.373103   13059 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:11.373106   13059 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:11.373261   13059 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:11.373406   13059 out.go:352] Setting JSON to false
	I1028 05:29:11.373419   13059 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:11.373456   13059 notify.go:220] Checking for updates...
	I1028 05:29:11.373658   13059 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:11.373668   13059 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:11.373957   13059 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:11.373961   13059 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:11.373964   13059 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:29:11.375007   11909 retry.go:31] will retry after 6.638848732s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (79.4305ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:18.093651   13061 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:18.093886   13061 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:18.093889   13061 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:18.093892   13061 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:18.094070   13061 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:18.094227   13061 out.go:352] Setting JSON to false
	I1028 05:29:18.094241   13061 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:18.094276   13061 notify.go:220] Checking for updates...
	I1028 05:29:18.094521   13061 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:18.094534   13061 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:18.094821   13061 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:18.094825   13061 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:18.094827   13061 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:29:18.095861   11909 retry.go:31] will retry after 8.002066174s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (80.1285ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:26.178356   13065 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:26.178569   13065 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:26.178574   13065 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:26.178577   13065 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:26.178743   13065 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:26.178908   13065 out.go:352] Setting JSON to false
	I1028 05:29:26.178920   13065 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:26.178962   13065 notify.go:220] Checking for updates...
	I1028 05:29:26.179192   13065 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:26.179201   13065 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:26.179501   13065 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:26.179506   13065 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:26.179508   13065 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I1028 05:29:26.180543   11909 retry.go:31] will retry after 14.380708472s: exit status 7
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr: exit status 7 (79.827209ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:40.641414   13067 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:40.641639   13067 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:40.641643   13067 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:40.641646   13067 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:40.641797   13067 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:40.641953   13067 out.go:352] Setting JSON to false
	I1028 05:29:40.641964   13067 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:40.642005   13067 notify.go:220] Checking for updates...
	I1028 05:29:40.642233   13067 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:40.642242   13067 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:40.642510   13067 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:40.642514   13067 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:40.642517   13067 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-379000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (36.321125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (44.85s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (9.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-379000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-arm64 stop -p multinode-379000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-arm64 stop -p multinode-379000: (3.653568s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-379000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-379000 --wait=true -v=8 --alsologtostderr: exit status 80 (5.22703525s)

                                                
                                                
-- stdout --
	* [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	* Restarting existing qemu2 VM for "multinode-379000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-379000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:44.436334   13094 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:44.436519   13094 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:44.436523   13094 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:44.436526   13094 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:44.436699   13094 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:44.437888   13094 out.go:352] Setting JSON to false
	I1028 05:29:44.457359   13094 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7155,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:29:44.457440   13094 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:29:44.461941   13094 out.go:177] * [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:29:44.468712   13094 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:29:44.468781   13094 notify.go:220] Checking for updates...
	I1028 05:29:44.475904   13094 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:29:44.477316   13094 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:29:44.479854   13094 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:29:44.482895   13094 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:29:44.485866   13094 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:29:44.489223   13094 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:44.489276   13094 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:29:44.493819   13094 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:29:44.500862   13094 start.go:297] selected driver: qemu2
	I1028 05:29:44.500870   13094 start.go:901] validating driver "qemu2" against &{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:29:44.500946   13094 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:29:44.503458   13094 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:29:44.503487   13094 cni.go:84] Creating CNI manager for ""
	I1028 05:29:44.503509   13094 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I1028 05:29:44.503555   13094 start.go:340] cluster config:
	{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerH
AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals
e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:29:44.508034   13094 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:29:44.515753   13094 out.go:177] * Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	I1028 05:29:44.519840   13094 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:29:44.519858   13094 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:29:44.519867   13094 cache.go:56] Caching tarball of preloaded images
	I1028 05:29:44.519954   13094 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:29:44.519959   13094 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:29:44.520018   13094 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/multinode-379000/config.json ...
	I1028 05:29:44.520426   13094 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:29:44.520477   13094 start.go:364] duration metric: took 44.5µs to acquireMachinesLock for "multinode-379000"
	I1028 05:29:44.520486   13094 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:29:44.520489   13094 fix.go:54] fixHost starting: 
	I1028 05:29:44.520609   13094 fix.go:112] recreateIfNeeded on multinode-379000: state=Stopped err=<nil>
	W1028 05:29:44.520616   13094 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:29:44.528842   13094 out.go:177] * Restarting existing qemu2 VM for "multinode-379000" ...
	I1028 05:29:44.531922   13094 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:29:44.531966   13094 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:b2:c0:38:98:91 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:29:44.534205   13094 main.go:141] libmachine: STDOUT: 
	I1028 05:29:44.534233   13094 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:29:44.534262   13094 fix.go:56] duration metric: took 13.77025ms for fixHost
	I1028 05:29:44.534269   13094 start.go:83] releasing machines lock for "multinode-379000", held for 13.787458ms
	W1028 05:29:44.534275   13094 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:29:44.534311   13094 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:29:44.534315   13094 start.go:729] Will try again in 5 seconds ...
	I1028 05:29:49.536552   13094 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:29:49.536978   13094 start.go:364] duration metric: took 327.041µs to acquireMachinesLock for "multinode-379000"
	I1028 05:29:49.537105   13094 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:29:49.537123   13094 fix.go:54] fixHost starting: 
	I1028 05:29:49.537864   13094 fix.go:112] recreateIfNeeded on multinode-379000: state=Stopped err=<nil>
	W1028 05:29:49.537890   13094 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:29:49.542344   13094 out.go:177] * Restarting existing qemu2 VM for "multinode-379000" ...
	I1028 05:29:49.550261   13094 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:29:49.550543   13094 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:b2:c0:38:98:91 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:29:49.560275   13094 main.go:141] libmachine: STDOUT: 
	I1028 05:29:49.560344   13094 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:29:49.560427   13094 fix.go:56] duration metric: took 23.298583ms for fixHost
	I1028 05:29:49.560447   13094 start.go:83] releasing machines lock for "multinode-379000", held for 23.443459ms
	W1028 05:29:49.560627   13094 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:29:49.568328   13094 out.go:201] 
	W1028 05:29:49.572252   13094 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:29:49.572278   13094 out.go:270] * 
	* 
	W1028 05:29:49.574829   13094 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:29:49.583244   13094 out.go:201] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p multinode-379000" : exit status 80
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-379000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (37.138875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (9.03s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.12s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 node delete m03: exit status 83 (46.3805ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-379000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-379000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-arm64 -p multinode-379000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr: exit status 7 (35.00725ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:49.791471   13108 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:49.791666   13108 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:49.791670   13108 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:49.791672   13108 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:49.791804   13108 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:49.791927   13108 out.go:352] Setting JSON to false
	I1028 05:29:49.791938   13108 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:49.791993   13108 notify.go:220] Checking for updates...
	I1028 05:29:49.792151   13108 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:49.792161   13108 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:49.792395   13108 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:49.792399   13108 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:49.792400   13108 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.773291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.12s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (4.04s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-arm64 -p multinode-379000 stop: (3.900640417s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status: exit status 7 (71.69275ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr: exit status 7 (36.504292ms)

                                                
                                                
-- stdout --
	multinode-379000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:53.835774   13136 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:53.835980   13136 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:53.835983   13136 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:53.835986   13136 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:53.836118   13136 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:53.836242   13136 out.go:352] Setting JSON to false
	I1028 05:29:53.836253   13136 mustload.go:65] Loading cluster: multinode-379000
	I1028 05:29:53.836309   13136 notify.go:220] Checking for updates...
	I1028 05:29:53.836468   13136 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:53.836479   13136 status.go:174] checking status of multinode-379000 ...
	I1028 05:29:53.836715   13136 status.go:371] multinode-379000 host status = "Stopped" (err=<nil>)
	I1028 05:29:53.836718   13136 status.go:384] host is not running, skipping remaining checks
	I1028 05:29:53.836720   13136 status.go:176] multinode-379000 status: &{Name:multinode-379000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr": multinode-379000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-arm64 -p multinode-379000 status --alsologtostderr": multinode-379000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.839333ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (4.04s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-379000 --wait=true -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-379000 --wait=true -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (5.192001541s)

                                                
                                                
-- stdout --
	* [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	* Restarting existing qemu2 VM for "multinode-379000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-379000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:29:53.904347   13140 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:29:53.904499   13140 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:53.904502   13140 out.go:358] Setting ErrFile to fd 2...
	I1028 05:29:53.904505   13140 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:29:53.904643   13140 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:29:53.905681   13140 out.go:352] Setting JSON to false
	I1028 05:29:53.923400   13140 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7164,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:29:53.923477   13140 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:29:53.928008   13140 out.go:177] * [multinode-379000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:29:53.934955   13140 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:29:53.935018   13140 notify.go:220] Checking for updates...
	I1028 05:29:53.941954   13140 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:29:53.944898   13140 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:29:53.948886   13140 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:29:53.951962   13140 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:29:53.954945   13140 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:29:53.958295   13140 config.go:182] Loaded profile config "multinode-379000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:29:53.958577   13140 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:29:53.962940   13140 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:29:53.969921   13140 start.go:297] selected driver: qemu2
	I1028 05:29:53.969929   13140 start.go:901] validating driver "qemu2" against &{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:29:53.970018   13140 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:29:53.972737   13140 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:29:53.972767   13140 cni.go:84] Creating CNI manager for ""
	I1028 05:29:53.972787   13140 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I1028 05:29:53.972847   13140 start.go:340] cluster config:
	{Name:multinode-379000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:multinode-379000 Namespace:default APIServerH
AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals
e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:29:53.977391   13140 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:29:53.985865   13140 out.go:177] * Starting "multinode-379000" primary control-plane node in "multinode-379000" cluster
	I1028 05:29:53.989957   13140 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:29:53.989974   13140 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:29:53.989987   13140 cache.go:56] Caching tarball of preloaded images
	I1028 05:29:53.990045   13140 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:29:53.990051   13140 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:29:53.990112   13140 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/multinode-379000/config.json ...
	I1028 05:29:53.990592   13140 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:29:53.990625   13140 start.go:364] duration metric: took 26.375µs to acquireMachinesLock for "multinode-379000"
	I1028 05:29:53.990634   13140 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:29:53.990639   13140 fix.go:54] fixHost starting: 
	I1028 05:29:53.990767   13140 fix.go:112] recreateIfNeeded on multinode-379000: state=Stopped err=<nil>
	W1028 05:29:53.990775   13140 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:29:53.997918   13140 out.go:177] * Restarting existing qemu2 VM for "multinode-379000" ...
	I1028 05:29:54.001935   13140 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:29:54.001984   13140 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:b2:c0:38:98:91 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:29:54.004333   13140 main.go:141] libmachine: STDOUT: 
	I1028 05:29:54.004364   13140 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:29:54.004394   13140 fix.go:56] duration metric: took 13.753917ms for fixHost
	I1028 05:29:54.004399   13140 start.go:83] releasing machines lock for "multinode-379000", held for 13.769042ms
	W1028 05:29:54.004405   13140 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:29:54.004439   13140 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:29:54.004444   13140 start.go:729] Will try again in 5 seconds ...
	I1028 05:29:59.006672   13140 start.go:360] acquireMachinesLock for multinode-379000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:29:59.007205   13140 start.go:364] duration metric: took 424.458µs to acquireMachinesLock for "multinode-379000"
	I1028 05:29:59.007361   13140 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:29:59.007384   13140 fix.go:54] fixHost starting: 
	I1028 05:29:59.008149   13140 fix.go:112] recreateIfNeeded on multinode-379000: state=Stopped err=<nil>
	W1028 05:29:59.008174   13140 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:29:59.012647   13140 out.go:177] * Restarting existing qemu2 VM for "multinode-379000" ...
	I1028 05:29:59.019692   13140 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:29:59.020007   13140 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:b2:c0:38:98:91 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/multinode-379000/disk.qcow2
	I1028 05:29:59.030479   13140 main.go:141] libmachine: STDOUT: 
	I1028 05:29:59.030546   13140 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:29:59.030644   13140 fix.go:56] duration metric: took 23.264292ms for fixHost
	I1028 05:29:59.030667   13140 start.go:83] releasing machines lock for "multinode-379000", held for 23.434917ms
	W1028 05:29:59.030811   13140 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-379000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:29:59.037648   13140 out.go:201] 
	W1028 05:29:59.040660   13140 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:29:59.040681   13140 out.go:270] * 
	* 
	W1028 05:29:59.043124   13140 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:29:59.051615   13140 out.go:201] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-379000 --wait=true -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (75.043125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.27s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (20.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-379000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-379000-m01 --driver=qemu2 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-379000-m01 --driver=qemu2 : exit status 80 (9.812817416s)

                                                
                                                
-- stdout --
	* [multinode-379000-m01] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-379000-m01" primary control-plane node in "multinode-379000-m01" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-379000-m01" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-379000-m01" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-379000-m02 --driver=qemu2 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-379000-m02 --driver=qemu2 : exit status 80 (9.9709485s)

                                                
                                                
-- stdout --
	* [multinode-379000-m02] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "multinode-379000-m02" primary control-plane node in "multinode-379000-m02" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-379000-m02" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-379000-m02" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-arm64 start -p multinode-379000-m02 --driver=qemu2 " : exit status 80
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-379000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-379000: exit status 83 (89.069625ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-379000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-379000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-arm64 delete -p multinode-379000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-379000 -n multinode-379000: exit status 7 (34.572042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-379000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (20.03s)

                                                
                                    
x
+
TestPreload (9.96s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p test-preload-706000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p test-preload-706000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4: exit status 80 (9.798323166s)

                                                
                                                
-- stdout --
	* [test-preload-706000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "test-preload-706000" primary control-plane node in "test-preload-706000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "test-preload-706000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:30:19.321200   13491 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:30:19.321376   13491 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:30:19.321379   13491 out.go:358] Setting ErrFile to fd 2...
	I1028 05:30:19.321381   13491 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:30:19.321498   13491 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:30:19.322644   13491 out.go:352] Setting JSON to false
	I1028 05:30:19.340681   13491 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7190,"bootTime":1730111429,"procs":523,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:30:19.340764   13491 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:30:19.346598   13491 out.go:177] * [test-preload-706000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:30:19.353647   13491 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:30:19.353713   13491 notify.go:220] Checking for updates...
	I1028 05:30:19.361610   13491 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:30:19.364571   13491 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:30:19.367634   13491 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:30:19.370508   13491 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:30:19.373570   13491 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:30:19.376907   13491 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:30:19.376971   13491 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:30:19.380533   13491 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:30:19.387592   13491 start.go:297] selected driver: qemu2
	I1028 05:30:19.387599   13491 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:30:19.387607   13491 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:30:19.390191   13491 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:30:19.391394   13491 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:30:19.394695   13491 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:30:19.394722   13491 cni.go:84] Creating CNI manager for ""
	I1028 05:30:19.394746   13491 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:30:19.394754   13491 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:30:19.394791   13491 start.go:340] cluster config:
	{Name:test-preload-706000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-706000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/so
cket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:30:19.399461   13491 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.407553   13491 out.go:177] * Starting "test-preload-706000" primary control-plane node in "test-preload-706000" cluster
	I1028 05:30:19.411550   13491 preload.go:131] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I1028 05:30:19.411627   13491 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/test-preload-706000/config.json ...
	I1028 05:30:19.411652   13491 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/test-preload-706000/config.json: {Name:mk7d269d3ea1735d1410ffb6f5854eaeedc12ba8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:30:19.411642   13491 cache.go:107] acquiring lock: {Name:mk3a76392d81b5bc4d8582ff0dc9d1969e96521b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.411659   13491 cache.go:107] acquiring lock: {Name:mk77ae2f700184c7e0ae932a9014a53b70714e9a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.411688   13491 cache.go:107] acquiring lock: {Name:mkcb85c9c58692e9121c1139de05c7f9b254ca0e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.411822   13491 cache.go:107] acquiring lock: {Name:mka422d370bbc0aeb491b52a718124347899b22a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.411869   13491 cache.go:107] acquiring lock: {Name:mk22b2c4a97188c9325c00f22a4f434c26bad951 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.411894   13491 cache.go:107] acquiring lock: {Name:mkdd9ed963af418316b742f7bec51a48b5c76ac7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.412007   13491 start.go:360] acquireMachinesLock for test-preload-706000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:30:19.411970   13491 cache.go:107] acquiring lock: {Name:mk274a63c2886b695f16568d169c33d355e09c4e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.412066   13491 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I1028 05:30:19.412232   13491 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1028 05:30:19.412301   13491 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:30:19.412314   13491 start.go:364] duration metric: took 301.167µs to acquireMachinesLock for "test-preload-706000"
	I1028 05:30:19.412327   13491 start.go:93] Provisioning new machine with config: &{Name:test-preload-706000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.24.4 ClusterName:test-preload-706000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:30:19.412392   13491 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:30:19.412396   13491 cache.go:107] acquiring lock: {Name:mkfcd7866fd4b60c76ec22fbd4c020888fc515d9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:30:19.412476   13491 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I1028 05:30:19.412492   13491 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I1028 05:30:19.412494   13491 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:30:19.412501   13491 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I1028 05:30:19.412873   13491 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:30:19.420560   13491 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:30:19.424928   13491 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I1028 05:30:19.424954   13491 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:30:19.424939   13491 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:30:19.424983   13491 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I1028 05:30:19.424993   13491 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:30:19.425012   13491 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1028 05:30:19.425019   13491 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1028 05:30:19.425045   13491 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I1028 05:30:19.438189   13491 start.go:159] libmachine.API.Create for "test-preload-706000" (driver="qemu2")
	I1028 05:30:19.438223   13491 client.go:168] LocalClient.Create starting
	I1028 05:30:19.438305   13491 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:30:19.438340   13491 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:19.438352   13491 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:19.438389   13491 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:30:19.438419   13491 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:19.438428   13491 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:19.438800   13491 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:30:19.606123   13491 main.go:141] libmachine: Creating SSH key...
	I1028 05:30:19.647448   13491 main.go:141] libmachine: Creating Disk image...
	I1028 05:30:19.647465   13491 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:30:19.647662   13491 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:19.657778   13491 main.go:141] libmachine: STDOUT: 
	I1028 05:30:19.657801   13491 main.go:141] libmachine: STDERR: 
	I1028 05:30:19.657863   13491 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2 +20000M
	I1028 05:30:19.667593   13491 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:30:19.667630   13491 main.go:141] libmachine: STDERR: 
	I1028 05:30:19.667652   13491 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:19.667658   13491 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:30:19.667675   13491 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:30:19.667718   13491 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/qemu.pid -device virtio-net-pci,netdev=net0,mac=8a:73:0b:20:c6:cc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:19.670008   13491 main.go:141] libmachine: STDOUT: 
	I1028 05:30:19.670022   13491 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:30:19.670046   13491 client.go:171] duration metric: took 231.816125ms to LocalClient.Create
	I1028 05:30:19.890206   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4
	W1028 05:30:19.890516   13491 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I1028 05:30:19.890540   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I1028 05:30:19.933748   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	I1028 05:30:20.081950   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4
	I1028 05:30:20.131207   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4
	I1028 05:30:20.170689   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I1028 05:30:20.250903   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4
	I1028 05:30:20.331015   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 exists
	I1028 05:30:20.331057   13491 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7" took 919.276042ms
	I1028 05:30:20.331098   13491 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 succeeded
	W1028 05:30:20.551358   13491 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1028 05:30:20.551442   13491 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1028 05:30:21.012666   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1028 05:30:21.012743   13491 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.601072375s
	I1028 05:30:21.012780   13491 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1028 05:30:21.670350   13491 start.go:128] duration metric: took 2.257912375s to createHost
	I1028 05:30:21.670418   13491 start.go:83] releasing machines lock for "test-preload-706000", held for 2.258089541s
	W1028 05:30:21.670479   13491 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:30:21.685926   13491 out.go:177] * Deleting "test-preload-706000" in qemu2 ...
	W1028 05:30:21.717334   13491 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:30:21.717375   13491 start.go:729] Will try again in 5 seconds ...
	I1028 05:30:22.507391   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I1028 05:30:22.507448   13491 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4" took 3.095606s
	I1028 05:30:22.507477   13491 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I1028 05:30:22.930922   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I1028 05:30:22.930964   13491 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6" took 3.5185555s
	I1028 05:30:22.930988   13491 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I1028 05:30:23.707832   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I1028 05:30:23.707876   13491 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4" took 4.296224667s
	I1028 05:30:23.707902   13491 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I1028 05:30:24.358357   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I1028 05:30:24.358408   13491 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4" took 4.946730958s
	I1028 05:30:24.358433   13491 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I1028 05:30:25.229909   13491 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I1028 05:30:25.229952   13491 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4" took 5.818083459s
	I1028 05:30:25.229977   13491 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I1028 05:30:26.717637   13491 start.go:360] acquireMachinesLock for test-preload-706000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:30:26.718157   13491 start.go:364] duration metric: took 436.75µs to acquireMachinesLock for "test-preload-706000"
	I1028 05:30:26.718302   13491 start.go:93] Provisioning new machine with config: &{Name:test-preload-706000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.24.4 ClusterName:test-preload-706000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOp
tions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:30:26.718600   13491 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:30:26.735839   13491 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:30:26.786303   13491 start.go:159] libmachine.API.Create for "test-preload-706000" (driver="qemu2")
	I1028 05:30:26.786380   13491 client.go:168] LocalClient.Create starting
	I1028 05:30:26.786500   13491 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:30:26.786578   13491 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:26.786593   13491 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:26.786665   13491 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:30:26.786722   13491 main.go:141] libmachine: Decoding PEM data...
	I1028 05:30:26.786737   13491 main.go:141] libmachine: Parsing certificate...
	I1028 05:30:26.787266   13491 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:30:26.954127   13491 main.go:141] libmachine: Creating SSH key...
	I1028 05:30:27.018357   13491 main.go:141] libmachine: Creating Disk image...
	I1028 05:30:27.018367   13491 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:30:27.018572   13491 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:27.028557   13491 main.go:141] libmachine: STDOUT: 
	I1028 05:30:27.028581   13491 main.go:141] libmachine: STDERR: 
	I1028 05:30:27.028649   13491 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2 +20000M
	I1028 05:30:27.037351   13491 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:30:27.037378   13491 main.go:141] libmachine: STDERR: 
	I1028 05:30:27.037396   13491 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:27.037403   13491 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:30:27.037411   13491 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:30:27.037452   13491 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/qemu.pid -device virtio-net-pci,netdev=net0,mac=26:4c:f2:25:ef:ec -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/test-preload-706000/disk.qcow2
	I1028 05:30:27.039344   13491 main.go:141] libmachine: STDOUT: 
	I1028 05:30:27.039356   13491 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:30:27.039369   13491 client.go:171] duration metric: took 252.982458ms to LocalClient.Create
	I1028 05:30:29.039945   13491 start.go:128] duration metric: took 2.321288916s to createHost
	I1028 05:30:29.040017   13491 start.go:83] releasing machines lock for "test-preload-706000", held for 2.321821333s
	W1028 05:30:29.040319   13491 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p test-preload-706000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p test-preload-706000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:30:29.056926   13491 out.go:201] 
	W1028 05:30:29.060960   13491 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:30:29.060985   13491 out.go:270] * 
	* 
	W1028 05:30:29.063829   13491 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:30:29.070752   13491 out.go:201] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-arm64 start -p test-preload-706000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4 failed: exit status 80
panic.go:629: *** TestPreload FAILED at 2024-10-28 05:30:29.088743 -0700 PDT m=+613.366664376
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-706000 -n test-preload-706000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-706000 -n test-preload-706000: exit status 7 (72.13ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-706000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-706000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p test-preload-706000
--- FAIL: TestPreload (9.96s)

                                                
                                    
x
+
TestScheduledStopUnix (9.94s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 start -p scheduled-stop-943000 --memory=2048 --driver=qemu2 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p scheduled-stop-943000 --memory=2048 --driver=qemu2 : exit status 80 (9.779862583s)

                                                
                                                
-- stdout --
	* [scheduled-stop-943000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "scheduled-stop-943000" primary control-plane node in "scheduled-stop-943000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-943000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-943000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [scheduled-stop-943000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "scheduled-stop-943000" primary control-plane node in "scheduled-stop-943000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-943000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-943000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:629: *** TestScheduledStopUnix FAILED at 2024-10-28 05:30:39.024629 -0700 PDT m=+623.302529793
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-943000 -n scheduled-stop-943000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-943000 -n scheduled-stop-943000: exit status 7 (74.698834ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-943000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-943000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p scheduled-stop-943000
--- FAIL: TestScheduledStopUnix (9.94s)

                                                
                                    
x
+
TestSkaffold (12.39s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/skaffold.exe873689256 version
skaffold_test.go:59: (dbg) Done: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/skaffold.exe873689256 version: (1.013501958s)
skaffold_test.go:63: skaffold version: v2.13.2
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-arm64 start -p skaffold-428000 --memory=2600 --driver=qemu2 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p skaffold-428000 --memory=2600 --driver=qemu2 : exit status 80 (9.848718083s)

                                                
                                                
-- stdout --
	* [skaffold-428000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "skaffold-428000" primary control-plane node in "skaffold-428000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-428000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-428000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [skaffold-428000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "skaffold-428000" primary control-plane node in "skaffold-428000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-428000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-428000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:629: *** TestSkaffold FAILED at 2024-10-28 05:30:51.413098 -0700 PDT m=+635.690972626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-428000 -n skaffold-428000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-428000 -n skaffold-428000: exit status 7 (70.209792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-428000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-428000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p skaffold-428000
--- FAIL: TestSkaffold (12.39s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (589.49s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3647482018 start -p running-upgrade-343000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:120: (dbg) Done: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3647482018 start -p running-upgrade-343000 --memory=2200 --vm-driver=qemu2 : (54.214324833s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-darwin-arm64 start -p running-upgrade-343000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:130: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p running-upgrade-343000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (8m21.336284209s)

                                                
                                                
-- stdout --
	* [running-upgrade-343000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	* Using the qemu2 driver based on existing profile
	* Starting "running-upgrade-343000" primary control-plane node in "running-upgrade-343000" cluster
	* Updating the running qemu2 "running-upgrade-343000" VM ...
	* Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring bridge CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:32:28.068890   13885 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:32:28.069359   13885 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:32:28.069363   13885 out.go:358] Setting ErrFile to fd 2...
	I1028 05:32:28.069365   13885 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:32:28.069507   13885 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:32:28.070540   13885 out.go:352] Setting JSON to false
	I1028 05:32:28.090079   13885 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7319,"bootTime":1730111429,"procs":521,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:32:28.090152   13885 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:32:28.094482   13885 out.go:177] * [running-upgrade-343000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:32:28.103354   13885 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:32:28.103411   13885 notify.go:220] Checking for updates...
	I1028 05:32:28.111383   13885 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:32:28.115349   13885 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:32:28.118335   13885 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:32:28.121389   13885 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:32:28.124388   13885 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:32:28.127569   13885 config.go:182] Loaded profile config "running-upgrade-343000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:32:28.131305   13885 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	I1028 05:32:28.134401   13885 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:32:28.138380   13885 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:32:28.145350   13885 start.go:297] selected driver: qemu2
	I1028 05:32:28.145355   13885 start.go:901] validating driver "qemu2" against &{Name:running-upgrade-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59017 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgra
de-343000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:32:28.145401   13885 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:32:28.148177   13885 cni.go:84] Creating CNI manager for ""
	I1028 05:32:28.148209   13885 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:32:28.148230   13885 start.go:340] cluster config:
	{Name:running-upgrade-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59017 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-343000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:32:28.148297   13885 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:32:28.156305   13885 out.go:177] * Starting "running-upgrade-343000" primary control-plane node in "running-upgrade-343000" cluster
	I1028 05:32:28.160294   13885 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:32:28.160308   13885 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I1028 05:32:28.160312   13885 cache.go:56] Caching tarball of preloaded images
	I1028 05:32:28.160359   13885 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:32:28.160365   13885 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I1028 05:32:28.160409   13885 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/config.json ...
	I1028 05:32:28.160826   13885 start.go:360] acquireMachinesLock for running-upgrade-343000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:32:28.160855   13885 start.go:364] duration metric: took 22.709µs to acquireMachinesLock for "running-upgrade-343000"
	I1028 05:32:28.160862   13885 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:32:28.160867   13885 fix.go:54] fixHost starting: 
	I1028 05:32:28.161475   13885 fix.go:112] recreateIfNeeded on running-upgrade-343000: state=Running err=<nil>
	W1028 05:32:28.161484   13885 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:32:28.165358   13885 out.go:177] * Updating the running qemu2 "running-upgrade-343000" VM ...
	I1028 05:32:28.173289   13885 machine.go:93] provisionDockerMachine start ...
	I1028 05:32:28.173325   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.173423   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.173428   13885 main.go:141] libmachine: About to run SSH command:
	hostname
	I1028 05:32:28.243659   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-343000
	
	I1028 05:32:28.243674   13885 buildroot.go:166] provisioning hostname "running-upgrade-343000"
	I1028 05:32:28.243748   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.243865   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.243873   13885 main.go:141] libmachine: About to run SSH command:
	sudo hostname running-upgrade-343000 && echo "running-upgrade-343000" | sudo tee /etc/hostname
	I1028 05:32:28.318010   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: running-upgrade-343000
	
	I1028 05:32:28.318085   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.318204   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.318213   13885 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\srunning-upgrade-343000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 running-upgrade-343000/g' /etc/hosts;
				else 
					echo '127.0.1.1 running-upgrade-343000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1028 05:32:28.391207   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 05:32:28.391220   13885 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19865-11397/.minikube CaCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19865-11397/.minikube}
	I1028 05:32:28.391233   13885 buildroot.go:174] setting up certificates
	I1028 05:32:28.391237   13885 provision.go:84] configureAuth start
	I1028 05:32:28.391242   13885 provision.go:143] copyHostCerts
	I1028 05:32:28.391324   13885 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem, removing ...
	I1028 05:32:28.391330   13885 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem
	I1028 05:32:28.391442   13885 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem (1078 bytes)
	I1028 05:32:28.391612   13885 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem, removing ...
	I1028 05:32:28.391616   13885 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem
	I1028 05:32:28.391663   13885 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem (1123 bytes)
	I1028 05:32:28.391788   13885 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem, removing ...
	I1028 05:32:28.391791   13885 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem
	I1028 05:32:28.391837   13885 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem (1679 bytes)
	I1028 05:32:28.391942   13885 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem org=jenkins.running-upgrade-343000 san=[127.0.0.1 localhost minikube running-upgrade-343000]
	I1028 05:32:28.608075   13885 provision.go:177] copyRemoteCerts
	I1028 05:32:28.608153   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1028 05:32:28.608162   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:32:28.645293   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I1028 05:32:28.652483   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I1028 05:32:28.659837   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I1028 05:32:28.666738   13885 provision.go:87] duration metric: took 275.495125ms to configureAuth
	I1028 05:32:28.666748   13885 buildroot.go:189] setting minikube options for container-runtime
	I1028 05:32:28.666871   13885 config.go:182] Loaded profile config "running-upgrade-343000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:32:28.666915   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.667004   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.667009   13885 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1028 05:32:28.739938   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I1028 05:32:28.739948   13885 buildroot.go:70] root file system type: tmpfs
	I1028 05:32:28.739994   13885 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I1028 05:32:28.740064   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.740178   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.740210   13885 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1028 05:32:28.813610   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1028 05:32:28.813680   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.813796   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.813804   13885 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1028 05:32:28.885817   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 05:32:28.885828   13885 machine.go:96] duration metric: took 712.532542ms to provisionDockerMachine
	I1028 05:32:28.885835   13885 start.go:293] postStartSetup for "running-upgrade-343000" (driver="qemu2")
	I1028 05:32:28.885841   13885 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1028 05:32:28.885903   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1028 05:32:28.885912   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:32:28.924178   13885 ssh_runner.go:195] Run: cat /etc/os-release
	I1028 05:32:28.925447   13885 info.go:137] Remote host: Buildroot 2021.02.12
	I1028 05:32:28.925455   13885 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/addons for local assets ...
	I1028 05:32:28.925511   13885 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/files for local assets ...
	I1028 05:32:28.925607   13885 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem -> 119092.pem in /etc/ssl/certs
	I1028 05:32:28.925711   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1028 05:32:28.928276   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:32:28.935761   13885 start.go:296] duration metric: took 49.920833ms for postStartSetup
	I1028 05:32:28.935778   13885 fix.go:56] duration metric: took 774.910583ms for fixHost
	I1028 05:32:28.935947   13885 main.go:141] libmachine: Using SSH client type: native
	I1028 05:32:28.936066   13885 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102d3a5f0] 0x102d3ce30 <nil>  [] 0s} localhost 58985 <nil> <nil>}
	I1028 05:32:28.936071   13885 main.go:141] libmachine: About to run SSH command:
	date +%s.%N
	I1028 05:32:29.007369   13885 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730118749.032448972
	
	I1028 05:32:29.007379   13885 fix.go:216] guest clock: 1730118749.032448972
	I1028 05:32:29.007383   13885 fix.go:229] Guest: 2024-10-28 05:32:29.032448972 -0700 PDT Remote: 2024-10-28 05:32:28.93578 -0700 PDT m=+0.889626293 (delta=96.668972ms)
	I1028 05:32:29.007393   13885 fix.go:200] guest clock delta is within tolerance: 96.668972ms
	I1028 05:32:29.007396   13885 start.go:83] releasing machines lock for "running-upgrade-343000", held for 846.535792ms
	I1028 05:32:29.007483   13885 ssh_runner.go:195] Run: cat /version.json
	I1028 05:32:29.007495   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:32:29.007483   13885 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1028 05:32:29.007523   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	W1028 05:32:29.008050   13885 sshutil.go:64] dial failure (will retry): dial tcp [::1]:58985: connect: connection refused
	I1028 05:32:29.008071   13885 retry.go:31] will retry after 373.365937ms: dial tcp [::1]:58985: connect: connection refused
	W1028 05:32:29.042872   13885 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I1028 05:32:29.042920   13885 ssh_runner.go:195] Run: systemctl --version
	I1028 05:32:29.044700   13885 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W1028 05:32:29.046425   13885 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I1028 05:32:29.046463   13885 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I1028 05:32:29.049370   13885 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I1028 05:32:29.053992   13885 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1028 05:32:29.053998   13885 start.go:495] detecting cgroup driver to use...
	I1028 05:32:29.054125   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:32:29.059443   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I1028 05:32:29.062428   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1028 05:32:29.065275   13885 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1028 05:32:29.065302   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1028 05:32:29.068643   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:32:29.072022   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1028 05:32:29.075266   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:32:29.078204   13885 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1028 05:32:29.082360   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1028 05:32:29.085397   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I1028 05:32:29.088676   13885 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I1028 05:32:29.092345   13885 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1028 05:32:29.095616   13885 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1028 05:32:29.098682   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:29.190627   13885 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1028 05:32:29.197158   13885 start.go:495] detecting cgroup driver to use...
	I1028 05:32:29.197243   13885 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1028 05:32:29.205679   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:32:29.210911   13885 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I1028 05:32:29.219391   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:32:29.227201   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 05:32:29.232600   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:32:29.238430   13885 ssh_runner.go:195] Run: which cri-dockerd
	I1028 05:32:29.239874   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1028 05:32:29.242938   13885 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1028 05:32:29.247844   13885 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1028 05:32:29.340288   13885 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1028 05:32:29.431989   13885 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I1028 05:32:29.432040   13885 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1028 05:32:29.438090   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:29.529488   13885 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:32:30.947664   13885 ssh_runner.go:235] Completed: curl -sS -m 2 https://registry.k8s.io/: (1.940142709s)
	I1028 05:32:30.947928   13885 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.41842425s)
	I1028 05:32:30.947992   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I1028 05:32:30.952791   13885 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
	I1028 05:32:30.959127   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:32:30.963973   13885 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1028 05:32:31.031794   13885 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1028 05:32:31.106298   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:31.188158   13885 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1028 05:32:31.194908   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:32:31.199472   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:31.289514   13885 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I1028 05:32:31.327606   13885 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1028 05:32:31.327692   13885 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1028 05:32:31.330812   13885 start.go:563] Will wait 60s for crictl version
	I1028 05:32:31.330882   13885 ssh_runner.go:195] Run: which crictl
	I1028 05:32:31.332263   13885 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1028 05:32:31.344876   13885 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I1028 05:32:31.344951   13885 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:32:31.358206   13885 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:32:31.378108   13885 out.go:235] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I1028 05:32:31.378276   13885 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I1028 05:32:31.379656   13885 kubeadm.go:883] updating cluster {Name:running-upgrade-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59017 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:running-upgrade-343000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I1028 05:32:31.379697   13885 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:32:31.379744   13885 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:32:31.389785   13885 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:32:31.389794   13885 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:32:31.389848   13885 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:32:31.393005   13885 ssh_runner.go:195] Run: which lz4
	I1028 05:32:31.394397   13885 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I1028 05:32:31.395612   13885 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1028 05:32:31.395621   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I1028 05:32:32.330891   13885 docker.go:653] duration metric: took 936.534125ms to copy over tarball
	I1028 05:32:32.330967   13885 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I1028 05:32:33.491580   13885 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.160596375s)
	I1028 05:32:33.491594   13885 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1028 05:32:33.507932   13885 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:32:33.511310   13885 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I1028 05:32:33.516552   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:33.589160   13885 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:32:34.778460   13885 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.1892805s)
	I1028 05:32:34.778551   13885 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:32:34.790433   13885 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:32:34.790443   13885 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:32:34.790448   13885 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I1028 05:32:34.795829   13885 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:32:34.798095   13885 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:32:34.799575   13885 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I1028 05:32:34.799653   13885 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:32:34.801416   13885 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:32:34.801965   13885 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:32:34.802767   13885 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1028 05:32:34.803037   13885 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:32:34.804107   13885 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:32:34.805287   13885 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:32:34.805777   13885 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:32:34.805875   13885 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:32:34.806095   13885 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:32:34.806708   13885 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:32:34.808322   13885 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:32:34.809504   13885 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:32:35.268797   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:32:35.280576   13885 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I1028 05:32:35.280602   13885 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:32:35.280672   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:32:35.292480   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I1028 05:32:35.316624   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:32:35.322741   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I1028 05:32:35.328265   13885 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I1028 05:32:35.328290   13885 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:32:35.328365   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:32:35.339574   13885 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I1028 05:32:35.339592   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I1028 05:32:35.339596   13885 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I1028 05:32:35.339662   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I1028 05:32:35.350776   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I1028 05:32:35.350920   13885 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I1028 05:32:35.353282   13885 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I1028 05:32:35.353298   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I1028 05:32:35.361525   13885 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I1028 05:32:35.361563   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	I1028 05:32:35.393509   13885 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	I1028 05:32:35.400304   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:32:35.410446   13885 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I1028 05:32:35.410476   13885 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:32:35.410544   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:32:35.419862   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	W1028 05:32:35.445608   13885 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I1028 05:32:35.445778   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:32:35.457711   13885 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I1028 05:32:35.457731   13885 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:32:35.457796   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:32:35.467860   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I1028 05:32:35.467999   13885 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:32:35.469500   13885 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I1028 05:32:35.469511   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I1028 05:32:35.495069   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:32:35.509600   13885 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:32:35.509614   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I1028 05:32:35.516774   13885 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I1028 05:32:35.516799   13885 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:32:35.516866   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:32:35.555269   13885 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I1028 05:32:35.555298   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I1028 05:32:35.604305   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I1028 05:32:35.615779   13885 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I1028 05:32:35.615802   13885 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:32:35.615859   13885 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I1028 05:32:35.629993   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	W1028 05:32:35.685437   13885 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1028 05:32:35.685549   13885 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:32:35.697836   13885 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I1028 05:32:35.697864   13885 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:32:35.697928   13885 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:32:36.355402   13885 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1028 05:32:36.355816   13885 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:32:36.361076   13885 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I1028 05:32:36.361126   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
	I1028 05:32:36.413371   13885 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:32:36.413386   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
	I1028 05:32:36.649572   13885 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I1028 05:32:36.649612   13885 cache_images.go:92] duration metric: took 1.859154291s to LoadCachedImages
	W1028 05:32:36.649655   13885 out.go:270] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1: no such file or directory
	X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1: no such file or directory
	I1028 05:32:36.649662   13885 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I1028 05:32:36.649718   13885 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=running-upgrade-343000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:running-upgrade-343000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I1028 05:32:36.649788   13885 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1028 05:32:36.663688   13885 cni.go:84] Creating CNI manager for ""
	I1028 05:32:36.663699   13885 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:32:36.663708   13885 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I1028 05:32:36.663717   13885 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:running-upgrade-343000 NodeName:running-upgrade-343000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1028 05:32:36.663784   13885 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "running-upgrade-343000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1028 05:32:36.663865   13885 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I1028 05:32:36.666771   13885 binaries.go:44] Found k8s binaries, skipping transfer
	I1028 05:32:36.666808   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1028 05:32:36.669465   13885 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I1028 05:32:36.674407   13885 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1028 05:32:36.680081   13885 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I1028 05:32:36.689180   13885 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I1028 05:32:36.690822   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:32:36.771399   13885 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:32:36.776792   13885 certs.go:68] Setting up /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000 for IP: 10.0.2.15
	I1028 05:32:36.776810   13885 certs.go:194] generating shared ca certs ...
	I1028 05:32:36.776819   13885 certs.go:226] acquiring lock for ca certs: {Name:mk98e4a9e20bbb7ca9edab1be452077f88dfe469 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:32:36.777066   13885 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key
	I1028 05:32:36.777106   13885 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key
	I1028 05:32:36.777117   13885 certs.go:256] generating profile certs ...
	I1028 05:32:36.777186   13885 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.key
	I1028 05:32:36.777198   13885 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key.d2effac2
	I1028 05:32:36.777208   13885 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt.d2effac2 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I1028 05:32:36.908137   13885 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt.d2effac2 ...
	I1028 05:32:36.908147   13885 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt.d2effac2: {Name:mk46e469a13de26f3186a71402f7b03da7827aa4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:32:36.908475   13885 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key.d2effac2 ...
	I1028 05:32:36.908479   13885 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key.d2effac2: {Name:mk6f9971b8759380501e9456ac4af2d7cacbe4e9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:32:36.908642   13885 certs.go:381] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt.d2effac2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt
	I1028 05:32:36.908775   13885 certs.go:385] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key.d2effac2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key
	I1028 05:32:36.908905   13885 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/proxy-client.key
	I1028 05:32:36.909054   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem (1338 bytes)
	W1028 05:32:36.909078   13885 certs.go:480] ignoring /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909_empty.pem, impossibly tiny 0 bytes
	I1028 05:32:36.909083   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem (1675 bytes)
	I1028 05:32:36.909105   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem (1078 bytes)
	I1028 05:32:36.909129   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem (1123 bytes)
	I1028 05:32:36.909152   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem (1679 bytes)
	I1028 05:32:36.909192   13885 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:32:36.909633   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1028 05:32:36.916853   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I1028 05:32:36.924525   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1028 05:32:36.932089   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1028 05:32:36.939613   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I1028 05:32:36.946356   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I1028 05:32:36.952898   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1028 05:32:36.960253   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I1028 05:32:36.967559   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /usr/share/ca-certificates/119092.pem (1708 bytes)
	I1028 05:32:36.974424   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1028 05:32:36.981127   13885 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem --> /usr/share/ca-certificates/11909.pem (1338 bytes)
	I1028 05:32:36.988394   13885 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1028 05:32:36.993361   13885 ssh_runner.go:195] Run: openssl version
	I1028 05:32:36.995378   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11909.pem && ln -fs /usr/share/ca-certificates/11909.pem /etc/ssl/certs/11909.pem"
	I1028 05:32:36.998442   13885 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11909.pem
	I1028 05:32:36.999779   13885 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 12:21 /usr/share/ca-certificates/11909.pem
	I1028 05:32:36.999803   13885 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11909.pem
	I1028 05:32:37.001670   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11909.pem /etc/ssl/certs/51391683.0"
	I1028 05:32:37.004411   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/119092.pem && ln -fs /usr/share/ca-certificates/119092.pem /etc/ssl/certs/119092.pem"
	I1028 05:32:37.007817   13885 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/119092.pem
	I1028 05:32:37.009339   13885 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 12:21 /usr/share/ca-certificates/119092.pem
	I1028 05:32:37.009362   13885 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/119092.pem
	I1028 05:32:37.011218   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/119092.pem /etc/ssl/certs/3ec20f2e.0"
	I1028 05:32:37.013786   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1028 05:32:37.016950   13885 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:32:37.018447   13885 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:32 /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:32:37.018474   13885 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:32:37.020246   13885 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1028 05:32:37.023035   13885 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I1028 05:32:37.024491   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I1028 05:32:37.026517   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I1028 05:32:37.028186   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I1028 05:32:37.030041   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I1028 05:32:37.031837   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I1028 05:32:37.033871   13885 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I1028 05:32:37.035687   13885 kubeadm.go:392] StartCluster: {Name:running-upgrade-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59017 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:ru
nning-upgrade-343000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:32:37.035769   13885 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:32:37.045871   13885 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1028 05:32:37.050032   13885 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I1028 05:32:37.050037   13885 kubeadm.go:593] restartPrimaryControlPlane start ...
	I1028 05:32:37.050069   13885 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I1028 05:32:37.053134   13885 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:32:37.053171   13885 kubeconfig.go:47] verify endpoint returned: get endpoint: "running-upgrade-343000" does not appear in /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:32:37.053186   13885 kubeconfig.go:62] /Users/jenkins/minikube-integration/19865-11397/kubeconfig needs updating (will repair): [kubeconfig missing "running-upgrade-343000" cluster setting kubeconfig missing "running-upgrade-343000" context setting]
	I1028 05:32:37.053357   13885 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:32:37.054113   13885 kapi.go:59] client config for running-upgrade-343000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x104796680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:32:37.055090   13885 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I1028 05:32:37.057818   13885 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "running-upgrade-343000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I1028 05:32:37.057823   13885 kubeadm.go:1160] stopping kube-system containers ...
	I1028 05:32:37.057871   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:32:37.072545   13885 docker.go:483] Stopping containers: [2533fbb2981c 2c37c2bd3b8c c7b8bfacf4fb 90e4db1dbfa7 9bbc93f4420b c447355932aa 482c30327b17 e3376d6426b6 74a797915875 d63869389f00 1b42e0233271]
	I1028 05:32:37.072617   13885 ssh_runner.go:195] Run: docker stop 2533fbb2981c 2c37c2bd3b8c c7b8bfacf4fb 90e4db1dbfa7 9bbc93f4420b c447355932aa 482c30327b17 e3376d6426b6 74a797915875 d63869389f00 1b42e0233271
	I1028 05:32:37.083781   13885 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I1028 05:32:37.191635   13885 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:32:37.199130   13885 kubeadm.go:157] found existing configuration files:
	-rw------- 1 root root 5643 Oct 28 12:32 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5653 Oct 28 12:32 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 2027 Oct 28 12:32 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5601 Oct 28 12:32 /etc/kubernetes/scheduler.conf
	
	I1028 05:32:37.199202   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf
	I1028 05:32:37.218202   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:32:37.218272   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:32:37.223683   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf
	I1028 05:32:37.226656   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:32:37.226702   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:32:37.229462   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf
	I1028 05:32:37.232260   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:32:37.232297   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:32:37.235208   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf
	I1028 05:32:37.239386   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:32:37.239440   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:32:37.255536   13885 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:32:37.263978   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:32:37.299316   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:32:37.790509   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:32:37.997242   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:32:38.026983   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:32:38.054541   13885 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:32:38.054629   13885 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:32:38.556784   13885 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:32:39.056678   13885 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:32:39.061245   13885 api_server.go:72] duration metric: took 1.006701125s to wait for apiserver process to appear ...
	I1028 05:32:39.061256   13885 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:32:39.061286   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:32:44.063193   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:32:44.063283   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:32:49.064042   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:32:49.064147   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:32:54.065242   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:32:54.065284   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:32:59.065795   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:32:59.065898   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:04.067329   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:04.067443   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:09.069487   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:09.069596   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:14.072090   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:14.072175   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:19.073852   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:19.073955   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:24.076671   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:24.076731   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:29.077894   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:29.077990   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:34.080852   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:34.080947   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:39.082844   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:39.083446   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:33:39.123418   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:33:39.123572   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:33:39.145890   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:33:39.146017   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:33:39.161403   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:33:39.161487   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:33:39.173978   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:33:39.174068   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:33:39.185309   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:33:39.185392   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:33:39.196277   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:33:39.196356   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:33:39.207131   13885 logs.go:282] 0 containers: []
	W1028 05:33:39.207162   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:33:39.207228   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:33:39.217709   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:33:39.217738   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:33:39.217743   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:33:39.229633   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:33:39.229647   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:33:39.254636   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:33:39.254646   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:33:39.291204   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:33:39.291211   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:33:39.308799   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:33:39.308812   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:33:39.326579   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:33:39.326589   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:33:39.347841   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:33:39.347851   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:33:39.365534   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:33:39.365545   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:33:39.377295   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:33:39.377304   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:33:39.393065   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:33:39.393078   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:33:39.467052   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:33:39.467065   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:33:39.481885   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:33:39.481897   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:33:39.494169   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:33:39.494183   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:33:39.507811   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:33:39.507823   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:33:39.519760   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:33:39.519773   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:33:39.524831   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:33:39.524837   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:33:39.536101   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:33:39.536111   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:33:42.054154   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:47.056570   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:47.057280   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:33:47.095908   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:33:47.096086   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:33:47.116568   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:33:47.116672   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:33:47.130907   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:33:47.130994   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:33:47.143057   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:33:47.143149   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:33:47.153394   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:33:47.153470   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:33:47.164267   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:33:47.164341   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:33:47.173913   13885 logs.go:282] 0 containers: []
	W1028 05:33:47.173925   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:33:47.173995   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:33:47.183677   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:33:47.183694   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:33:47.183699   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:33:47.195316   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:33:47.195331   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:33:47.223544   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:33:47.223553   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:33:47.238501   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:33:47.238518   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:33:47.251489   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:33:47.251501   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:33:47.266248   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:33:47.266257   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:33:47.289487   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:33:47.289497   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:33:47.304077   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:33:47.304086   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:33:47.314891   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:33:47.314900   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:33:47.327144   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:33:47.327154   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:33:47.341425   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:33:47.341433   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:33:47.352178   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:33:47.352189   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:33:47.392146   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:33:47.392156   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:33:47.403845   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:33:47.403858   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:33:47.421334   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:33:47.421344   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:33:47.437011   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:33:47.437020   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:33:47.473789   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:33:47.473798   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:33:49.979933   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:33:54.982488   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:33:54.983112   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:33:55.030042   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:33:55.030191   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:33:55.049984   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:33:55.050098   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:33:55.064627   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:33:55.064701   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:33:55.076908   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:33:55.077001   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:33:55.087604   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:33:55.087676   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:33:55.098499   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:33:55.098564   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:33:55.109162   13885 logs.go:282] 0 containers: []
	W1028 05:33:55.109175   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:33:55.109238   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:33:55.119899   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:33:55.119922   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:33:55.119927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:33:55.133684   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:33:55.133695   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:33:55.144929   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:33:55.144940   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:33:55.161962   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:33:55.161972   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:33:55.186878   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:33:55.186886   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:33:55.225204   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:33:55.225214   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:33:55.241961   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:33:55.241972   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:33:55.253833   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:33:55.253845   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:33:55.266139   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:33:55.266149   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:33:55.270659   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:33:55.270668   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:33:55.296651   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:33:55.296660   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:33:55.311091   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:33:55.311100   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:33:55.326256   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:33:55.326267   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:33:55.337874   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:33:55.337884   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:33:55.374469   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:33:55.374477   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:33:55.389516   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:33:55.389526   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:33:55.408329   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:33:55.408338   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:33:57.922262   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:02.925224   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:02.925822   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:02.966139   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:02.966303   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:02.990448   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:02.990582   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:03.005491   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:03.005580   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:03.017586   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:03.017673   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:03.028186   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:03.028274   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:03.038724   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:03.038804   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:03.062997   13885 logs.go:282] 0 containers: []
	W1028 05:34:03.063012   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:03.063085   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:03.073800   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:03.073818   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:03.073822   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:03.089030   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:03.089040   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:03.101337   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:03.101350   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:03.117486   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:03.117495   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:03.132703   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:03.132714   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:03.137600   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:03.137609   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:03.156974   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:03.156983   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:03.168614   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:03.168624   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:03.189122   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:03.189133   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:03.200954   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:03.200964   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:03.214421   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:03.214431   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:03.253522   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:03.253531   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:03.287947   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:03.287958   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:03.301880   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:03.301891   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:03.326224   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:03.326232   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:03.343522   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:03.343534   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:03.354662   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:03.354673   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:05.867823   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:10.870562   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:10.871085   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:10.912002   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:10.912177   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:10.934413   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:10.934533   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:10.953173   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:10.953268   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:10.965664   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:10.965752   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:10.976413   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:10.976494   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:10.987266   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:10.987345   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:10.997915   13885 logs.go:282] 0 containers: []
	W1028 05:34:10.997928   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:10.997986   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:11.008848   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:11.008866   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:11.008872   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:11.023494   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:11.023503   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:11.041726   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:11.041739   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:11.068033   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:11.068043   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:11.087384   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:11.087394   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:11.126166   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:11.126174   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:11.140815   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:11.140824   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:11.152374   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:11.152385   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:11.187816   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:11.187828   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:11.202246   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:11.202256   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:11.214168   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:11.214178   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:11.226166   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:11.226182   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:11.252036   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:11.252043   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:11.256332   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:11.256337   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:11.282915   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:11.282926   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:11.301229   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:11.301239   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:11.313097   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:11.313108   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:13.827265   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:18.830126   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:18.830721   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:18.870162   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:18.870321   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:18.892891   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:18.893002   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:18.907684   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:18.907771   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:18.920106   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:18.920186   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:18.930992   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:18.931070   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:18.941607   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:18.941687   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:18.952028   13885 logs.go:282] 0 containers: []
	W1028 05:34:18.952039   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:18.952099   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:18.962662   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:18.962679   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:18.962684   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:18.976933   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:18.976946   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:18.994407   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:18.994419   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:19.013919   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:19.013933   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:19.025326   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:19.025341   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:19.030037   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:19.030046   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:19.045916   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:19.045927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:19.057738   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:19.057750   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:19.082217   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:19.082224   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:19.119082   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:19.119089   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:19.157624   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:19.157635   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:19.177510   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:19.177523   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:19.191691   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:19.191703   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:19.203788   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:19.203800   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:19.218586   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:19.218597   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:19.230135   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:19.230145   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:19.241865   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:19.241878   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:21.764555   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:26.767348   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:26.768016   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:26.807230   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:26.807384   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:26.829364   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:26.829503   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:26.844546   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:26.844633   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:26.857083   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:26.857163   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:26.868026   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:26.868098   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:26.878776   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:26.878859   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:26.888906   13885 logs.go:282] 0 containers: []
	W1028 05:34:26.888917   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:26.888985   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:26.899056   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:26.899071   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:26.899076   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:26.923710   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:26.923720   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:26.927911   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:26.927917   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:26.947594   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:26.947604   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:26.963662   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:26.963671   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:26.978360   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:26.978370   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:26.995468   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:26.995477   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:27.034031   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:27.034039   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:27.049479   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:27.049488   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:27.063748   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:27.063757   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:27.074737   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:27.074748   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:27.086260   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:27.086271   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:27.103714   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:27.103725   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:27.118379   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:27.118391   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:27.154385   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:27.154394   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:27.166074   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:27.166083   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:27.182986   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:27.182998   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:29.697368   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:34.700276   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:34.700829   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:34.738477   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:34.738632   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:34.759318   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:34.759439   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:34.774333   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:34.774417   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:34.786751   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:34.786831   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:34.797790   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:34.797866   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:34.808623   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:34.808698   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:34.818727   13885 logs.go:282] 0 containers: []
	W1028 05:34:34.818741   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:34.818806   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:34.829654   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:34.829676   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:34.829682   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:34.867265   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:34.867277   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:34.881478   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:34.881490   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:34.895123   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:34.895134   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:34.916255   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:34.916267   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:34.927114   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:34.927124   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:34.939762   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:34.939774   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:34.977756   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:34.977766   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:34.982419   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:34.982427   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:34.997347   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:34.997358   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:35.020233   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:35.020246   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:35.033439   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:35.033451   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:35.059127   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:35.059136   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:35.071286   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:35.071297   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:35.086208   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:35.086220   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:35.097803   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:35.097815   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:35.118199   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:35.118209   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:37.633686   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:42.636028   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:42.636206   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:42.650411   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:42.650490   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:42.661566   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:42.661647   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:42.672153   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:42.672229   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:42.682662   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:42.682732   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:42.697219   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:42.697294   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:42.707869   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:42.707933   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:42.718044   13885 logs.go:282] 0 containers: []
	W1028 05:34:42.718063   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:42.718120   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:42.728529   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:42.728549   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:42.728554   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:42.740059   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:42.740071   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:42.751560   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:42.751570   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:42.766926   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:42.766938   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:42.778488   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:42.778498   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:42.815455   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:42.815467   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:42.840767   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:42.840780   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:42.858760   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:42.858769   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:42.878768   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:42.878781   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:42.898707   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:42.898717   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:42.912552   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:42.912563   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:42.927530   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:42.927543   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:42.938249   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:42.938259   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:42.951179   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:42.951193   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:42.955715   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:42.955724   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:42.969699   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:42.969712   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:42.981484   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:42.981494   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:45.522773   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:50.525364   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:50.525644   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:50.551601   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:50.551738   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:50.582936   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:50.583010   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:50.594029   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:50.594105   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:50.605046   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:50.605122   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:50.616093   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:50.616160   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:50.627523   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:50.627604   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:50.637984   13885 logs.go:282] 0 containers: []
	W1028 05:34:50.637998   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:50.638058   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:50.648884   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:50.648900   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:50.648905   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:50.660796   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:50.660805   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:50.675818   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:50.675830   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:50.693002   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:50.693013   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:50.718439   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:50.718447   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:50.752482   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:50.752493   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:50.772398   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:50.772411   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:50.786653   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:50.786666   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:50.797369   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:50.797380   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:50.812961   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:50.812971   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:50.824326   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:50.824338   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:50.863169   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:50.863177   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:50.878093   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:50.878105   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:50.889632   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:50.889643   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:50.903965   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:50.903976   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:50.917733   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:50.917743   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:50.928911   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:50.928920   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:34:53.435892   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:34:58.438189   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:34:58.438813   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:34:58.479681   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:34:58.479842   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:34:58.503858   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:34:58.503993   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:34:58.519605   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:34:58.519691   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:34:58.532225   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:34:58.532308   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:34:58.544662   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:34:58.544729   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:34:58.567678   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:34:58.567767   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:34:58.578490   13885 logs.go:282] 0 containers: []
	W1028 05:34:58.578500   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:34:58.578556   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:34:58.589286   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:34:58.589305   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:34:58.589310   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:34:58.615002   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:34:58.615012   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:34:58.626390   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:34:58.626401   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:34:58.663124   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:34:58.663133   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:34:58.682364   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:34:58.682374   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:34:58.693540   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:34:58.693550   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:34:58.705565   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:34:58.705573   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:34:58.740696   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:34:58.740708   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:34:58.760319   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:34:58.760328   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:34:58.778672   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:34:58.778683   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:34:58.790519   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:34:58.790531   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:34:58.802219   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:34:58.802230   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:34:58.825840   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:34:58.825847   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:34:58.840002   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:34:58.840012   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:34:58.853881   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:34:58.853890   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:34:58.870812   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:34:58.870824   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:34:58.882735   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:34:58.882749   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:01.389030   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:06.391425   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:06.391931   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:06.425278   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:06.425431   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:06.445267   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:06.445373   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:06.459450   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:06.459522   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:06.471713   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:06.471799   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:06.482486   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:06.482565   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:06.493040   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:06.493113   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:06.504208   13885 logs.go:282] 0 containers: []
	W1028 05:35:06.504225   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:06.504298   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:06.515060   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:06.515083   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:06.515089   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:06.549259   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:06.549272   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:06.563759   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:06.563772   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:06.575301   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:06.575314   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:06.589837   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:06.589848   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:06.605209   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:06.605221   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:06.645496   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:06.645512   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:06.660079   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:06.660089   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:06.681746   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:06.681757   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:06.705237   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:06.705246   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:06.709917   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:06.709925   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:06.732742   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:06.732751   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:06.744555   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:06.744569   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:06.755954   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:06.755966   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:06.767471   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:06.767483   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:06.781873   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:06.781883   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:06.793121   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:06.793131   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:09.307454   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:14.308646   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:14.308772   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:14.320229   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:14.320310   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:14.336254   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:14.336333   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:14.348354   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:14.348433   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:14.360782   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:14.360864   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:14.371619   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:14.371689   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:14.383124   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:14.383205   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:14.396561   13885 logs.go:282] 0 containers: []
	W1028 05:35:14.396575   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:14.396645   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:14.408669   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:14.408686   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:14.408691   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:14.425591   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:14.425604   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:14.430400   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:14.430412   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:14.446145   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:14.446160   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:14.462886   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:14.462897   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:14.475151   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:14.475163   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:14.499912   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:14.499926   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:14.521692   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:14.521703   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:14.533660   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:14.533671   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:14.545601   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:14.545615   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:14.559970   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:14.559983   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:14.574275   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:14.574287   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:14.589639   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:14.589650   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:14.608020   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:14.608030   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:14.620190   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:14.620202   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:14.659684   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:14.659701   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:14.695387   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:14.695400   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:17.212507   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:22.214831   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:22.214960   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:22.228204   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:22.228289   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:22.238376   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:22.238456   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:22.248475   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:22.248557   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:22.258936   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:22.259015   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:22.270130   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:22.270199   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:22.280318   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:22.280401   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:22.290323   13885 logs.go:282] 0 containers: []
	W1028 05:35:22.290340   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:22.290407   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:22.301242   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:22.301261   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:22.301266   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:22.320107   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:22.320119   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:22.324587   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:22.324595   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:22.359905   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:22.359916   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:22.374033   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:22.374046   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:22.392036   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:22.392049   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:22.416219   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:22.416226   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:22.430267   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:22.430277   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:22.451247   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:22.451258   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:22.462266   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:22.462278   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:22.473938   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:22.473951   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:22.487250   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:22.487262   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:22.504674   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:22.504687   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:22.521395   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:22.521405   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:22.532463   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:22.532476   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:22.570291   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:22.570303   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:22.590801   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:22.590814   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:25.107929   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:30.109642   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:30.109754   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:30.120512   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:30.120593   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:30.130842   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:30.130917   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:30.144731   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:30.144806   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:30.160028   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:30.160101   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:30.171336   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:30.171419   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:30.181706   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:30.181784   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:30.192194   13885 logs.go:282] 0 containers: []
	W1028 05:35:30.192207   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:30.192278   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:30.203640   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:30.203660   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:30.203666   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:30.218700   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:30.218710   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:30.234301   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:30.234312   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:30.245498   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:30.245511   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:30.256833   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:30.256845   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:30.272299   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:30.272310   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:30.284367   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:30.284378   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:30.288828   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:30.288836   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:30.308407   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:30.308423   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:30.322271   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:30.322283   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:30.347402   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:30.347412   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:30.359154   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:30.359168   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:30.370688   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:30.370699   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:30.382831   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:30.382844   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:30.403906   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:30.403918   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:30.444041   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:30.444055   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:30.484236   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:30.484249   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:33.001661   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:38.004218   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:38.004526   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:38.030249   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:38.030387   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:38.047231   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:38.047321   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:38.059929   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:38.060009   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:38.071938   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:38.072014   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:38.085044   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:38.085112   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:38.100222   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:38.100297   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:38.110966   13885 logs.go:282] 0 containers: []
	W1028 05:35:38.110979   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:38.111043   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:38.123168   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:38.123191   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:38.123198   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:38.135027   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:38.135037   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:38.159818   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:38.159829   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:38.171462   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:38.171472   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:38.175832   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:38.175838   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:38.190735   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:38.190743   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:38.205935   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:38.205946   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:38.217820   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:38.217831   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:38.231603   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:38.231613   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:38.243590   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:38.243601   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:38.261050   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:38.261061   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:38.276441   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:38.276451   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:38.288016   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:38.288025   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:38.299498   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:38.299510   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:38.337110   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:38.337118   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:38.372663   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:38.372672   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:38.387316   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:38.387329   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:40.909843   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:45.912896   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:45.913691   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:45.953563   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:45.953737   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:45.976133   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:45.976267   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:45.991172   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:45.991265   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:46.003652   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:46.003738   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:46.014917   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:46.014997   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:46.025697   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:46.025773   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:46.035973   13885 logs.go:282] 0 containers: []
	W1028 05:35:46.035985   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:46.036048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:46.046884   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:46.046902   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:46.046907   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:46.051246   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:46.051255   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:46.065087   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:46.065098   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:46.079637   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:46.079650   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:46.098954   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:46.098967   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:46.114513   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:46.114524   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:46.152892   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:46.152899   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:46.169199   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:46.169211   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:46.184822   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:46.184832   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:46.209085   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:46.209093   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:46.221103   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:46.221116   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:46.244160   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:46.244172   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:46.255894   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:46.255905   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:46.297130   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:46.297143   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:46.311049   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:46.311058   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:46.327747   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:46.327759   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:46.338805   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:46.338814   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:48.853031   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:53.855391   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:53.855529   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:53.868174   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:53.868255   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:53.883509   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:53.883593   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:53.900204   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:53.900288   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:53.912379   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:53.912460   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:53.924598   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:53.924682   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:53.941830   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:53.941911   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:53.954421   13885 logs.go:282] 0 containers: []
	W1028 05:35:53.954434   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:53.954507   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:53.966190   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:53.966214   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:53.966219   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:53.982031   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:53.982044   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:53.995095   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:53.995106   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:53.999819   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:53.999829   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:54.044300   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:54.044323   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:54.068101   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:54.068119   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:54.085400   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:54.085415   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:54.105940   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:54.105953   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:54.149146   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:54.149167   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:54.163388   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:54.163399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:54.178333   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:54.178344   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:54.190198   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:54.190210   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:54.211585   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:54.211598   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:54.235258   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:54.235271   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:54.247126   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:54.247136   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:54.259070   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:54.259080   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:54.277535   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:54.277545   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:56.791830   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:01.794657   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:01.795252   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:01.848402   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:01.848563   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:01.867323   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:01.867426   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:01.880993   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:01.881088   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:01.892403   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:01.892484   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:01.903526   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:01.903605   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:01.914345   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:01.914420   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:01.924693   13885 logs.go:282] 0 containers: []
	W1028 05:36:01.924704   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:01.924766   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:01.935145   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:01.935175   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:01.935180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:01.956389   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:01.956399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:01.968455   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:01.968468   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:01.981362   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:01.981377   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:02.028498   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:02.028517   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:02.043616   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:02.043627   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:02.056457   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:02.056468   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:02.093100   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:02.093115   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:02.108832   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:02.108845   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:02.125721   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:02.125731   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:02.144099   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:02.144109   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:02.167810   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:02.167820   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:02.179284   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:02.179298   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:02.183539   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:02.183545   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:02.199801   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:02.199813   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:02.215793   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:02.215807   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:02.234145   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:02.234156   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:04.747764   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:09.750013   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:09.750120   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:09.761449   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:09.761536   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:09.774103   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:09.774175   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:09.784860   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:09.784950   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:09.795703   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:09.795792   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:09.806781   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:09.806853   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:09.818707   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:09.818780   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:09.829843   13885 logs.go:282] 0 containers: []
	W1028 05:36:09.829858   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:09.829930   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:09.844913   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:09.844934   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:09.844940   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:09.856807   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:09.856821   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:09.882408   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:09.882426   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:09.921349   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:09.921361   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:09.936542   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:09.936556   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:09.949394   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:09.949406   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:09.963804   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:09.963816   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:09.993124   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:09.993145   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:10.007853   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:10.007864   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:10.021546   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:10.021558   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:10.034094   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:10.034106   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:10.074349   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:10.074369   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:10.079727   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:10.079739   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:10.096478   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:10.096491   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:10.117778   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:10.117790   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:10.132836   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:10.132847   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:10.148276   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:10.148294   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:12.668874   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:17.671202   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:17.671672   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:17.699991   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:17.700145   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:17.718723   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:17.718811   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:17.732763   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:17.732853   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:17.744166   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:17.744253   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:17.755277   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:17.755354   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:17.766305   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:17.766392   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:17.777736   13885 logs.go:282] 0 containers: []
	W1028 05:36:17.777750   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:17.777822   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:17.789288   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:17.789306   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:17.789311   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:17.813478   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:17.813486   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:17.825194   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:17.825207   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:17.840123   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:17.840132   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:17.852110   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:17.852123   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:17.868843   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:17.868860   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:17.908471   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:17.908490   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:17.923108   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:17.923118   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:17.938706   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:17.938718   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:17.950276   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:17.950290   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:17.986177   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:17.986188   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:18.001202   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:18.001212   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:18.015740   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:18.015750   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:18.027159   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:18.027174   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:18.039410   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:18.039421   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:18.056825   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:18.056835   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:18.061619   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:18.061626   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:20.586576   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:25.588274   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:25.588516   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:25.608903   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:25.609016   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:25.623527   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:25.623620   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:25.637155   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:25.637233   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:25.649383   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:25.649466   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:25.659715   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:25.659794   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:25.669993   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:25.670073   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:25.680824   13885 logs.go:282] 0 containers: []
	W1028 05:36:25.680840   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:25.680912   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:25.691666   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:25.691683   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:25.691689   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:25.705570   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:25.705583   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:25.716760   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:25.716770   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:25.728726   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:25.728737   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:25.744164   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:25.744174   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:25.756289   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:25.756299   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:25.777168   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:25.777178   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:25.792665   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:25.792674   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:25.807744   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:25.807755   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:25.822886   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:25.822897   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:25.835326   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:25.835336   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:25.840101   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:25.840108   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:25.874707   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:25.874718   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:25.889001   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:25.889010   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:25.906229   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:25.906239   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:25.918149   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:25.918160   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:25.940606   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:25.940619   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:28.481927   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:33.484234   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:33.484410   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:33.504252   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:33.504356   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:33.517867   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:33.517949   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:33.528942   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:33.529023   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:33.539587   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:33.539674   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:33.550590   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:33.550668   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:33.560966   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:33.561044   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:33.570837   13885 logs.go:282] 0 containers: []
	W1028 05:36:33.570850   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:33.570914   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:33.584978   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:33.584995   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:33.585000   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:33.603508   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:33.603520   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:33.617982   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:33.617992   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:33.632995   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:33.633005   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:33.644767   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:33.644778   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:33.656907   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:33.656917   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:33.694949   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:33.694960   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:33.709457   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:33.709467   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:33.748566   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:33.748575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:33.770094   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:33.770105   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:33.781777   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:33.781788   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:33.793463   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:33.793474   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:33.817354   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:33.817362   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:33.821577   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:33.821584   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:33.838660   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:33.838670   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:33.855171   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:33.855181   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:33.867299   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:33.867311   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:36.380757   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:41.383124   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:41.383216   13885 kubeadm.go:597] duration metric: took 4m4.332660417s to restartPrimaryControlPlane
	W1028 05:36:41.383323   13885 out.go:270] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	! Unable to restart control-plane node(s), will reset cluster: <no value>
	I1028 05:36:41.383369   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I1028 05:36:42.481818   13885 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.09843425s)
	I1028 05:36:42.481905   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 05:36:42.487042   13885 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:36:42.490317   13885 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:36:42.493194   13885 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:36:42.493203   13885 kubeadm.go:157] found existing configuration files:
	
	I1028 05:36:42.493240   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf
	I1028 05:36:42.495773   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:36:42.495799   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:36:42.498903   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf
	I1028 05:36:42.501988   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:36:42.502028   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:36:42.504685   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf
	I1028 05:36:42.507212   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:36:42.507241   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:36:42.510439   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf
	I1028 05:36:42.513454   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:36:42.513488   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:36:42.516095   13885 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I1028 05:36:42.533622   13885 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I1028 05:36:42.533898   13885 kubeadm.go:310] [preflight] Running pre-flight checks
	I1028 05:36:42.586875   13885 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1028 05:36:42.586930   13885 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1028 05:36:42.586978   13885 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1028 05:36:42.634955   13885 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1028 05:36:42.640098   13885 out.go:235]   - Generating certificates and keys ...
	I1028 05:36:42.640133   13885 kubeadm.go:310] [certs] Using existing ca certificate authority
	I1028 05:36:42.640169   13885 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I1028 05:36:42.640210   13885 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I1028 05:36:42.640283   13885 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I1028 05:36:42.640319   13885 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I1028 05:36:42.640393   13885 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I1028 05:36:42.640434   13885 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I1028 05:36:42.640472   13885 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I1028 05:36:42.640551   13885 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I1028 05:36:42.640590   13885 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I1028 05:36:42.640635   13885 kubeadm.go:310] [certs] Using the existing "sa" key
	I1028 05:36:42.640669   13885 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1028 05:36:42.772144   13885 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1028 05:36:42.899866   13885 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1028 05:36:42.958340   13885 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1028 05:36:43.057571   13885 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1028 05:36:43.086788   13885 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1028 05:36:43.087220   13885 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1028 05:36:43.087262   13885 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I1028 05:36:43.174172   13885 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1028 05:36:43.178293   13885 out.go:235]   - Booting up control plane ...
	I1028 05:36:43.178342   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1028 05:36:43.178387   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1028 05:36:43.178532   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1028 05:36:43.179659   13885 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1028 05:36:43.179758   13885 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1028 05:36:47.182086   13885 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.002371 seconds
	I1028 05:36:47.182144   13885 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1028 05:36:47.185854   13885 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1028 05:36:47.696740   13885 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I1028 05:36:47.696880   13885 kubeadm.go:310] [mark-control-plane] Marking the node running-upgrade-343000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1028 05:36:48.200509   13885 kubeadm.go:310] [bootstrap-token] Using token: nawgah.pntycuvv3oxfpjjz
	I1028 05:36:48.206902   13885 out.go:235]   - Configuring RBAC rules ...
	I1028 05:36:48.206964   13885 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1028 05:36:48.207007   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1028 05:36:48.210893   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1028 05:36:48.211762   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1028 05:36:48.212684   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1028 05:36:48.213839   13885 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1028 05:36:48.217203   13885 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1028 05:36:48.405371   13885 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I1028 05:36:48.606227   13885 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I1028 05:36:48.606721   13885 kubeadm.go:310] 
	I1028 05:36:48.606749   13885 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I1028 05:36:48.606755   13885 kubeadm.go:310] 
	I1028 05:36:48.606792   13885 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I1028 05:36:48.606795   13885 kubeadm.go:310] 
	I1028 05:36:48.606807   13885 kubeadm.go:310]   mkdir -p $HOME/.kube
	I1028 05:36:48.606843   13885 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1028 05:36:48.606871   13885 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1028 05:36:48.606873   13885 kubeadm.go:310] 
	I1028 05:36:48.606901   13885 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I1028 05:36:48.606920   13885 kubeadm.go:310] 
	I1028 05:36:48.606946   13885 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1028 05:36:48.606949   13885 kubeadm.go:310] 
	I1028 05:36:48.606979   13885 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I1028 05:36:48.607013   13885 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1028 05:36:48.607070   13885 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1028 05:36:48.607074   13885 kubeadm.go:310] 
	I1028 05:36:48.607152   13885 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I1028 05:36:48.607196   13885 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I1028 05:36:48.607201   13885 kubeadm.go:310] 
	I1028 05:36:48.607252   13885 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token nawgah.pntycuvv3oxfpjjz \
	I1028 05:36:48.607396   13885 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 \
	I1028 05:36:48.607422   13885 kubeadm.go:310] 	--control-plane 
	I1028 05:36:48.607427   13885 kubeadm.go:310] 
	I1028 05:36:48.607474   13885 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I1028 05:36:48.607480   13885 kubeadm.go:310] 
	I1028 05:36:48.607540   13885 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token nawgah.pntycuvv3oxfpjjz \
	I1028 05:36:48.607628   13885 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 
	I1028 05:36:48.607756   13885 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1028 05:36:48.607764   13885 cni.go:84] Creating CNI manager for ""
	I1028 05:36:48.607773   13885 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:36:48.615166   13885 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1028 05:36:48.618303   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1028 05:36:48.621293   13885 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I1028 05:36:48.626230   13885 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1028 05:36:48.626282   13885 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1028 05:36:48.626310   13885 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes running-upgrade-343000 minikube.k8s.io/updated_at=2024_10_28T05_36_48_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=running-upgrade-343000 minikube.k8s.io/primary=true
	I1028 05:36:48.677834   13885 kubeadm.go:1113] duration metric: took 51.593375ms to wait for elevateKubeSystemPrivileges
	I1028 05:36:48.677855   13885 ops.go:34] apiserver oom_adj: -16
	I1028 05:36:48.677862   13885 kubeadm.go:394] duration metric: took 4m11.6416505s to StartCluster
	I1028 05:36:48.677874   13885 settings.go:142] acquiring lock: {Name:mkccfb5f47d0974e890d9ac591452228f9b915fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:48.678077   13885 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:36:48.678468   13885 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:48.678683   13885 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:36:48.678688   13885 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 05:36:48.678724   13885 addons.go:69] Setting storage-provisioner=true in profile "running-upgrade-343000"
	I1028 05:36:48.678731   13885 addons.go:234] Setting addon storage-provisioner=true in "running-upgrade-343000"
	W1028 05:36:48.678734   13885 addons.go:243] addon storage-provisioner should already be in state true
	I1028 05:36:48.678754   13885 addons.go:69] Setting default-storageclass=true in profile "running-upgrade-343000"
	I1028 05:36:48.678764   13885 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-343000"
	I1028 05:36:48.678757   13885 host.go:66] Checking if "running-upgrade-343000" exists ...
	I1028 05:36:48.678873   13885 config.go:182] Loaded profile config "running-upgrade-343000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:36:48.679759   13885 kapi.go:59] client config for running-upgrade-343000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x104796680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:36:48.680383   13885 addons.go:234] Setting addon default-storageclass=true in "running-upgrade-343000"
	W1028 05:36:48.680389   13885 addons.go:243] addon default-storageclass should already be in state true
	I1028 05:36:48.680397   13885 host.go:66] Checking if "running-upgrade-343000" exists ...
	I1028 05:36:48.683258   13885 out.go:177] * Verifying Kubernetes components...
	I1028 05:36:48.683641   13885 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 05:36:48.686567   13885 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 05:36:48.686573   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:36:48.690211   13885 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:48.694286   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:48.697240   13885 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:36:48.697247   13885 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 05:36:48.697252   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:36:48.784123   13885 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:36:48.789038   13885 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:36:48.789088   13885 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:48.792923   13885 api_server.go:72] duration metric: took 114.225083ms to wait for apiserver process to appear ...
	I1028 05:36:48.792932   13885 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:36:48.792940   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:48.804159   13885 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:36:48.862117   13885 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 05:36:49.143359   13885 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I1028 05:36:49.143372   13885 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I1028 05:36:53.795105   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:53.795208   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:58.795698   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:58.795735   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:03.796630   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:03.796673   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:08.797361   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:08.797417   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:13.798346   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:13.798362   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:18.799431   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:18.799478   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W1028 05:37:19.145487   13885 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I1028 05:37:19.149907   13885 out.go:177] * Enabled addons: storage-provisioner
	I1028 05:37:19.156689   13885 addons.go:510] duration metric: took 30.477937292s for enable addons: enabled=[storage-provisioner]
	I1028 05:37:23.800999   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:23.801054   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:28.803027   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:28.803051   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:33.805291   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:33.805347   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:38.807771   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:38.807810   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:43.808191   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:43.808245   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:48.810590   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:48.810705   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:48.821826   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:37:48.821907   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:48.832169   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:37:48.832251   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:48.843056   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:37:48.843138   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:48.858119   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:37:48.858195   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:48.868801   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:37:48.868871   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:48.879603   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:37:48.879681   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:48.889534   13885 logs.go:282] 0 containers: []
	W1028 05:37:48.889546   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:48.889605   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:48.899382   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:37:48.899394   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:48.899400   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:48.942517   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:37:48.942529   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:37:48.956947   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:37:48.956959   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:37:48.968266   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:37:48.968279   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:48.979953   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:48.979965   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:49.013834   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:49.013845   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:49.018361   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:37:49.018369   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:37:49.032357   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:37:49.032367   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:37:49.052618   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:37:49.052628   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:37:49.065657   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:37:49.065670   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:37:49.079938   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:37:49.079952   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:37:49.092370   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:37:49.092381   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:37:49.110118   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:49.110131   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:51.638020   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:56.640651   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:56.640909   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:56.665396   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:37:56.665573   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:56.682501   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:37:56.682597   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:56.695733   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:37:56.695815   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:56.710014   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:37:56.710093   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:56.720955   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:37:56.721038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:56.731654   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:37:56.731734   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:56.745874   13885 logs.go:282] 0 containers: []
	W1028 05:37:56.745884   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:56.745959   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:56.756716   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:37:56.756731   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:56.756736   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:56.792033   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:37:56.792046   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:37:56.806002   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:37:56.806013   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:37:56.818160   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:37:56.818175   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:37:56.836868   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:37:56.836882   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:37:56.854233   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:56.854246   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:56.890346   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:37:56.890358   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:37:56.904538   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:37:56.904549   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:37:56.916401   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:37:56.916416   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:37:56.937148   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:37:56.937161   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:37:56.948968   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:56.948979   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:56.973708   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:37:56.973718   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:56.985609   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:56.985621   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:59.492133   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:04.494465   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:04.494665   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:04.516666   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:04.516780   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:04.531831   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:04.531907   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:04.544125   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:04.544218   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:04.555617   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:04.555692   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:04.566422   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:04.566509   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:04.576940   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:04.577014   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:04.587415   13885 logs.go:282] 0 containers: []
	W1028 05:38:04.587425   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:04.587487   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:04.600182   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:04.600198   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:04.600204   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:04.625730   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:04.625739   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:04.660241   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:04.660247   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:04.674617   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:04.674630   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:04.688171   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:04.688180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:04.699864   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:04.699873   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:04.714565   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:04.714575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:04.732241   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:04.732250   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:04.750305   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:04.750317   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:04.754684   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:04.754692   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:04.788790   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:04.788804   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:04.804258   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:04.804268   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:04.815848   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:04.815858   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:07.327661   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:12.330056   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:12.330235   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:12.342547   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:12.342629   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:12.353368   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:12.353440   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:12.363778   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:12.363856   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:12.374142   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:12.374215   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:12.384368   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:12.384447   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:12.394503   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:12.394577   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:12.404642   13885 logs.go:282] 0 containers: []
	W1028 05:38:12.404655   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:12.404710   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:12.415296   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:12.415312   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:12.415317   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:12.433647   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:12.433663   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:12.446373   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:12.446387   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:12.482658   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:12.482672   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:12.487400   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:12.487406   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:12.498722   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:12.498736   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:12.510370   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:12.510379   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:12.525229   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:12.525239   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:12.550932   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:12.550941   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:12.586005   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:12.586016   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:12.601032   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:12.601045   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:12.614960   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:12.614970   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:12.626544   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:12.626553   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:15.142132   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:20.144054   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:20.144225   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:20.159181   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:20.159266   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:20.170736   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:20.170812   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:20.186022   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:20.186100   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:20.196197   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:20.196266   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:20.209176   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:20.209252   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:20.219861   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:20.219929   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:20.230857   13885 logs.go:282] 0 containers: []
	W1028 05:38:20.230868   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:20.230932   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:20.241005   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:20.241021   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:20.241026   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:20.253341   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:20.253352   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:20.265949   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:20.265960   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:20.286277   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:20.286287   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:20.297957   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:20.297967   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:20.333176   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:20.333184   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:20.337494   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:20.337504   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:20.371054   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:20.371064   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:20.385715   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:20.385726   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:20.399525   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:20.399533   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:20.414742   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:20.414753   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:20.426449   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:20.426459   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:20.441759   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:20.441769   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:22.967288   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:27.969676   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:27.970038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:28.005438   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:28.005582   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:28.022352   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:28.022460   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:28.035085   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:28.035166   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:28.053235   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:28.053306   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:28.064820   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:28.064904   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:28.075900   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:28.075975   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:28.086535   13885 logs.go:282] 0 containers: []
	W1028 05:38:28.086547   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:28.086614   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:28.097473   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:28.097486   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:28.097493   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:28.133013   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:28.133024   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:28.147954   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:28.147966   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:28.159397   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:28.159407   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:28.174602   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:28.174613   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:28.197828   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:28.197838   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:28.209189   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:28.209200   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:28.242854   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:28.242863   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:28.260455   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:28.260465   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:28.272618   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:28.272628   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:28.284691   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:28.284701   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:28.302361   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:28.302371   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:28.315416   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:28.315427   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:30.821978   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:35.824559   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:35.824993   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:35.865376   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:35.865530   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:35.888034   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:35.888162   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:35.905980   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:35.906064   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:35.918501   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:35.918587   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:35.930236   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:35.930319   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:35.941468   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:35.941550   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:35.952428   13885 logs.go:282] 0 containers: []
	W1028 05:38:35.952441   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:35.952507   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:35.963799   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:35.963815   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:35.963820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:35.978394   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:35.978409   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:35.993621   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:35.993632   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:36.011800   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:36.011810   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:36.023997   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:36.024008   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:36.047701   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:36.047714   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:36.081974   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:36.081982   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:36.087853   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:36.087862   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:36.125853   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:36.125865   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:36.140183   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:36.140196   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:36.156419   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:36.156430   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:36.169363   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:36.169374   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:36.182536   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:36.182547   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:38.697033   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:43.698825   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:43.699048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:43.717844   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:43.717940   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:43.731175   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:43.731254   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:43.746518   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:43.746585   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:43.757043   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:43.757118   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:43.767864   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:43.767946   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:43.778446   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:43.778519   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:43.794593   13885 logs.go:282] 0 containers: []
	W1028 05:38:43.794606   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:43.794675   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:43.810148   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:43.810166   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:43.810171   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:43.826597   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:43.826608   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:43.838732   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:43.838743   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:43.853887   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:43.853898   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:43.871376   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:43.871386   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:43.882908   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:43.882920   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:43.895702   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:43.895712   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:43.930982   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:43.930991   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:43.935420   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:43.935426   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:43.947631   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:43.947641   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:43.959282   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:43.959292   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:43.984412   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:43.984420   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:44.021522   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:44.021535   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:46.538637   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:51.540868   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:51.541038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:51.559780   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:51.559887   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:51.575572   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:51.575655   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:51.587916   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:51.587997   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:51.599091   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:51.599163   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:51.609541   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:51.609616   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:51.620165   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:51.620233   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:51.630071   13885 logs.go:282] 0 containers: []
	W1028 05:38:51.630084   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:51.630153   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:51.640292   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:51.640306   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:51.640311   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:51.675746   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:51.675756   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:51.712132   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:51.712146   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:51.727011   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:51.727023   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:51.738799   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:51.738812   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:51.753675   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:51.753687   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:51.765531   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:51.765541   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:51.782429   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:51.782441   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:51.794525   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:51.794534   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:51.798965   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:51.798975   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:51.813334   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:51.813347   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:51.824592   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:51.824603   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:51.849739   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:51.849747   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:54.363469   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:59.365829   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:59.365910   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:59.378729   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:59.378807   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:59.389165   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:59.389245   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:59.399752   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:59.399828   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:59.416544   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:59.416627   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:59.427184   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:59.427258   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:59.437907   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:59.437982   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:59.447799   13885 logs.go:282] 0 containers: []
	W1028 05:38:59.447812   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:59.447874   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:59.458902   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:59.458917   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:59.458922   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:59.463293   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:59.463302   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:59.477701   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:59.477713   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:59.491449   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:59.491460   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:59.505788   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:59.505800   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:59.522404   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:59.522414   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:59.546900   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:59.546915   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:59.580761   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:59.580769   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:59.592418   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:59.592428   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:59.606352   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:59.606367   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:59.618369   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:59.618382   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:59.630205   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:59.630219   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:59.641368   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:59.641376   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:02.177285   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:07.178297   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:07.178468   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:07.196117   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:07.196227   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:07.210238   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:07.210335   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:07.222616   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:07.222698   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:07.235821   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:07.235894   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:07.246952   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:07.247030   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:07.257188   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:07.257263   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:07.267887   13885 logs.go:282] 0 containers: []
	W1028 05:39:07.267899   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:07.267963   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:07.278407   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:07.278423   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:07.278429   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:07.290442   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:07.290456   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:07.302286   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:07.302312   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:07.337654   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:07.337662   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:07.342176   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:07.342182   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:07.378084   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:07.378093   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:07.393074   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:07.393087   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:07.409916   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:07.409927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:07.421599   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:07.421611   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:07.445726   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:07.445738   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:07.459923   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:07.459933   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:07.472056   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:07.472068   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:07.488228   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:07.488239   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:07.499900   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:07.499911   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:07.511761   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:07.511772   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:10.026472   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:15.028894   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:15.029098   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:15.042955   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:15.043048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:15.053690   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:15.053759   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:15.064775   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:15.064859   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:15.075343   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:15.075427   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:15.085960   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:15.086036   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:15.097344   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:15.097423   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:15.107318   13885 logs.go:282] 0 containers: []
	W1028 05:39:15.107331   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:15.107395   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:15.117732   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:15.117754   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:15.117760   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:15.132515   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:15.132525   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:15.145059   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:15.145070   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:15.156746   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:15.156755   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:15.192091   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:15.192100   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:15.197025   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:15.197034   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:15.211311   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:15.211324   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:15.224071   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:15.224080   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:15.235556   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:15.235566   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:15.253309   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:15.253320   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:15.278386   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:15.278403   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:15.290198   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:15.290213   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:15.310757   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:15.310773   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:15.347033   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:15.347044   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:15.360846   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:15.360858   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:17.874441   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:22.877035   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:22.877257   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:22.898694   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:22.898819   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:22.916789   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:22.916870   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:22.934925   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:22.935007   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:22.946620   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:22.946689   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:22.962683   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:22.962764   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:22.972936   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:22.973012   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:22.982774   13885 logs.go:282] 0 containers: []
	W1028 05:39:22.982786   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:22.982850   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:22.998203   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:22.998225   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:22.998230   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:23.032345   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:23.032354   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:23.047126   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:23.047136   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:23.064671   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:23.064681   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:23.069575   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:23.069584   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:23.084523   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:23.084537   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:23.098823   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:23.098834   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:23.110811   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:23.110826   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:23.126982   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:23.126996   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:23.138571   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:23.138586   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:23.150335   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:23.150343   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:23.161921   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:23.161932   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:23.185706   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:23.185716   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:23.219924   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:23.219936   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:23.231746   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:23.231757   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:25.744228   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:30.746541   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:30.746762   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:30.762479   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:30.762575   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:30.780496   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:30.780579   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:30.791656   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:30.791737   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:30.801642   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:30.801718   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:30.811783   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:30.811854   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:30.822219   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:30.822302   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:30.832558   13885 logs.go:282] 0 containers: []
	W1028 05:39:30.832570   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:30.832625   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:30.842506   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:30.842533   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:30.842539   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:30.858728   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:30.858742   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:30.874391   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:30.874401   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:30.891334   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:30.891346   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:30.904895   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:30.904907   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:30.916881   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:30.916892   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:30.943601   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:30.943613   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:30.955326   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:30.955338   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:30.971198   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:30.971210   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:31.007902   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:31.007915   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:31.012660   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:31.012668   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:31.048584   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:31.048598   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:31.062305   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:31.062315   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:31.077571   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:31.077581   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:31.090195   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:31.090205   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:33.604346   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:38.606543   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:38.606668   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:38.617946   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:38.618031   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:38.628719   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:38.628797   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:38.639420   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:38.639504   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:38.653610   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:38.653686   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:38.664056   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:38.664131   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:38.674547   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:38.674642   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:38.684763   13885 logs.go:282] 0 containers: []
	W1028 05:39:38.684773   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:38.684830   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:38.695296   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:38.695314   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:38.695320   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:38.699847   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:38.699856   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:38.715661   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:38.715673   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:38.729842   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:38.729854   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:38.741421   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:38.741434   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:38.753099   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:38.753115   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:38.769967   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:38.769977   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:38.781300   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:38.781314   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:38.816214   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:38.816223   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:38.831497   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:38.831507   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:38.842925   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:38.842935   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:38.854691   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:38.854701   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:38.889604   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:38.889618   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:38.901282   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:38.901293   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:38.919021   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:38.919031   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:41.445089   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:46.446589   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:46.447107   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:46.500779   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:46.500924   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:46.523312   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:46.523402   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:46.536621   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:46.536709   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:46.547940   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:46.548021   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:46.558638   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:46.558715   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:46.569437   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:46.569520   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:46.580706   13885 logs.go:282] 0 containers: []
	W1028 05:39:46.580721   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:46.580790   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:46.591928   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:46.591947   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:46.591952   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:46.608376   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:46.608387   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:46.643124   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:46.643133   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:46.655046   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:46.655055   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:46.670713   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:46.670723   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:46.706473   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:46.706483   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:46.721452   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:46.721462   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:46.733495   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:46.733507   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:46.745243   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:46.745253   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:46.757453   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:46.757465   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:46.776241   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:46.776255   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:46.790332   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:46.790342   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:46.801850   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:46.801865   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:46.827656   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:46.827667   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:46.832160   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:46.832167   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:49.348976   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:54.351374   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:54.351662   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:54.372799   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:54.372910   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:54.387713   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:54.387803   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:54.400134   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:54.400226   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:54.411259   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:54.411334   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:54.421440   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:54.421524   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:54.432138   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:54.432218   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:54.442701   13885 logs.go:282] 0 containers: []
	W1028 05:39:54.442712   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:54.442778   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:54.453073   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:54.453092   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:54.453098   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:54.457977   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:54.457983   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:54.475259   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:54.475271   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:54.490532   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:54.490547   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:54.502085   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:54.502098   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:54.516387   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:54.516398   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:54.529309   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:54.529319   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:54.541421   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:54.541434   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:54.553493   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:54.553504   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:54.564874   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:54.564885   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:54.598907   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:54.598914   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:54.634210   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:54.634220   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:54.646052   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:54.646063   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:54.661073   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:54.661083   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:54.678131   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:54.678141   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:57.203879   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:02.206234   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:02.206456   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:02.223501   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:02.223601   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:02.236876   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:02.236953   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:02.248202   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:02.248280   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:02.260165   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:02.260239   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:02.270718   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:02.270789   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:02.287098   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:02.287177   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:02.296796   13885 logs.go:282] 0 containers: []
	W1028 05:40:02.296810   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:02.296874   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:02.307082   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:02.307116   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:02.307122   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:02.318888   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:02.318898   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:02.336019   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:02.336029   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:02.347714   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:02.347729   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:02.381870   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:02.381884   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:02.386486   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:02.386493   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:02.400810   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:02.400820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:02.412862   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:02.412873   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:02.424635   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:02.424645   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:02.459695   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:02.459710   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:02.474994   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:02.475005   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:02.486744   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:02.486755   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:02.498759   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:02.498774   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:02.512576   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:02.512585   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:02.535718   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:02.535727   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:05.063122   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:10.065620   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:10.065786   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:10.078684   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:10.078779   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:10.091139   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:10.091220   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:10.101867   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:10.101947   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:10.111918   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:10.111989   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:10.122862   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:10.122940   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:10.133340   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:10.133414   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:10.143786   13885 logs.go:282] 0 containers: []
	W1028 05:40:10.143802   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:10.143867   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:10.154036   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:10.154053   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:10.154059   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:10.165862   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:10.165875   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:10.183729   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:10.183739   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:10.188251   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:10.188257   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:10.199685   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:10.199697   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:10.211671   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:10.211682   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:10.223573   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:10.223583   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:10.259389   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:10.259399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:10.273618   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:10.273632   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:10.285472   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:10.285483   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:10.297279   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:10.297288   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:10.309119   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:10.309130   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:10.324341   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:10.324351   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:10.349755   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:10.349763   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:10.383467   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:10.383480   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:12.900435   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:17.902778   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:17.902909   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:17.917601   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:17.917685   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:17.930445   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:17.930532   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:17.941739   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:17.941830   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:17.954285   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:17.954374   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:17.966878   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:17.966954   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:17.978174   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:17.978257   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:17.988801   13885 logs.go:282] 0 containers: []
	W1028 05:40:17.988835   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:17.988904   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:18.001470   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:18.001489   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:18.001495   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:18.014973   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:18.014985   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:18.052915   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:18.052927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:18.074873   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:18.074886   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:18.089591   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:18.089605   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:18.104573   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:18.104585   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:18.120475   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:18.120487   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:18.144187   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:18.144201   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:18.162882   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:18.162899   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:18.176786   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:18.176801   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:18.213548   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:18.213575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:18.227091   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:18.227102   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:18.240214   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:18.240229   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:18.245949   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:18.245964   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:18.261770   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:18.261783   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:20.788599   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:25.790958   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:25.791087   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:25.802434   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:25.802518   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:25.813409   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:25.813498   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:25.824349   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:25.824430   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:25.842636   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:25.842716   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:25.855756   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:25.855834   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:25.866218   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:25.866290   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:25.876289   13885 logs.go:282] 0 containers: []
	W1028 05:40:25.876303   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:25.876376   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:25.890885   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:25.890904   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:25.890909   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:25.928809   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:25.928820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:25.944823   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:25.944833   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:25.956552   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:25.956562   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:25.975712   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:25.975721   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:25.991168   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:25.991180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:26.004310   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:26.004321   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:26.038802   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:26.038812   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:26.043089   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:26.043096   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:26.067077   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:26.067089   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:26.080023   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:26.080036   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:26.094531   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:26.094541   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:26.106274   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:26.106286   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:26.118048   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:26.118061   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:26.129985   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:26.129997   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:28.649793   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:33.652109   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:33.652256   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:33.663474   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:33.663552   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:33.673966   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:33.674046   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:33.684911   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:33.684988   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:33.696092   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:33.696164   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:33.706426   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:33.706497   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:33.716540   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:33.716620   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:33.727093   13885 logs.go:282] 0 containers: []
	W1028 05:40:33.727105   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:33.727174   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:33.740779   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:33.740796   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:33.740804   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:33.777299   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:33.777313   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:33.791151   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:33.791166   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:33.803053   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:33.803065   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:33.807297   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:33.807304   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:33.819215   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:33.819228   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:33.831166   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:33.831179   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:33.851140   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:33.851154   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:33.862666   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:33.862675   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:33.898456   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:33.898467   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:33.912507   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:33.912518   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:33.926526   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:33.926540   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:33.942593   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:33.942605   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:33.955062   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:33.955074   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:33.966943   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:33.966954   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:36.494384   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:41.496626   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:41.496849   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:41.510760   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:41.510848   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:41.521590   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:41.521664   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:41.538790   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:41.538877   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:41.549255   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:41.549329   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:41.559020   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:41.559095   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:41.569881   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:41.569953   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:41.580384   13885 logs.go:282] 0 containers: []
	W1028 05:40:41.580397   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:41.580458   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:41.591467   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:41.591485   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:41.591490   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:41.627252   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:41.627263   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:41.641956   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:41.641967   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:41.656214   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:41.656225   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:41.668745   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:41.668754   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:41.680171   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:41.680181   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:41.691767   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:41.691776   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:41.703461   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:41.703474   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:41.715046   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:41.715057   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:41.719611   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:41.719619   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:41.753735   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:41.753746   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:41.771628   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:41.771638   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:41.783520   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:41.783530   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:41.798237   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:41.798247   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:41.822919   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:41.822929   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:44.338668   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:49.339611   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:49.344490   13885 out.go:201] 
	W1028 05:40:49.349421   13885 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W1028 05:40:49.349426   13885 out.go:270] * 
	* 
	W1028 05:40:49.349901   13885 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:40:49.365431   13885 out.go:201] 

                                                
                                                
** /stderr **
version_upgrade_test.go:132: upgrade from v1.26.0 to HEAD failed: out/minikube-darwin-arm64 start -p running-upgrade-343000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
panic.go:629: *** TestRunningBinaryUpgrade FAILED at 2024-10-28 05:40:49.449714 -0700 PDT m=+1233.726338959
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-343000 -n running-upgrade-343000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-343000 -n running-upgrade-343000: exit status 2 (15.767737792s)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestRunningBinaryUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestRunningBinaryUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p running-upgrade-343000 logs -n 25
helpers_test.go:252: TestRunningBinaryUpgrade logs: 
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                  |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| start   | -p force-systemd-flag-548000          | force-systemd-flag-548000 | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | --memory=2048 --force-systemd         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-120000              | force-systemd-env-120000  | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | ssh docker info --format              |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                     |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-120000           | force-systemd-env-120000  | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT | 28 Oct 24 05:31 PDT |
	| start   | -p docker-flags-510000                | docker-flags-510000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | --cache-images=false                  |                           |         |         |                     |                     |
	|         | --memory=2048                         |                           |         |         |                     |                     |
	|         | --install-addons=false                |                           |         |         |                     |                     |
	|         | --wait=false                          |                           |         |         |                     |                     |
	|         | --docker-env=FOO=BAR                  |                           |         |         |                     |                     |
	|         | --docker-env=BAZ=BAT                  |                           |         |         |                     |                     |
	|         | --docker-opt=debug                    |                           |         |         |                     |                     |
	|         | --docker-opt=icc=true                 |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-548000             | force-systemd-flag-548000 | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | ssh docker info --format              |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                     |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-548000          | force-systemd-flag-548000 | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT | 28 Oct 24 05:31 PDT |
	| start   | -p cert-expiration-656000             | cert-expiration-656000    | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | --memory=2048                         |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                  |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| ssh     | docker-flags-510000 ssh               | docker-flags-510000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | sudo systemctl show docker            |                           |         |         |                     |                     |
	|         | --property=Environment                |                           |         |         |                     |                     |
	|         | --no-pager                            |                           |         |         |                     |                     |
	| ssh     | docker-flags-510000 ssh               | docker-flags-510000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | sudo systemctl show docker            |                           |         |         |                     |                     |
	|         | --property=ExecStart                  |                           |         |         |                     |                     |
	|         | --no-pager                            |                           |         |         |                     |                     |
	| delete  | -p docker-flags-510000                | docker-flags-510000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT | 28 Oct 24 05:31 PDT |
	| start   | -p cert-options-127000                | cert-options-127000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | --memory=2048                         |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1             |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15         |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost           |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com      |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                 |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| ssh     | cert-options-127000 ssh               | cert-options-127000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | openssl x509 -text -noout -in         |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt |                           |         |         |                     |                     |
	| ssh     | -p cert-options-127000 -- sudo        | cert-options-127000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT |                     |
	|         | cat /etc/kubernetes/admin.conf        |                           |         |         |                     |                     |
	| delete  | -p cert-options-127000                | cert-options-127000       | jenkins | v1.34.0 | 28 Oct 24 05:31 PDT | 28 Oct 24 05:31 PDT |
	| start   | -p running-upgrade-343000             | minikube                  | jenkins | v1.26.0 | 28 Oct 24 05:31 PDT | 28 Oct 24 05:32 PDT |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --vm-driver=qemu2                     |                           |         |         |                     |                     |
	| start   | -p running-upgrade-343000             | running-upgrade-343000    | jenkins | v1.34.0 | 28 Oct 24 05:32 PDT |                     |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| start   | -p cert-expiration-656000             | cert-expiration-656000    | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT |                     |
	|         | --memory=2048                         |                           |         |         |                     |                     |
	|         | --cert-expiration=8760h               |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| delete  | -p cert-expiration-656000             | cert-expiration-656000    | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT | 28 Oct 24 05:34 PDT |
	| start   | -p kubernetes-upgrade-386000          | kubernetes-upgrade-386000 | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT |                     |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0          |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-386000          | kubernetes-upgrade-386000 | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT | 28 Oct 24 05:34 PDT |
	| start   | -p kubernetes-upgrade-386000          | kubernetes-upgrade-386000 | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT |                     |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2          |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-386000          | kubernetes-upgrade-386000 | jenkins | v1.34.0 | 28 Oct 24 05:34 PDT | 28 Oct 24 05:34 PDT |
	| start   | -p stopped-upgrade-871000             | minikube                  | jenkins | v1.26.0 | 28 Oct 24 05:34 PDT | 28 Oct 24 05:35 PDT |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --vm-driver=qemu2                     |                           |         |         |                     |                     |
	| stop    | stopped-upgrade-871000 stop           | minikube                  | jenkins | v1.26.0 | 28 Oct 24 05:35 PDT | 28 Oct 24 05:35 PDT |
	| start   | -p stopped-upgrade-871000             | stopped-upgrade-871000    | jenkins | v1.34.0 | 28 Oct 24 05:35 PDT |                     |
	|         | --memory=2200                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                |                           |         |         |                     |                     |
	|         | --driver=qemu2                        |                           |         |         |                     |                     |
	|---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 05:35:43
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.23.2 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 05:35:43.332785   14044 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:35:43.332991   14044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:35:43.332995   14044 out.go:358] Setting ErrFile to fd 2...
	I1028 05:35:43.332998   14044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:35:43.333143   14044 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:35:43.334495   14044 out.go:352] Setting JSON to false
	I1028 05:35:43.354665   14044 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7514,"bootTime":1730111429,"procs":524,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:35:43.354736   14044 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:35:43.358322   14044 out.go:177] * [stopped-upgrade-871000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:35:43.365351   14044 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:35:43.365427   14044 notify.go:220] Checking for updates...
	I1028 05:35:43.372338   14044 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:35:43.375418   14044 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:35:43.379358   14044 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:35:43.382412   14044 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:35:43.385448   14044 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:35:43.388655   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:35:43.392347   14044 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	I1028 05:35:43.395441   14044 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:35:43.398352   14044 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:35:43.405484   14044 start.go:297] selected driver: qemu2
	I1028 05:35:43.405496   14044 start.go:901] validating driver "qemu2" against &{Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgra
de-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:35:43.405553   14044 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:35:43.408183   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:35:43.408212   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:35:43.408243   14044 start.go:340] cluster config:
	{Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:35:43.408294   14044 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:35:43.417378   14044 out.go:177] * Starting "stopped-upgrade-871000" primary control-plane node in "stopped-upgrade-871000" cluster
	I1028 05:35:43.420242   14044 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:35:43.420259   14044 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I1028 05:35:43.420266   14044 cache.go:56] Caching tarball of preloaded images
	I1028 05:35:43.420328   14044 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:35:43.420334   14044 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I1028 05:35:43.420386   14044 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/config.json ...
	I1028 05:35:43.420844   14044 start.go:360] acquireMachinesLock for stopped-upgrade-871000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:35:43.420877   14044 start.go:364] duration metric: took 25.667µs to acquireMachinesLock for "stopped-upgrade-871000"
	I1028 05:35:43.420885   14044 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:35:43.420890   14044 fix.go:54] fixHost starting: 
	I1028 05:35:43.420997   14044 fix.go:112] recreateIfNeeded on stopped-upgrade-871000: state=Stopped err=<nil>
	W1028 05:35:43.421004   14044 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:35:43.424449   14044 out.go:177] * Restarting existing qemu2 VM for "stopped-upgrade-871000" ...
	I1028 05:35:45.912896   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:45.913691   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:45.953563   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:45.953737   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:45.976133   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:45.976267   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:45.991172   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:45.991265   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:46.003652   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:46.003738   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:46.014917   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:46.014997   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:46.025697   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:46.025773   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:46.035973   13885 logs.go:282] 0 containers: []
	W1028 05:35:46.035985   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:46.036048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:46.046884   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:46.046902   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:46.046907   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:46.051246   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:46.051255   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:46.065087   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:46.065098   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:46.079637   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:46.079650   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:46.098954   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:46.098967   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:46.114513   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:46.114524   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:46.152892   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:46.152899   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:46.169199   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:46.169211   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:46.184822   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:46.184832   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:46.209085   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:46.209093   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:46.221103   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:46.221116   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:46.244160   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:46.244172   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:46.255894   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:46.255905   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:46.297130   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:46.297143   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:46.311049   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:46.311058   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:46.327747   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:46.327759   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:46.338805   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:46.338814   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:43.432327   14044 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:35:43.432403   14044 main.go:141] libmachine: executing: qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/9.1.1/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/qemu.pid -nic user,model=virtio,hostfwd=tcp::59232-:22,hostfwd=tcp::59233-:2376,hostname=stopped-upgrade-871000 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/disk.qcow2
	I1028 05:35:43.478524   14044 main.go:141] libmachine: STDOUT: 
	I1028 05:35:43.478568   14044 main.go:141] libmachine: STDERR: 
	I1028 05:35:43.478575   14044 main.go:141] libmachine: Waiting for VM to start (ssh -p 59232 docker@127.0.0.1)...
	I1028 05:35:48.853031   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:35:53.855391   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:35:53.855529   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:35:53.868174   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:35:53.868255   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:35:53.883509   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:35:53.883593   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:35:53.900204   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:35:53.900288   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:35:53.912379   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:35:53.912460   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:35:53.924598   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:35:53.924682   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:35:53.941830   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:35:53.941911   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:35:53.954421   13885 logs.go:282] 0 containers: []
	W1028 05:35:53.954434   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:35:53.954507   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:35:53.966190   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:35:53.966214   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:35:53.966219   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:35:53.982031   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:35:53.982044   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:35:53.995095   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:35:53.995106   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:35:53.999819   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:35:53.999829   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:35:54.044300   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:35:54.044323   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:35:54.068101   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:35:54.068119   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:35:54.085400   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:35:54.085415   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:35:54.105940   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:35:54.105953   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:35:54.149146   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:35:54.149167   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:35:54.163388   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:35:54.163399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:35:54.178333   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:35:54.178344   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:35:54.190198   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:35:54.190210   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:35:54.211585   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:35:54.211598   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:35:54.235258   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:35:54.235271   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:35:54.247126   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:35:54.247136   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:35:54.259070   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:35:54.259080   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:35:54.277535   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:35:54.277545   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:35:56.791830   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:01.794657   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:01.795252   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:01.848402   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:01.848563   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:01.867323   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:01.867426   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:01.880993   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:01.881088   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:01.892403   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:01.892484   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:01.903526   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:01.903605   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:01.914345   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:01.914420   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:01.924693   13885 logs.go:282] 0 containers: []
	W1028 05:36:01.924704   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:01.924766   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:01.935145   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:01.935175   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:01.935180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:01.956389   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:01.956399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:01.968455   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:01.968468   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:01.981362   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:01.981377   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:02.028498   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:02.028517   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:02.043616   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:02.043627   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:02.056457   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:02.056468   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:02.093100   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:02.093115   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:02.108832   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:02.108845   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:02.125721   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:02.125731   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:02.144099   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:02.144109   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:02.167810   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:02.167820   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:02.179284   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:02.179298   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:02.183539   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:02.183545   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:02.199801   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:02.199813   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:02.215793   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:02.215807   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:02.234145   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:02.234156   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:02.963563   14044 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/config.json ...
	I1028 05:36:02.964105   14044 machine.go:93] provisionDockerMachine start ...
	I1028 05:36:02.964223   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:02.964547   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:02.964557   14044 main.go:141] libmachine: About to run SSH command:
	hostname
	I1028 05:36:03.036927   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
	
	I1028 05:36:03.036944   14044 buildroot.go:166] provisioning hostname "stopped-upgrade-871000"
	I1028 05:36:03.037024   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.037137   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.037143   14044 main.go:141] libmachine: About to run SSH command:
	sudo hostname stopped-upgrade-871000 && echo "stopped-upgrade-871000" | sudo tee /etc/hostname
	I1028 05:36:03.101120   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-871000
	
	I1028 05:36:03.101194   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.101309   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.101317   14044 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sstopped-upgrade-871000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-871000/g' /etc/hosts;
				else 
					echo '127.0.1.1 stopped-upgrade-871000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1028 05:36:03.163111   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 05:36:03.163123   14044 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19865-11397/.minikube CaCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19865-11397/.minikube}
	I1028 05:36:03.163129   14044 buildroot.go:174] setting up certificates
	I1028 05:36:03.163134   14044 provision.go:84] configureAuth start
	I1028 05:36:03.163140   14044 provision.go:143] copyHostCerts
	I1028 05:36:03.163216   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem, removing ...
	I1028 05:36:03.163222   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem
	I1028 05:36:03.163474   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem (1123 bytes)
	I1028 05:36:03.164389   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem, removing ...
	I1028 05:36:03.164395   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem
	I1028 05:36:03.164462   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem (1679 bytes)
	I1028 05:36:03.164595   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem, removing ...
	I1028 05:36:03.164599   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem
	I1028 05:36:03.164655   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem (1078 bytes)
	I1028 05:36:03.164746   14044 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-871000 san=[127.0.0.1 localhost minikube stopped-upgrade-871000]
	I1028 05:36:03.345080   14044 provision.go:177] copyRemoteCerts
	I1028 05:36:03.345138   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1028 05:36:03.345148   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.378487   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I1028 05:36:03.385141   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I1028 05:36:03.391875   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I1028 05:36:03.399136   14044 provision.go:87] duration metric: took 235.993917ms to configureAuth
	I1028 05:36:03.399146   14044 buildroot.go:189] setting minikube options for container-runtime
	I1028 05:36:03.399250   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:36:03.399300   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.399412   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.399417   14044 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1028 05:36:03.461135   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I1028 05:36:03.461144   14044 buildroot.go:70] root file system type: tmpfs
	I1028 05:36:03.461197   14044 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I1028 05:36:03.461257   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.461365   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.461400   14044 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1028 05:36:03.526494   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1028 05:36:03.526570   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.526686   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.526695   14044 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1028 05:36:03.877398   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
	
	I1028 05:36:03.877413   14044 machine.go:96] duration metric: took 913.297042ms to provisionDockerMachine
	I1028 05:36:03.877419   14044 start.go:293] postStartSetup for "stopped-upgrade-871000" (driver="qemu2")
	I1028 05:36:03.877426   14044 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1028 05:36:03.877494   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1028 05:36:03.877504   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.907751   14044 ssh_runner.go:195] Run: cat /etc/os-release
	I1028 05:36:03.909147   14044 info.go:137] Remote host: Buildroot 2021.02.12
	I1028 05:36:03.909158   14044 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/addons for local assets ...
	I1028 05:36:03.909258   14044 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/files for local assets ...
	I1028 05:36:03.909407   14044 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem -> 119092.pem in /etc/ssl/certs
	I1028 05:36:03.909575   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1028 05:36:03.911968   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:36:03.919367   14044 start.go:296] duration metric: took 41.94275ms for postStartSetup
	I1028 05:36:03.919379   14044 fix.go:56] duration metric: took 20.498448291s for fixHost
	I1028 05:36:03.919416   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.919524   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.919531   14044 main.go:141] libmachine: About to run SSH command:
	date +%s.%N
	I1028 05:36:03.980366   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730118963.647835087
	
	I1028 05:36:03.980375   14044 fix.go:216] guest clock: 1730118963.647835087
	I1028 05:36:03.980379   14044 fix.go:229] Guest: 2024-10-28 05:36:03.647835087 -0700 PDT Remote: 2024-10-28 05:36:03.919381 -0700 PDT m=+20.621373876 (delta=-271.545913ms)
	I1028 05:36:03.980391   14044 fix.go:200] guest clock delta is within tolerance: -271.545913ms
	I1028 05:36:03.980395   14044 start.go:83] releasing machines lock for "stopped-upgrade-871000", held for 20.559470459s
	I1028 05:36:03.980485   14044 ssh_runner.go:195] Run: cat /version.json
	I1028 05:36:03.980495   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.981175   14044 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1028 05:36:03.981198   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	W1028 05:36:04.013321   14044 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I1028 05:36:04.013379   14044 ssh_runner.go:195] Run: systemctl --version
	I1028 05:36:04.055659   14044 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W1028 05:36:04.057468   14044 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I1028 05:36:04.057512   14044 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I1028 05:36:04.060459   14044 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I1028 05:36:04.065467   14044 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1028 05:36:04.065476   14044 start.go:495] detecting cgroup driver to use...
	I1028 05:36:04.065562   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:36:04.072416   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I1028 05:36:04.075714   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1028 05:36:04.079265   14044 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1028 05:36:04.079297   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1028 05:36:04.082580   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:36:04.085685   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1028 05:36:04.088599   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:36:04.091721   14044 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1028 05:36:04.095467   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1028 05:36:04.098823   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I1028 05:36:04.102234   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I1028 05:36:04.105148   14044 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1028 05:36:04.107861   14044 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1028 05:36:04.111014   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:04.194609   14044 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1028 05:36:04.201868   14044 start.go:495] detecting cgroup driver to use...
	I1028 05:36:04.201957   14044 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1028 05:36:04.207568   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:36:04.212703   14044 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I1028 05:36:04.226346   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:36:04.231274   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 05:36:04.236087   14044 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I1028 05:36:04.266268   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 05:36:04.270936   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:36:04.276864   14044 ssh_runner.go:195] Run: which cri-dockerd
	I1028 05:36:04.278187   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1028 05:36:04.280633   14044 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1028 05:36:04.285488   14044 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1028 05:36:04.363698   14044 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1028 05:36:04.434357   14044 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I1028 05:36:04.434419   14044 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1028 05:36:04.439802   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:04.511765   14044 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:36:05.652863   14044 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.141077166s)
	I1028 05:36:05.652936   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I1028 05:36:05.657424   14044 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
	I1028 05:36:05.663772   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:36:05.668719   14044 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1028 05:36:05.740495   14044 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1028 05:36:05.827606   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:05.907993   14044 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1028 05:36:05.914104   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:36:05.918345   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:05.995111   14044 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I1028 05:36:06.035013   14044 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1028 05:36:06.035108   14044 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1028 05:36:06.038530   14044 start.go:563] Will wait 60s for crictl version
	I1028 05:36:06.038585   14044 ssh_runner.go:195] Run: which crictl
	I1028 05:36:06.040030   14044 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1028 05:36:06.055548   14044 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I1028 05:36:06.055621   14044 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:36:06.072991   14044 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:36:04.747764   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:06.096022   14044 out.go:235] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I1028 05:36:06.096282   14044 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I1028 05:36:06.097554   14044 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "10.0.2.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 05:36:06.101082   14044 kubeadm.go:883] updating cluster {Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I1028 05:36:06.101150   14044 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:36:06.101202   14044 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:36:06.111563   14044 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:36:06.111577   14044 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:36:06.111638   14044 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:36:06.115339   14044 ssh_runner.go:195] Run: which lz4
	I1028 05:36:06.116638   14044 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I1028 05:36:06.117875   14044 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1028 05:36:06.117887   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I1028 05:36:07.102203   14044 docker.go:653] duration metric: took 985.603541ms to copy over tarball
	I1028 05:36:07.102284   14044 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I1028 05:36:08.280035   14044 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.177734792s)
	I1028 05:36:08.280050   14044 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1028 05:36:08.296025   14044 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:36:08.299319   14044 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I1028 05:36:08.304590   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:09.750013   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:09.750120   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:09.761449   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:09.761536   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:09.774103   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:09.774175   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:09.784860   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:09.784950   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:09.795703   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:09.795792   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:09.806781   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:09.806853   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:09.818707   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:09.818780   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:09.829843   13885 logs.go:282] 0 containers: []
	W1028 05:36:09.829858   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:09.829930   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:09.844913   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:09.844934   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:09.844940   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:09.856807   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:09.856821   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:09.882408   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:09.882426   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:09.921349   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:09.921361   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:09.936542   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:09.936556   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:09.949394   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:09.949406   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:09.963804   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:09.963816   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:09.993124   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:09.993145   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:10.007853   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:10.007864   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:10.021546   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:10.021558   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:10.034094   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:10.034106   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:10.074349   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:10.074369   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:10.079727   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:10.079739   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:10.096478   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:10.096491   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:10.117778   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:10.117790   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:10.132836   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:10.132847   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:10.148276   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:10.148294   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:12.668874   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:08.387727   14044 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:36:09.954024   14044 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.566269083s)
	I1028 05:36:09.954232   14044 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:36:09.967182   14044 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:36:09.967190   14044 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:36:09.967194   14044 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I1028 05:36:09.971682   14044 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:09.973517   14044 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:09.975805   14044 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:09.975869   14044 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:09.978016   14044 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:09.978212   14044 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:09.979427   14044 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:09.979441   14044 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:09.981347   14044 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:09.981552   14044 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:09.982117   14044 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:09.983183   14044 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I1028 05:36:09.984104   14044 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:09.984312   14044 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:09.986389   14044 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:09.986505   14044 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1028 05:36:10.530007   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.542373   14044 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I1028 05:36:10.542407   14044 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.542491   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.553123   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.561398   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I1028 05:36:10.566692   14044 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I1028 05:36:10.566726   14044 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.566797   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.577443   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I1028 05:36:10.583948   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.594899   14044 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I1028 05:36:10.594930   14044 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.595024   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.607788   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I1028 05:36:10.642873   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.653165   14044 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I1028 05:36:10.653185   14044 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.653245   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.663208   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I1028 05:36:10.716768   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.728624   14044 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I1028 05:36:10.728651   14044 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.728718   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.738673   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	W1028 05:36:10.767868   14044 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I1028 05:36:10.768055   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.783988   14044 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I1028 05:36:10.784009   14044 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.784070   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.793960   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I1028 05:36:10.794106   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:36:10.795787   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I1028 05:36:10.795798   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I1028 05:36:10.832040   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I1028 05:36:10.841286   14044 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:36:10.841300   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I1028 05:36:10.850397   14044 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I1028 05:36:10.850421   14044 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I1028 05:36:10.850483   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I1028 05:36:10.881772   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I1028 05:36:10.881793   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I1028 05:36:10.881938   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I1028 05:36:10.883324   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I1028 05:36:10.883338   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I1028 05:36:10.890635   14044 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I1028 05:36:10.890644   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	I1028 05:36:10.918250   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	W1028 05:36:10.999413   14044 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1028 05:36:10.999589   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.013088   14044 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I1028 05:36:11.013113   14044 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.013184   14044 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.028489   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1028 05:36:11.028620   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:36:11.030095   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I1028 05:36:11.030123   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
	I1028 05:36:11.064696   14044 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:36:11.064720   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
	I1028 05:36:11.303706   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I1028 05:36:11.303746   14044 cache_images.go:92] duration metric: took 1.336543s to LoadCachedImages
	W1028 05:36:11.303799   14044 out.go:270] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	I1028 05:36:11.303812   14044 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I1028 05:36:11.303876   14044 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=stopped-upgrade-871000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I1028 05:36:11.303949   14044 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1028 05:36:11.318896   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:36:11.318913   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:36:11.318920   14044 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I1028 05:36:11.318928   14044 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-871000 NodeName:stopped-upgrade-871000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1028 05:36:11.318988   14044 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "stopped-upgrade-871000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1028 05:36:11.319060   14044 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I1028 05:36:11.322557   14044 binaries.go:44] Found k8s binaries, skipping transfer
	I1028 05:36:11.322593   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1028 05:36:11.325285   14044 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I1028 05:36:11.330016   14044 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1028 05:36:11.335025   14044 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I1028 05:36:11.340515   14044 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I1028 05:36:11.341844   14044 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "10.0.2.15	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 05:36:11.345104   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:11.415611   14044 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:36:11.421152   14044 certs.go:68] Setting up /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000 for IP: 10.0.2.15
	I1028 05:36:11.421164   14044 certs.go:194] generating shared ca certs ...
	I1028 05:36:11.421173   14044 certs.go:226] acquiring lock for ca certs: {Name:mk98e4a9e20bbb7ca9edab1be452077f88dfe469 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.421350   14044 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key
	I1028 05:36:11.422115   14044 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key
	I1028 05:36:11.422128   14044 certs.go:256] generating profile certs ...
	I1028 05:36:11.422402   14044 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key
	I1028 05:36:11.422421   14044 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c
	I1028 05:36:11.422433   14044 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I1028 05:36:11.523083   14044 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c ...
	I1028 05:36:11.523100   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c: {Name:mkbbeae012350cf78dc275aaf7cb4a1e3fe56f25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.524415   14044 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c ...
	I1028 05:36:11.524422   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c: {Name:mk2a1db50910931c74bce4df59653784fccf808a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.524786   14044 certs.go:381] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt
	I1028 05:36:11.525098   14044 certs.go:385] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key
	I1028 05:36:11.525430   14044 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.key
	I1028 05:36:11.525604   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem (1338 bytes)
	W1028 05:36:11.525796   14044 certs.go:480] ignoring /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909_empty.pem, impossibly tiny 0 bytes
	I1028 05:36:11.525803   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem (1675 bytes)
	I1028 05:36:11.525823   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem (1078 bytes)
	I1028 05:36:11.525845   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem (1123 bytes)
	I1028 05:36:11.525863   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem (1679 bytes)
	I1028 05:36:11.525914   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:36:11.526294   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1028 05:36:11.533568   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I1028 05:36:11.540310   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1028 05:36:11.547423   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1028 05:36:11.554522   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I1028 05:36:11.561121   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I1028 05:36:11.567735   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1028 05:36:11.574872   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1028 05:36:11.581700   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1028 05:36:11.588172   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem --> /usr/share/ca-certificates/11909.pem (1338 bytes)
	I1028 05:36:11.595313   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /usr/share/ca-certificates/119092.pem (1708 bytes)
	I1028 05:36:11.602620   14044 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1028 05:36:11.608035   14044 ssh_runner.go:195] Run: openssl version
	I1028 05:36:11.609870   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11909.pem && ln -fs /usr/share/ca-certificates/11909.pem /etc/ssl/certs/11909.pem"
	I1028 05:36:11.612700   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.614090   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 12:21 /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.614124   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.615771   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11909.pem /etc/ssl/certs/51391683.0"
	I1028 05:36:11.619016   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/119092.pem && ln -fs /usr/share/ca-certificates/119092.pem /etc/ssl/certs/119092.pem"
	I1028 05:36:11.622246   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.623572   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 12:21 /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.623608   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.625370   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/119092.pem /etc/ssl/certs/3ec20f2e.0"
	I1028 05:36:11.628237   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1028 05:36:11.631654   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.633117   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:32 /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.633142   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.634772   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1028 05:36:11.637674   14044 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I1028 05:36:11.639129   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I1028 05:36:11.641322   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I1028 05:36:11.643125   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I1028 05:36:11.645177   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I1028 05:36:11.646876   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I1028 05:36:11.648538   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I1028 05:36:11.650471   14044 kubeadm.go:392] StartCluster: {Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:st
opped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:36:11.650543   14044 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:36:11.660799   14044 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1028 05:36:11.663915   14044 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I1028 05:36:11.663925   14044 kubeadm.go:593] restartPrimaryControlPlane start ...
	I1028 05:36:11.663956   14044 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I1028 05:36:11.666919   14044 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:36:11.667270   14044 kubeconfig.go:47] verify endpoint returned: get endpoint: "stopped-upgrade-871000" does not appear in /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:36:11.667371   14044 kubeconfig.go:62] /Users/jenkins/minikube-integration/19865-11397/kubeconfig needs updating (will repair): [kubeconfig missing "stopped-upgrade-871000" cluster setting kubeconfig missing "stopped-upgrade-871000" context setting]
	I1028 05:36:11.667576   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.668033   14044 kapi.go:59] client config for stopped-upgrade-871000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1021ae680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:36:11.668548   14044 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I1028 05:36:11.671637   14044 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "stopped-upgrade-871000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I1028 05:36:11.671642   14044 kubeadm.go:1160] stopping kube-system containers ...
	I1028 05:36:11.671691   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:36:11.682701   14044 docker.go:483] Stopping containers: [1d246d72453f 0c37d3667d75 b44a7e22a03f 4cb3d4018f36 75a05b976c8a e4b0e641290b 7426bdc7b812 5274b9f0fa1c]
	I1028 05:36:11.682782   14044 ssh_runner.go:195] Run: docker stop 1d246d72453f 0c37d3667d75 b44a7e22a03f 4cb3d4018f36 75a05b976c8a e4b0e641290b 7426bdc7b812 5274b9f0fa1c
	I1028 05:36:11.693460   14044 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I1028 05:36:11.698769   14044 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:36:11.701650   14044 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:36:11.701656   14044 kubeadm.go:157] found existing configuration files:
	
	I1028 05:36:11.701683   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf
	I1028 05:36:11.704260   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:36:11.704300   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:36:11.707600   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf
	I1028 05:36:11.710721   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:36:11.710752   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:36:11.713374   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf
	I1028 05:36:11.715809   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:36:11.715841   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:36:11.719021   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf
	I1028 05:36:11.721595   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:36:11.721621   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:36:11.724171   14044 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:36:11.727325   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:11.750394   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.165562   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.291609   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.323489   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.342394   14044 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:36:12.342480   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:12.844681   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:17.671202   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:17.671672   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:17.699991   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:17.700145   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:17.718723   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:17.718811   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:17.732763   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:17.732853   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:17.744166   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:17.744253   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:17.755277   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:17.755354   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:17.766305   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:17.766392   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:17.777736   13885 logs.go:282] 0 containers: []
	W1028 05:36:17.777750   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:17.777822   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:17.789288   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:17.789306   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:17.789311   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:17.813478   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:17.813486   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:17.825194   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:17.825207   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:17.840123   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:17.840132   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:17.852110   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:17.852123   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:17.868843   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:17.868860   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:17.908471   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:17.908490   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:17.923108   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:17.923118   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:17.938706   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:17.938718   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:17.950276   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:17.950290   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:17.986177   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:17.986188   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:18.001202   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:18.001212   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:18.015740   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:18.015750   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:18.027159   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:18.027174   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:18.039410   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:18.039421   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:18.056825   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:18.056835   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:18.061619   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:18.061626   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:13.344378   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:13.348804   14044 api_server.go:72] duration metric: took 1.006415417s to wait for apiserver process to appear ...
	I1028 05:36:13.348825   14044 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:36:13.348839   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:20.586576   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:18.350946   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:18.350988   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:25.588274   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:25.588516   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:25.608903   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:25.609016   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:25.623527   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:25.623620   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:25.637155   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:25.637233   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:25.649383   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:25.649466   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:25.659715   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:25.659794   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:25.669993   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:25.670073   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:25.680824   13885 logs.go:282] 0 containers: []
	W1028 05:36:25.680840   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:25.680912   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:25.691666   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:25.691683   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:25.691689   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:25.705570   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:25.705583   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:25.716760   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:25.716770   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:25.728726   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:25.728737   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:25.744164   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:25.744174   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:25.756289   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:25.756299   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:25.777168   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:25.777178   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:25.792665   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:25.792674   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:25.807744   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:25.807755   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:25.822886   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:25.822897   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:25.835326   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:25.835336   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:25.840101   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:25.840108   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:25.874707   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:25.874718   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:25.889001   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:25.889010   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:25.906229   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:25.906239   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:25.918149   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:25.918160   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:25.940606   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:25.940619   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:23.351398   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:23.351443   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:28.481927   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:28.351886   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:28.351905   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:33.484234   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:33.484410   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:36:33.504252   13885 logs.go:282] 2 containers: [15f8d8ec9d0d c447355932aa]
	I1028 05:36:33.504356   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:36:33.517867   13885 logs.go:282] 2 containers: [edade31c957d 9bbc93f4420b]
	I1028 05:36:33.517949   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:36:33.528942   13885 logs.go:282] 1 containers: [9e6597032635]
	I1028 05:36:33.529023   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:36:33.539587   13885 logs.go:282] 2 containers: [961153ee09aa 90e4db1dbfa7]
	I1028 05:36:33.539674   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:36:33.550590   13885 logs.go:282] 1 containers: [84a8cee49c21]
	I1028 05:36:33.550668   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:36:33.560966   13885 logs.go:282] 2 containers: [a9c99efbec93 482c30327b17]
	I1028 05:36:33.561044   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:36:33.570837   13885 logs.go:282] 0 containers: []
	W1028 05:36:33.570850   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:36:33.570914   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:36:33.584978   13885 logs.go:282] 2 containers: [3ea0d9a56a91 38729b15d235]
	I1028 05:36:33.584995   13885 logs.go:123] Gathering logs for kube-apiserver [15f8d8ec9d0d] ...
	I1028 05:36:33.585000   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 15f8d8ec9d0d"
	I1028 05:36:33.603508   13885 logs.go:123] Gathering logs for etcd [9bbc93f4420b] ...
	I1028 05:36:33.603520   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bbc93f4420b"
	I1028 05:36:33.617982   13885 logs.go:123] Gathering logs for kube-scheduler [90e4db1dbfa7] ...
	I1028 05:36:33.617992   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 90e4db1dbfa7"
	I1028 05:36:33.632995   13885 logs.go:123] Gathering logs for storage-provisioner [3ea0d9a56a91] ...
	I1028 05:36:33.633005   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3ea0d9a56a91"
	I1028 05:36:33.644767   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:36:33.644778   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:36:33.656907   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:36:33.656917   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:36:33.694949   13885 logs.go:123] Gathering logs for etcd [edade31c957d] ...
	I1028 05:36:33.694960   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 edade31c957d"
	I1028 05:36:33.709457   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:36:33.709467   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:36:33.748566   13885 logs.go:123] Gathering logs for kube-apiserver [c447355932aa] ...
	I1028 05:36:33.748575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c447355932aa"
	I1028 05:36:33.770094   13885 logs.go:123] Gathering logs for kube-scheduler [961153ee09aa] ...
	I1028 05:36:33.770105   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 961153ee09aa"
	I1028 05:36:33.781777   13885 logs.go:123] Gathering logs for kube-proxy [84a8cee49c21] ...
	I1028 05:36:33.781788   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 84a8cee49c21"
	I1028 05:36:33.793463   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:36:33.793474   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:36:33.817354   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:36:33.817362   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:36:33.821577   13885 logs.go:123] Gathering logs for kube-controller-manager [a9c99efbec93] ...
	I1028 05:36:33.821584   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a9c99efbec93"
	I1028 05:36:33.838660   13885 logs.go:123] Gathering logs for kube-controller-manager [482c30327b17] ...
	I1028 05:36:33.838670   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 482c30327b17"
	I1028 05:36:33.855171   13885 logs.go:123] Gathering logs for storage-provisioner [38729b15d235] ...
	I1028 05:36:33.855181   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 38729b15d235"
	I1028 05:36:33.867299   13885 logs.go:123] Gathering logs for coredns [9e6597032635] ...
	I1028 05:36:33.867311   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9e6597032635"
	I1028 05:36:36.380757   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:33.352672   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:33.352700   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:41.383124   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:41.383216   13885 kubeadm.go:597] duration metric: took 4m4.332660417s to restartPrimaryControlPlane
	W1028 05:36:41.383323   13885 out.go:270] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	I1028 05:36:41.383369   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I1028 05:36:42.481818   13885 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (1.09843425s)
	I1028 05:36:42.481905   13885 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 05:36:42.487042   13885 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:36:42.490317   13885 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:36:42.493194   13885 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:36:42.493203   13885 kubeadm.go:157] found existing configuration files:
	
	I1028 05:36:42.493240   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf
	I1028 05:36:42.495773   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:36:42.495799   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:36:42.498903   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf
	I1028 05:36:42.501988   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:36:42.502028   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:36:42.504685   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf
	I1028 05:36:42.507212   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:36:42.507241   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:36:42.510439   13885 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf
	I1028 05:36:42.513454   13885 kubeadm.go:163] "https://control-plane.minikube.internal:59017" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59017 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:36:42.513488   13885 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:36:42.516095   13885 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I1028 05:36:42.533622   13885 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I1028 05:36:42.533898   13885 kubeadm.go:310] [preflight] Running pre-flight checks
	I1028 05:36:42.586875   13885 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1028 05:36:42.586930   13885 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1028 05:36:42.586978   13885 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1028 05:36:42.634955   13885 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1028 05:36:42.640098   13885 out.go:235]   - Generating certificates and keys ...
	I1028 05:36:42.640133   13885 kubeadm.go:310] [certs] Using existing ca certificate authority
	I1028 05:36:42.640169   13885 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I1028 05:36:42.640210   13885 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I1028 05:36:42.640283   13885 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I1028 05:36:42.640319   13885 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I1028 05:36:42.640393   13885 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I1028 05:36:42.640434   13885 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I1028 05:36:42.640472   13885 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I1028 05:36:42.640551   13885 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I1028 05:36:42.640590   13885 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I1028 05:36:42.640635   13885 kubeadm.go:310] [certs] Using the existing "sa" key
	I1028 05:36:42.640669   13885 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1028 05:36:42.772144   13885 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1028 05:36:42.899866   13885 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1028 05:36:42.958340   13885 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1028 05:36:43.057571   13885 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1028 05:36:43.086788   13885 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1028 05:36:43.087220   13885 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1028 05:36:43.087262   13885 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I1028 05:36:43.174172   13885 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1028 05:36:38.353426   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:38.353466   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:43.178293   13885 out.go:235]   - Booting up control plane ...
	I1028 05:36:43.178342   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1028 05:36:43.178387   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1028 05:36:43.178532   13885 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1028 05:36:43.179659   13885 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1028 05:36:43.179758   13885 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1028 05:36:47.182086   13885 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.002371 seconds
	I1028 05:36:47.182144   13885 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1028 05:36:47.185854   13885 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1028 05:36:47.696740   13885 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I1028 05:36:47.696880   13885 kubeadm.go:310] [mark-control-plane] Marking the node running-upgrade-343000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1028 05:36:48.200509   13885 kubeadm.go:310] [bootstrap-token] Using token: nawgah.pntycuvv3oxfpjjz
	I1028 05:36:43.354706   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:43.354741   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:48.206902   13885 out.go:235]   - Configuring RBAC rules ...
	I1028 05:36:48.206964   13885 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1028 05:36:48.207007   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1028 05:36:48.210893   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1028 05:36:48.211762   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1028 05:36:48.212684   13885 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1028 05:36:48.213839   13885 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1028 05:36:48.217203   13885 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1028 05:36:48.405371   13885 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I1028 05:36:48.606227   13885 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I1028 05:36:48.606721   13885 kubeadm.go:310] 
	I1028 05:36:48.606749   13885 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I1028 05:36:48.606755   13885 kubeadm.go:310] 
	I1028 05:36:48.606792   13885 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I1028 05:36:48.606795   13885 kubeadm.go:310] 
	I1028 05:36:48.606807   13885 kubeadm.go:310]   mkdir -p $HOME/.kube
	I1028 05:36:48.606843   13885 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1028 05:36:48.606871   13885 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1028 05:36:48.606873   13885 kubeadm.go:310] 
	I1028 05:36:48.606901   13885 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I1028 05:36:48.606920   13885 kubeadm.go:310] 
	I1028 05:36:48.606946   13885 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1028 05:36:48.606949   13885 kubeadm.go:310] 
	I1028 05:36:48.606979   13885 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I1028 05:36:48.607013   13885 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1028 05:36:48.607070   13885 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1028 05:36:48.607074   13885 kubeadm.go:310] 
	I1028 05:36:48.607152   13885 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I1028 05:36:48.607196   13885 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I1028 05:36:48.607201   13885 kubeadm.go:310] 
	I1028 05:36:48.607252   13885 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token nawgah.pntycuvv3oxfpjjz \
	I1028 05:36:48.607396   13885 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 \
	I1028 05:36:48.607422   13885 kubeadm.go:310] 	--control-plane 
	I1028 05:36:48.607427   13885 kubeadm.go:310] 
	I1028 05:36:48.607474   13885 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I1028 05:36:48.607480   13885 kubeadm.go:310] 
	I1028 05:36:48.607540   13885 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token nawgah.pntycuvv3oxfpjjz \
	I1028 05:36:48.607628   13885 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 
	I1028 05:36:48.607756   13885 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1028 05:36:48.607764   13885 cni.go:84] Creating CNI manager for ""
	I1028 05:36:48.607773   13885 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:36:48.615166   13885 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1028 05:36:48.618303   13885 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1028 05:36:48.621293   13885 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I1028 05:36:48.626230   13885 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1028 05:36:48.626282   13885 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1028 05:36:48.626310   13885 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes running-upgrade-343000 minikube.k8s.io/updated_at=2024_10_28T05_36_48_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=running-upgrade-343000 minikube.k8s.io/primary=true
	I1028 05:36:48.677834   13885 kubeadm.go:1113] duration metric: took 51.593375ms to wait for elevateKubeSystemPrivileges
	I1028 05:36:48.677855   13885 ops.go:34] apiserver oom_adj: -16
	I1028 05:36:48.677862   13885 kubeadm.go:394] duration metric: took 4m11.6416505s to StartCluster
	I1028 05:36:48.677874   13885 settings.go:142] acquiring lock: {Name:mkccfb5f47d0974e890d9ac591452228f9b915fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:48.678077   13885 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:36:48.678468   13885 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:48.678683   13885 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:36:48.678688   13885 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 05:36:48.678724   13885 addons.go:69] Setting storage-provisioner=true in profile "running-upgrade-343000"
	I1028 05:36:48.678731   13885 addons.go:234] Setting addon storage-provisioner=true in "running-upgrade-343000"
	W1028 05:36:48.678734   13885 addons.go:243] addon storage-provisioner should already be in state true
	I1028 05:36:48.678754   13885 addons.go:69] Setting default-storageclass=true in profile "running-upgrade-343000"
	I1028 05:36:48.678764   13885 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-343000"
	I1028 05:36:48.678757   13885 host.go:66] Checking if "running-upgrade-343000" exists ...
	I1028 05:36:48.678873   13885 config.go:182] Loaded profile config "running-upgrade-343000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:36:48.679759   13885 kapi.go:59] client config for running-upgrade-343000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/running-upgrade-343000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x104796680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:36:48.680383   13885 addons.go:234] Setting addon default-storageclass=true in "running-upgrade-343000"
	W1028 05:36:48.680389   13885 addons.go:243] addon default-storageclass should already be in state true
	I1028 05:36:48.680397   13885 host.go:66] Checking if "running-upgrade-343000" exists ...
	I1028 05:36:48.683258   13885 out.go:177] * Verifying Kubernetes components...
	I1028 05:36:48.683641   13885 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 05:36:48.686567   13885 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 05:36:48.686573   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:36:48.690211   13885 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:48.694286   13885 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:48.697240   13885 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:36:48.697247   13885 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 05:36:48.697252   13885 sshutil.go:53] new ssh client: &{IP:localhost Port:58985 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/running-upgrade-343000/id_rsa Username:docker}
	I1028 05:36:48.784123   13885 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:36:48.789038   13885 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:36:48.789088   13885 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:48.792923   13885 api_server.go:72] duration metric: took 114.225083ms to wait for apiserver process to appear ...
	I1028 05:36:48.792932   13885 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:36:48.792940   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:48.804159   13885 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:36:48.862117   13885 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 05:36:49.143359   13885 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I1028 05:36:49.143372   13885 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I1028 05:36:48.355958   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:48.355976   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:53.795105   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:53.795208   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:53.357630   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:53.357708   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:58.795698   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:58.795735   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:58.360248   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:58.360288   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:03.796630   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:03.796673   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:03.362605   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:03.362641   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:08.797361   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:08.797417   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:08.364964   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:08.365004   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:13.798346   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:13.798362   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:13.366409   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:13.366882   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:13.397269   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:13.397423   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:13.416795   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:13.416892   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:13.430439   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:13.430515   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:13.448373   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:13.448450   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:13.458813   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:13.458892   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:13.469465   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:13.469543   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:13.480031   14044 logs.go:282] 0 containers: []
	W1028 05:37:13.480041   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:13.480103   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:13.491085   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:13.491103   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:13.491109   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:13.507546   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:13.507565   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:13.519092   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:13.519102   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:13.536217   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:13.536230   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:13.647921   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:13.647935   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:13.662196   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:13.662207   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:13.676279   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:13.676290   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:13.691950   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:13.691964   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:13.705376   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:13.705388   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:13.717414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:13.717426   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:13.728783   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:13.728795   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:13.740840   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:13.740853   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:13.745537   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:13.745547   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:13.757362   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:13.757373   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:13.784196   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:13.784209   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:13.798757   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:13.798768   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:13.839351   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:13.839362   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:16.379924   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:18.799431   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:18.799478   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W1028 05:37:19.145487   13885 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I1028 05:37:19.149907   13885 out.go:177] * Enabled addons: storage-provisioner
	I1028 05:37:19.156689   13885 addons.go:510] duration metric: took 30.477937292s for enable addons: enabled=[storage-provisioner]
	I1028 05:37:21.382288   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:21.382511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:21.401343   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:21.401454   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:21.414442   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:21.414523   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:21.425947   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:21.426020   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:21.439873   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:21.439963   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:21.450829   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:21.450914   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:21.461638   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:21.461724   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:21.471812   14044 logs.go:282] 0 containers: []
	W1028 05:37:21.471822   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:21.471890   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:21.486514   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:21.486538   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:21.486543   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:21.498213   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:21.498225   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:21.509541   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:21.509554   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:21.520851   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:21.520861   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:21.535225   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:21.535235   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:21.574961   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:21.574971   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:21.612370   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:21.612382   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:21.658542   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:21.658557   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:21.672892   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:21.672904   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:21.687320   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:21.687333   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:21.700813   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:21.700826   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:21.724387   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:21.724394   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:21.728276   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:21.728284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:21.743373   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:21.743384   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:21.757839   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:21.757848   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:21.781533   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:21.781544   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:21.793373   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:21.793386   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:23.800999   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:23.801054   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:24.306962   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:28.803027   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:28.803051   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:29.307623   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:29.307807   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:29.320118   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:29.320194   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:29.330984   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:29.331065   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:29.341198   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:29.341274   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:29.351831   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:29.351908   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:29.362731   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:29.362811   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:29.373510   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:29.373595   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:29.383473   14044 logs.go:282] 0 containers: []
	W1028 05:37:29.383485   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:29.383555   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:29.394104   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:29.394122   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:29.394128   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:29.405678   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:29.405690   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:29.429920   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:29.429928   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:29.441748   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:29.441760   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:29.458083   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:29.458094   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:29.476463   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:29.476474   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:29.489861   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:29.489872   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:29.528862   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:29.528873   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:29.543720   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:29.543730   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:29.556338   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:29.556348   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:29.571392   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:29.571403   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:29.583274   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:29.583285   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:29.594922   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:29.594934   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:29.606347   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:29.606358   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:29.643822   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:29.643833   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:29.648168   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:29.648174   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:29.691198   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:29.691209   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:32.215857   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:33.805291   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:33.805347   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:37.218145   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:37.218266   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:37.233566   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:37.233647   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:37.244732   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:37.244813   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:37.255428   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:37.255511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:37.265483   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:37.265555   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:37.275939   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:37.276014   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:37.290106   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:37.290181   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:37.300342   14044 logs.go:282] 0 containers: []
	W1028 05:37:37.300353   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:37.300418   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:37.310442   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:37.310458   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:37.310463   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:37.324854   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:37.324864   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:37.336231   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:37.336241   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:37.351720   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:37.351729   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:37.363117   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:37.363127   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:37.368447   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:37.368459   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:37.406067   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:37.406080   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:37.419636   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:37.419645   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:37.456322   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:37.456332   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:37.468256   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:37.468270   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:37.482531   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:37.482540   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:37.501180   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:37.501193   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:37.512709   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:37.512720   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:37.536682   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:37.536690   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:37.548417   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:37.548428   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:37.585825   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:37.585835   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:37.599612   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:37.599622   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:38.807771   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:38.807810   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:40.113591   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:43.808191   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:43.808245   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:45.115828   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:45.115953   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:45.127366   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:45.127443   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:45.138291   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:45.138360   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:45.149052   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:45.149132   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:45.163811   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:45.163893   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:45.175015   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:45.175092   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:45.185773   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:45.185855   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:45.196573   14044 logs.go:282] 0 containers: []
	W1028 05:37:45.196585   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:45.196650   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:45.207155   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:45.207180   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:45.207186   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:45.247407   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:45.247419   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:45.262100   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:45.262115   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:45.279522   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:45.279533   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:45.292627   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:45.292636   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:45.309968   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:45.309979   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:45.321731   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:45.321742   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:45.336993   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:45.337002   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:45.355122   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:45.355133   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:45.366303   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:45.366314   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:45.384556   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:45.384571   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:45.397004   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:45.397017   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:45.435229   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:45.435242   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:45.439252   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:45.439258   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:45.474715   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:45.474729   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:45.489439   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:45.489453   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:45.501199   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:45.501213   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:48.030570   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:48.810590   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:48.810705   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:48.821826   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:37:48.821907   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:48.832169   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:37:48.832251   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:48.843056   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:37:48.843138   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:48.858119   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:37:48.858195   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:48.868801   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:37:48.868871   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:48.879603   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:37:48.879681   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:48.889534   13885 logs.go:282] 0 containers: []
	W1028 05:37:48.889546   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:48.889605   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:48.899382   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:37:48.899394   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:48.899400   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:48.942517   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:37:48.942529   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:37:48.956947   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:37:48.956959   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:37:48.968266   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:37:48.968279   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:48.979953   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:48.979965   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:49.013834   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:49.013845   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:49.018361   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:37:49.018369   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:37:49.032357   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:37:49.032367   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:37:49.052618   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:37:49.052628   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:37:49.065657   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:37:49.065670   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:37:49.079938   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:37:49.079952   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:37:49.092370   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:37:49.092381   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:37:49.110118   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:49.110131   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:51.638020   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:53.032982   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:53.033275   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:53.057825   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:53.057957   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:53.073514   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:53.073607   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:53.086866   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:53.086946   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:53.098212   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:53.098298   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:53.109349   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:53.109423   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:53.120167   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:53.120245   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:53.130414   14044 logs.go:282] 0 containers: []
	W1028 05:37:53.130426   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:53.130486   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:53.141468   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:53.141488   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:53.141496   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:53.156365   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:53.156376   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:53.167886   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:53.167896   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:53.186261   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:53.186271   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:53.202388   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:53.202399   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:53.224975   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:53.224986   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:53.287963   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:53.287973   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:53.301973   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:53.301984   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:53.315753   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:53.315764   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:53.327767   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:53.327781   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:56.640651   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:56.640909   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:56.665396   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:37:56.665573   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:56.682501   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:37:56.682597   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:56.695733   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:37:56.695815   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:56.710014   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:37:56.710093   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:56.720955   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:37:56.721038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:56.731654   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:37:56.731734   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:56.745874   13885 logs.go:282] 0 containers: []
	W1028 05:37:56.745884   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:56.745959   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:56.756716   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:37:56.756731   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:56.756736   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:56.792033   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:37:56.792046   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:37:56.806002   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:37:56.806013   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:37:56.818160   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:37:56.818175   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:37:56.836868   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:37:56.836882   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:37:56.854233   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:56.854246   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:56.890346   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:37:56.890358   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:37:56.904538   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:37:56.904549   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:37:56.916401   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:37:56.916416   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:37:56.937148   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:37:56.937161   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:37:56.948968   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:56.948979   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:56.973708   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:37:56.973718   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:56.985609   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:56.985621   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:53.352302   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:53.352309   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:53.389644   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:53.389654   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:53.426294   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:53.426303   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:53.438546   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:53.438559   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:53.442744   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:53.442750   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:53.453630   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:53.453641   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:53.464827   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:53.464838   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:55.980570   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:59.492133   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:00.982848   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:00.983002   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:00.998861   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:00.998960   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:01.011506   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:01.011592   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:01.022531   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:01.022605   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:01.033821   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:01.033905   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:01.044539   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:01.044610   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:01.055297   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:01.055377   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:01.065370   14044 logs.go:282] 0 containers: []
	W1028 05:38:01.065383   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:01.065451   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:01.075908   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:01.075926   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:01.075945   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:01.112357   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:01.112368   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:01.127262   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:01.127275   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:01.141742   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:01.141756   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:01.179142   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:01.179155   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:01.221830   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:01.221849   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:01.239084   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:01.239094   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:01.253696   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:01.253708   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:01.265929   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:01.265941   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:01.278234   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:01.278248   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:01.292688   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:01.292698   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:01.305851   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:01.305861   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:01.310085   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:01.310090   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:01.323878   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:01.323890   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:01.335855   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:01.335867   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:01.347582   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:01.347593   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:01.371666   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:01.371675   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:04.494465   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:04.494665   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:04.516666   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:04.516780   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:04.531831   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:04.531907   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:04.544125   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:04.544218   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:04.555617   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:04.555692   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:04.566422   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:04.566509   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:04.576940   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:04.577014   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:04.587415   13885 logs.go:282] 0 containers: []
	W1028 05:38:04.587425   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:04.587487   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:04.600182   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:04.600198   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:04.600204   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:04.625730   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:04.625739   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:04.660241   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:04.660247   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:04.674617   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:04.674630   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:04.688171   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:04.688180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:04.699864   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:04.699873   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:04.714565   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:04.714575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:04.732241   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:04.732250   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:04.750305   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:04.750317   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:04.754684   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:04.754692   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:04.788790   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:04.788804   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:04.804258   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:04.804268   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:04.815848   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:04.815858   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:07.327661   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:03.886944   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:12.330056   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:12.330235   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:12.342547   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:12.342629   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:12.353368   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:12.353440   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:12.363778   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:12.363856   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:12.374142   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:12.374215   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:12.384368   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:12.384447   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:12.394503   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:12.394577   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:12.404642   13885 logs.go:282] 0 containers: []
	W1028 05:38:12.404655   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:12.404710   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:12.415296   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:12.415312   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:12.415317   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:12.433647   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:12.433663   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:12.446373   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:12.446387   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:12.482658   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:12.482672   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:12.487400   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:12.487406   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:12.498722   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:12.498736   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:12.510370   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:12.510379   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:12.525229   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:12.525239   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:12.550932   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:12.550941   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:12.586005   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:12.586016   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:12.601032   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:12.601045   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:12.614960   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:12.614970   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:12.626544   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:12.626553   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:08.889344   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:08.889633   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:08.915104   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:08.915248   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:08.938323   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:08.938413   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:08.951095   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:08.951172   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:08.961299   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:08.961374   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:08.971532   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:08.971612   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:08.982354   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:08.982419   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:08.993087   14044 logs.go:282] 0 containers: []
	W1028 05:38:08.993102   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:08.993170   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:09.004393   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:09.004410   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:09.004415   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:09.015802   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:09.015813   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:09.028653   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:09.028664   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:09.040673   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:09.040685   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:09.079310   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:09.079319   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:09.083829   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:09.083836   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:09.095606   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:09.095617   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:09.115573   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:09.115583   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:09.133507   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:09.133517   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:09.157139   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:09.157150   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:09.170995   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:09.171005   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:09.182036   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:09.182047   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:09.195576   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:09.195586   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:09.210966   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:09.210976   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:09.224414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:09.224425   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:09.235957   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:09.235968   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:09.270219   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:09.270231   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:11.814682   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:15.142132   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:16.816731   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:16.816946   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:16.836382   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:16.836484   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:16.851119   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:16.851206   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:16.863594   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:16.863677   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:16.874003   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:16.874081   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:16.884281   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:16.884356   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:16.894894   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:16.894963   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:16.905627   14044 logs.go:282] 0 containers: []
	W1028 05:38:16.905641   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:16.905706   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:16.919659   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:16.919678   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:16.919683   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:16.930645   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:16.930658   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:16.946525   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:16.946539   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:16.964434   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:16.964449   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:16.979804   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:16.979816   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:16.996324   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:16.996336   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:17.021865   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:17.021875   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:17.060664   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:17.060673   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:17.077293   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:17.077303   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:17.091594   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:17.091603   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:17.107706   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:17.107721   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:17.119195   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:17.119210   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:17.133739   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:17.133753   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:17.145044   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:17.145054   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:17.180643   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:17.180653   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:17.192647   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:17.192657   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:17.231023   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:17.231035   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:20.144054   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:20.144225   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:20.159181   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:20.159266   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:20.170736   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:20.170812   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:20.186022   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:20.186100   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:20.196197   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:20.196266   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:20.209176   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:20.209252   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:20.219861   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:20.219929   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:20.230857   13885 logs.go:282] 0 containers: []
	W1028 05:38:20.230868   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:20.230932   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:20.241005   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:20.241021   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:20.241026   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:20.253341   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:20.253352   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:20.265949   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:20.265960   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:20.286277   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:20.286287   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:20.297957   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:20.297967   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:20.333176   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:20.333184   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:20.337494   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:20.337504   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:20.371054   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:20.371064   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:20.385715   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:20.385726   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:20.399525   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:20.399533   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:20.414742   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:20.414753   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:20.426449   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:20.426459   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:20.441759   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:20.441769   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:22.967288   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:19.740080   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:27.969676   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:27.970038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:28.005438   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:28.005582   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:28.022352   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:28.022460   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:28.035085   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:28.035166   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:28.053235   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:28.053306   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:28.064820   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:28.064904   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:24.743056   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:24.743367   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:24.770943   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:24.771081   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:24.787783   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:24.787880   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:24.801046   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:24.801133   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:24.812566   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:24.812650   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:24.823514   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:24.823590   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:24.833912   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:24.833988   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:24.844630   14044 logs.go:282] 0 containers: []
	W1028 05:38:24.844641   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:24.844707   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:24.855360   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:24.855380   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:24.855385   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:24.869729   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:24.869739   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:24.888112   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:24.888121   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:24.900063   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:24.900072   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:24.937702   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:24.937714   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:24.950225   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:24.950237   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:24.987986   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:24.987996   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:25.032272   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:25.032284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:25.047699   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:25.047709   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:25.061733   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:25.061745   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:25.085133   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:25.085144   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:25.098302   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:25.098311   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:25.109520   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:25.109529   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:25.113984   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:25.113990   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:25.125685   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:25.125696   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:25.140490   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:25.140499   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:25.165648   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:25.165655   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:27.679257   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:28.075900   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:28.075975   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:28.086535   13885 logs.go:282] 0 containers: []
	W1028 05:38:28.086547   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:28.086614   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:28.097473   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:28.097486   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:28.097493   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:28.133013   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:28.133024   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:28.147954   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:28.147966   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:28.159397   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:28.159407   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:28.174602   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:28.174613   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:28.197828   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:28.197838   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:28.209189   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:28.209200   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:28.242854   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:28.242863   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:28.260455   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:28.260465   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:28.272618   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:28.272628   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:28.284691   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:28.284701   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:28.302361   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:28.302371   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:28.315416   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:28.315427   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:30.821978   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:32.681181   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:32.681319   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:32.693794   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:32.693869   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:32.705846   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:32.705922   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:32.716605   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:32.716672   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:32.727249   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:32.727329   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:32.737632   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:32.737701   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:32.748337   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:32.748445   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:32.758335   14044 logs.go:282] 0 containers: []
	W1028 05:38:32.758345   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:32.758401   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:32.768877   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:32.768897   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:32.768902   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:32.781820   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:32.781829   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:32.804799   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:32.804806   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:32.819396   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:32.819406   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:32.830883   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:32.830895   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:32.842763   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:32.842774   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:32.858347   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:32.858356   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:32.870598   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:32.870608   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:32.884017   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:32.884026   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:32.921199   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:32.921215   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:32.932978   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:32.932989   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:32.946910   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:32.946922   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:32.984636   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:32.984651   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:32.998696   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:32.998711   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:33.038006   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:33.038017   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:33.042421   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:33.042429   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:33.057072   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:33.057083   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:35.824559   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:35.824993   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:35.865376   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:35.865530   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:35.888034   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:35.888162   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:35.905980   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:35.906064   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:35.918501   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:35.918587   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:35.930236   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:35.930319   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:35.941468   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:35.941550   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:35.952428   13885 logs.go:282] 0 containers: []
	W1028 05:38:35.952441   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:35.952507   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:35.963799   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:35.963815   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:35.963820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:35.978394   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:35.978409   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:35.993621   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:35.993632   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:36.011800   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:36.011810   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:36.023997   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:36.024008   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:36.047701   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:36.047714   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:36.081974   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:36.081982   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:36.087853   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:36.087862   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:36.125853   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:36.125865   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:36.140183   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:36.140196   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:36.156419   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:36.156430   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:36.169363   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:36.169374   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:36.182536   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:36.182547   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:35.585187   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:38.697033   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:40.587582   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:40.587838   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:40.609882   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:40.610003   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:40.632129   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:40.632207   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:40.646929   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:40.647004   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:40.657359   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:40.657441   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:40.667930   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:40.668009   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:40.678010   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:40.678085   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:40.688583   14044 logs.go:282] 0 containers: []
	W1028 05:38:40.688596   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:40.688658   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:40.699111   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:40.699135   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:40.699140   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:40.712168   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:40.712177   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:40.725573   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:40.725587   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:40.763643   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:40.763658   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:40.775992   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:40.776006   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:40.787488   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:40.787499   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:40.800554   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:40.800564   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:40.835472   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:40.835483   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:40.839695   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:40.839703   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:40.853707   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:40.853717   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:40.869291   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:40.869306   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:40.880964   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:40.880975   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:40.892793   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:40.892803   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:40.915362   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:40.915371   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:40.933017   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:40.933027   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:40.974335   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:40.974345   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:40.987092   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:40.987104   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:43.698825   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:43.699048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:43.717844   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:43.717940   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:43.731175   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:43.731254   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:43.746518   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:43.746585   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:43.757043   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:43.757118   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:43.767864   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:43.767946   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:43.778446   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:43.778519   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:43.794593   13885 logs.go:282] 0 containers: []
	W1028 05:38:43.794606   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:43.794675   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:43.810148   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:43.810166   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:43.810171   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:43.826597   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:43.826608   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:43.838732   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:43.838743   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:43.853887   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:43.853898   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:43.871376   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:43.871386   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:43.882908   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:43.882920   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:43.895702   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:43.895712   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:43.930982   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:43.930991   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:43.935420   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:43.935426   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:43.947631   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:43.947641   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:43.959282   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:43.959292   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:43.984412   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:43.984420   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:44.021522   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:44.021535   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:46.538637   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:43.512299   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:51.540868   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:51.541038   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:51.559780   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:51.559887   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:51.575572   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:51.575655   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:51.587916   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:51.587997   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:51.599091   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:51.599163   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:51.609541   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:51.609616   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:51.620165   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:51.620233   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:51.630071   13885 logs.go:282] 0 containers: []
	W1028 05:38:51.630084   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:51.630153   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:51.640292   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:51.640306   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:51.640311   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:51.675746   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:51.675756   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:51.712132   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:51.712146   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:51.727011   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:51.727023   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:51.738799   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:51.738812   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:51.753675   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:51.753687   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:51.765531   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:51.765541   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:51.782429   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:51.782441   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:51.794525   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:51.794534   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:51.798965   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:51.798975   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:51.813334   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:51.813347   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:51.824592   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:51.824603   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:51.849739   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:51.849747   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:48.514772   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:48.514932   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:48.525771   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:48.525849   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:48.536503   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:48.536593   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:48.547673   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:48.547752   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:48.558124   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:48.558200   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:48.569028   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:48.569100   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:48.579906   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:48.580060   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:48.590811   14044 logs.go:282] 0 containers: []
	W1028 05:38:48.590821   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:48.590885   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:48.601583   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:48.601601   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:48.601607   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:48.622388   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:48.622402   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:48.659669   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:48.659679   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:48.675929   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:48.675943   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:48.690430   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:48.690444   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:48.702252   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:48.702262   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:48.743103   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:48.743113   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:48.757374   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:48.757386   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:48.774692   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:48.774706   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:48.809435   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:48.809450   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:48.823608   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:48.823618   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:48.838034   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:48.838048   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:48.857852   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:48.857863   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:48.869876   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:48.869888   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:48.882274   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:48.882285   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:48.886914   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:48.886920   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:48.909551   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:48.909560   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:51.422596   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:54.363469   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:56.424896   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:56.425012   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:56.436406   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:56.436492   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:56.447702   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:56.447793   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:56.458527   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:56.458597   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:56.474522   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:56.474601   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:56.485000   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:56.485077   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:56.495624   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:56.495691   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:56.505587   14044 logs.go:282] 0 containers: []
	W1028 05:38:56.505597   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:56.505663   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:56.516874   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:56.516895   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:56.516900   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:56.530205   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:56.530217   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:56.554891   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:56.554901   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:56.558997   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:56.559006   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:56.573585   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:56.573597   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:56.586641   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:56.586654   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:56.601221   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:56.601230   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:56.615541   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:56.615551   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:56.627414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:56.627424   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:56.638436   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:56.638446   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:56.673272   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:56.673283   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:56.684787   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:56.684798   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:56.702526   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:56.702536   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:56.718456   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:56.718467   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:56.730367   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:56.730379   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:56.768099   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:56.768110   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:56.782206   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:56.782216   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:59.365829   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:59.365910   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:59.378729   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:38:59.378807   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:59.389165   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:38:59.389245   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:59.399752   13885 logs.go:282] 2 containers: [26c0d9578065 46ceb5be449d]
	I1028 05:38:59.399828   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:59.416544   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:38:59.416627   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:59.427184   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:38:59.427258   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:59.437907   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:38:59.437982   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:59.447799   13885 logs.go:282] 0 containers: []
	W1028 05:38:59.447812   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:59.447874   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:59.458902   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:38:59.458917   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:59.458922   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:59.463293   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:38:59.463302   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:38:59.477701   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:38:59.477713   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:38:59.491449   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:38:59.491460   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:38:59.505788   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:38:59.505800   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:38:59.522404   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:59.522414   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:59.546900   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:59.546915   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:59.580761   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:38:59.580769   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:38:59.592418   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:38:59.592428   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:38:59.606352   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:38:59.606367   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:38:59.618369   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:38:59.618382   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:38:59.630205   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:38:59.630219   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:59.641368   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:59.641376   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:02.177285   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:59.321702   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:07.178297   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:07.178468   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:07.196117   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:07.196227   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:07.210238   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:07.210335   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:07.222616   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:07.222698   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:07.235821   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:07.235894   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:07.246952   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:07.247030   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:07.257188   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:07.257263   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:07.267887   13885 logs.go:282] 0 containers: []
	W1028 05:39:07.267899   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:07.267963   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:07.278407   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:07.278423   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:07.278429   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:07.290442   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:07.290456   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:07.302286   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:07.302312   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:07.337654   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:07.337662   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:07.342176   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:07.342182   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:07.378084   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:07.378093   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:07.393074   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:07.393087   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:07.409916   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:07.409927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:07.421599   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:07.421611   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:07.445726   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:07.445738   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:07.459923   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:07.459933   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:07.472056   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:07.472068   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:07.488228   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:07.488239   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:07.499900   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:07.499911   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:07.511761   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:07.511772   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:04.324027   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:04.324301   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:04.343958   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:04.344066   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:04.358323   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:04.358404   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:04.370142   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:04.370221   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:04.381301   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:04.381374   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:04.392013   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:04.392084   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:04.402634   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:04.402716   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:04.415787   14044 logs.go:282] 0 containers: []
	W1028 05:39:04.415799   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:04.415866   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:04.432002   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:04.432019   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:04.432024   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:04.436049   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:04.436058   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:04.449485   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:04.449495   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:04.463651   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:04.463661   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:04.475686   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:04.475697   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:04.489621   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:04.489631   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:04.527521   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:04.527533   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:04.538649   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:04.538660   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:04.550602   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:04.550615   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:04.563397   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:04.563406   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:04.574585   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:04.574595   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:04.598933   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:04.598941   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:04.637647   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:04.637655   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:04.672469   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:04.672479   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:04.687380   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:04.687390   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:04.699002   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:04.699013   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:04.716813   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:04.716824   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:07.228981   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:10.026472   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:12.231239   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:12.231511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:12.253523   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:12.253620   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:12.267371   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:12.267456   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:12.279214   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:12.279286   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:12.293030   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:12.293118   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:12.308214   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:12.308283   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:12.319727   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:12.319804   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:12.330096   14044 logs.go:282] 0 containers: []
	W1028 05:39:12.330108   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:12.330169   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:12.340998   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:12.341017   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:12.341023   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:12.354865   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:12.354875   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:12.367526   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:12.367537   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:12.391262   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:12.391269   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:12.402954   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:12.402966   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:12.407092   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:12.407102   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:12.428672   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:12.428687   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:12.443517   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:12.443528   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:12.458220   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:12.458236   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:12.473332   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:12.473343   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:12.491823   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:12.491837   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:12.505196   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:12.505206   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:12.516520   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:12.516531   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:12.556219   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:12.556228   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:12.593173   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:12.593183   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:12.604474   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:12.604484   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:12.641559   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:12.641569   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:15.028894   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:15.029098   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:15.042955   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:15.043048   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:15.053690   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:15.053759   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:15.064775   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:15.064859   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:15.075343   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:15.075427   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:15.085960   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:15.086036   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:15.097344   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:15.097423   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:15.107318   13885 logs.go:282] 0 containers: []
	W1028 05:39:15.107331   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:15.107395   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:15.117732   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:15.117754   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:15.117760   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:15.132515   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:15.132525   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:15.145059   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:15.145070   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:15.156746   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:15.156755   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:15.192091   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:15.192100   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:15.197025   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:15.197034   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:15.211311   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:15.211324   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:15.224071   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:15.224080   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:15.235556   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:15.235566   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:15.253309   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:15.253320   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:15.278386   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:15.278403   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:15.290198   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:15.290213   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:15.310757   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:15.310773   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:15.347033   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:15.347044   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:15.360846   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:15.360858   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:17.874441   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:15.156624   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:22.877035   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:22.877257   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:22.898694   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:22.898819   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:22.916789   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:22.916870   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:22.934925   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:22.935007   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:22.946620   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:22.946689   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:22.962683   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:22.962764   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:22.972936   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:22.973012   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:22.982774   13885 logs.go:282] 0 containers: []
	W1028 05:39:22.982786   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:22.982850   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:22.998203   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:22.998225   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:22.998230   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:23.032345   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:23.032354   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:23.047126   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:23.047136   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:23.064671   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:23.064681   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:23.069575   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:23.069584   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:20.158823   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:20.159086   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:20.181691   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:20.181796   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:20.196874   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:20.196959   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:20.208325   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:20.208408   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:20.218584   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:20.218673   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:20.229515   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:20.229593   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:20.240052   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:20.240125   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:20.250585   14044 logs.go:282] 0 containers: []
	W1028 05:39:20.250600   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:20.250665   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:20.261059   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:20.261086   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:20.261091   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:20.280387   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:20.280399   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:20.304899   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:20.304909   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:20.309668   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:20.309674   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:20.323769   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:20.323780   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:20.362067   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:20.362078   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:20.378161   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:20.378174   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:20.389849   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:20.389860   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:20.404759   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:20.404769   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:20.418722   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:20.418733   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:20.430096   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:20.430107   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:20.442053   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:20.442065   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:20.477214   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:20.477224   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:20.492107   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:20.492115   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:20.531358   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:20.531368   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:20.545655   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:20.545665   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:20.557322   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:20.557331   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:23.080692   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:23.084523   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:23.084537   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:23.098823   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:23.098834   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:23.110811   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:23.110826   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:23.126982   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:23.126996   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:23.138571   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:23.138586   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:23.150335   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:23.150343   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:23.161921   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:23.161932   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:23.185706   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:23.185716   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:23.219924   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:23.219936   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:23.231746   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:23.231757   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:25.744228   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:28.082933   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:28.083181   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:28.102623   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:28.102729   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:28.116575   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:28.116663   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:28.128584   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:28.128664   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:28.139280   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:28.139363   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:28.153094   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:28.153178   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:28.163971   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:28.164039   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:28.174058   14044 logs.go:282] 0 containers: []
	W1028 05:39:28.174071   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:28.174139   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:28.184698   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:28.184713   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:28.184719   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:28.224598   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:28.224609   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:28.238568   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:28.238580   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:28.250273   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:28.250283   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:28.261847   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:28.261857   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:28.279379   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:28.279389   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:28.317804   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:28.317816   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:28.329744   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:28.329753   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:30.746541   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:30.746762   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:30.762479   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:30.762575   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:30.780496   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:30.780579   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:30.791656   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:30.791737   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:30.801642   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:30.801718   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:30.811783   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:30.811854   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:30.822219   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:30.822302   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:30.832558   13885 logs.go:282] 0 containers: []
	W1028 05:39:30.832570   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:30.832625   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:30.842506   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:30.842533   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:30.842539   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:30.858728   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:30.858742   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:30.874391   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:30.874401   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:30.891334   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:30.891346   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:30.904895   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:30.904907   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:30.916881   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:30.916892   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:30.943601   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:30.943613   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:30.955326   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:30.955338   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:30.971198   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:30.971210   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:31.007902   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:31.007915   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:31.012660   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:31.012668   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:31.048584   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:31.048598   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:31.062305   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:31.062315   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:31.077571   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:31.077581   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:31.090195   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:31.090205   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:28.348227   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:28.348237   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:28.359798   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:28.359808   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:28.364010   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:28.364019   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:28.382162   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:28.382172   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:28.402966   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:28.402975   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:28.416031   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:28.416041   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:28.427389   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:28.427399   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:28.466742   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:28.466751   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:28.482400   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:28.482411   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:31.008230   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:33.604346   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:36.010432   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:36.010713   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:36.029184   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:36.029285   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:36.045089   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:36.045179   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:36.063258   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:36.063332   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:36.073610   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:36.073678   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:36.084319   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:36.084403   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:36.095205   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:36.095288   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:36.107679   14044 logs.go:282] 0 containers: []
	W1028 05:39:36.107692   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:36.107759   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:36.118461   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:36.118478   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:36.118484   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:36.132776   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:36.132787   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:36.146471   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:36.146482   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:36.185298   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:36.185308   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:36.220305   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:36.220317   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:36.234512   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:36.234521   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:36.247843   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:36.247852   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:36.259335   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:36.259350   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:36.263881   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:36.263891   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:36.286381   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:36.286392   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:36.298123   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:36.298132   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:36.320951   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:36.320960   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:36.358402   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:36.358413   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:36.372598   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:36.372607   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:36.388347   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:36.388358   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:36.403634   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:36.403644   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:36.415241   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:36.415254   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:38.606543   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:38.606668   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:38.617946   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:38.618031   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:38.628719   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:38.628797   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:38.639420   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:38.639504   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:38.653610   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:38.653686   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:38.664056   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:38.664131   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:38.674547   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:38.674642   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:38.684763   13885 logs.go:282] 0 containers: []
	W1028 05:39:38.684773   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:38.684830   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:38.695296   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:38.695314   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:38.695320   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:38.699847   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:38.699856   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:38.715661   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:38.715673   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:38.729842   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:38.729854   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:38.741421   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:38.741434   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:38.753099   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:38.753115   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:38.769967   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:38.769977   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:38.781300   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:38.781314   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:38.816214   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:38.816223   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:38.831497   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:38.831507   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:38.842925   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:38.842935   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:38.854691   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:38.854701   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:38.889604   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:38.889618   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:38.901282   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:38.901293   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:38.919021   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:38.919031   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:41.445089   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:38.927276   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:46.446589   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:46.447107   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:46.500779   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:46.500924   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:46.523312   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:46.523402   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:46.536621   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:46.536709   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:46.547940   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:46.548021   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:46.558638   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:46.558715   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:46.569437   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:46.569520   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:46.580706   13885 logs.go:282] 0 containers: []
	W1028 05:39:46.580721   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:46.580790   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:46.591928   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:46.591947   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:46.591952   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:46.608376   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:46.608387   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:46.643124   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:46.643133   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:46.655046   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:46.655055   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:46.670713   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:46.670723   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:46.706473   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:46.706483   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:46.721452   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:46.721462   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:46.733495   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:46.733507   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:46.745243   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:46.745253   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:46.757453   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:46.757465   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:46.776241   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:46.776255   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:46.790332   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:46.790342   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:46.801850   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:46.801865   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:46.827656   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:46.827667   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:46.832160   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:46.832167   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:43.929474   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:43.929738   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:43.950453   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:43.950554   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:43.964519   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:43.964602   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:43.982065   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:43.982141   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:43.992727   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:43.992798   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:44.007822   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:44.007899   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:44.019794   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:44.019865   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:44.031301   14044 logs.go:282] 0 containers: []
	W1028 05:39:44.031312   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:44.031380   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:44.041849   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:44.041869   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:44.041876   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:44.055599   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:44.055612   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:44.093434   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:44.093442   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:44.128709   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:44.128721   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:44.143888   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:44.143899   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:44.158542   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:44.158554   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:44.169531   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:44.169545   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:44.183406   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:44.183417   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:44.197628   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:44.197637   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:44.209451   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:44.209461   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:44.227373   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:44.227384   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:44.239326   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:44.239338   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:44.243940   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:44.243946   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:44.281086   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:44.281097   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:44.292795   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:44.292804   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:44.307709   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:44.307720   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:44.318817   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:44.318830   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:46.843904   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:49.348976   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:51.846133   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:51.846413   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:51.874671   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:51.874822   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:51.892667   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:51.892758   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:51.906224   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:51.906309   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:51.917745   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:51.917850   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:51.928148   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:51.928223   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:51.939766   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:51.939846   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:51.950714   14044 logs.go:282] 0 containers: []
	W1028 05:39:51.950725   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:51.950794   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:51.961363   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:51.961382   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:51.961387   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:51.973256   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:51.973267   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:51.991195   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:51.991205   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:52.005090   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:52.005100   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:52.009428   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:52.009435   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:52.028296   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:52.028311   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:52.074967   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:52.074977   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:52.097330   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:52.097341   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:52.108625   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:52.108635   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:52.143050   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:52.143066   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:52.157546   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:52.157555   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:52.168890   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:52.168901   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:52.207995   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:52.208003   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:52.220047   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:52.220057   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:52.235003   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:52.235015   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:52.249825   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:52.249836   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:52.261480   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:52.261495   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:54.351374   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:54.351662   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:54.372799   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:39:54.372910   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:54.387713   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:39:54.387803   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:54.400134   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:39:54.400226   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:54.411259   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:39:54.411334   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:54.421440   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:39:54.421524   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:54.432138   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:39:54.432218   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:54.442701   13885 logs.go:282] 0 containers: []
	W1028 05:39:54.442712   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:54.442778   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:54.453073   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:39:54.453092   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:54.453098   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:54.457977   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:39:54.457983   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:39:54.475259   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:39:54.475271   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:39:54.490532   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:39:54.490547   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:54.502085   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:39:54.502098   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:39:54.516387   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:39:54.516398   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:39:54.529309   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:39:54.529319   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:39:54.541421   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:39:54.541434   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:39:54.553493   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:39:54.553504   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:39:54.564874   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:54.564885   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:54.598907   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:54.598914   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:54.634210   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:39:54.634220   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:39:54.646052   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:39:54.646063   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:39:54.661073   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:39:54.661083   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:39:54.678131   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:54.678141   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:57.203879   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:54.778304   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:02.206234   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:02.206456   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:02.223501   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:02.223601   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:02.236876   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:02.236953   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:02.248202   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:02.248280   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:02.260165   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:02.260239   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:02.270718   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:02.270789   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:02.287098   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:02.287177   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:02.296796   13885 logs.go:282] 0 containers: []
	W1028 05:40:02.296810   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:02.296874   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:02.307082   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:02.307116   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:02.307122   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:02.318888   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:02.318898   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:02.336019   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:02.336029   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:02.347714   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:02.347729   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:02.381870   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:02.381884   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:02.386486   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:02.386493   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:02.400810   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:02.400820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:02.412862   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:02.412873   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:02.424635   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:02.424645   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:02.459695   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:02.459710   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:02.474994   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:02.475005   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:02.486744   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:02.486755   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:02.498759   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:02.498774   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:02.512576   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:02.512585   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:02.535718   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:02.535727   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:59.780605   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:59.780780   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:59.794698   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:59.794783   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:59.805899   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:59.805976   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:59.816407   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:59.816478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:59.826748   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:59.826833   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:59.837406   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:59.837478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:59.847989   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:59.848067   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:59.863094   14044 logs.go:282] 0 containers: []
	W1028 05:39:59.863104   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:59.863162   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:59.873739   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:59.873757   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:59.873762   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:59.884982   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:59.884991   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:59.899814   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:59.899827   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:59.922863   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:59.922872   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:59.962907   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:59.962920   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:59.977374   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:59.977383   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:59.992391   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:59.992402   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:40:00.005006   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:00.005017   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:00.009061   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:40:00.009070   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:40:00.022936   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:40:00.022948   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:40:00.037548   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:40:00.037559   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:40:00.058051   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:40:00.058065   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:40:00.068888   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:40:00.068898   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:00.080484   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:00.080496   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:00.115622   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:40:00.115633   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:40:00.154052   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:40:00.154065   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:40:00.175621   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:40:00.175631   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:40:02.690490   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:05.063122   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:07.692765   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:07.692915   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:07.709064   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:40:07.709196   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:07.723250   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:40:07.723332   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:07.737357   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:40:07.737439   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:07.748491   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:40:07.748569   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:07.758911   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:40:07.758985   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:07.770001   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:40:07.770080   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:07.779749   14044 logs.go:282] 0 containers: []
	W1028 05:40:07.779761   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:07.779831   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:07.789960   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:40:07.789976   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:40:07.789982   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:40:07.803785   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:40:07.803797   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:40:07.821761   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:40:07.821776   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:40:07.836003   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:07.836013   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:07.873768   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:07.873777   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:07.908725   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:40:07.908739   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:40:07.923026   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:40:07.923037   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:40:07.942273   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:40:07.942284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:40:07.954057   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:40:07.954066   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:40:07.965976   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:07.965987   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:07.988183   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:40:07.988193   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:08.000240   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:08.000251   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:08.004523   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:40:08.004530   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:40:08.042875   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:40:08.042887   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:40:08.055081   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:40:08.055093   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:40:08.071892   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:40:08.071902   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:40:08.083222   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:40:08.083232   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:40:10.065620   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:10.065786   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:10.078684   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:10.078779   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:10.091139   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:10.091220   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:10.101867   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:10.101947   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:10.111918   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:10.111989   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:10.122862   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:10.122940   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:10.133340   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:10.133414   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:10.143786   13885 logs.go:282] 0 containers: []
	W1028 05:40:10.143802   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:10.143867   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:10.154036   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:10.154053   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:10.154059   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:10.165862   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:10.165875   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:10.183729   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:10.183739   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:10.188251   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:10.188257   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:10.199685   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:10.199697   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:10.211671   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:10.211682   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:10.223573   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:10.223583   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:10.259389   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:10.259399   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:10.273618   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:10.273632   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:10.285472   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:10.285483   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:10.297279   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:10.297288   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:10.309119   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:10.309130   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:10.324341   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:10.324351   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:10.349755   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:10.349763   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:10.383467   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:10.383480   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:12.900435   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:10.600376   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:15.602660   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:15.602755   14044 kubeadm.go:597] duration metric: took 4m3.938314s to restartPrimaryControlPlane
	W1028 05:40:15.602824   14044 out.go:270] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	I1028 05:40:15.602858   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I1028 05:40:16.595897   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 05:40:16.600960   14044 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:40:16.603706   14044 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:40:16.606541   14044 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:40:16.606546   14044 kubeadm.go:157] found existing configuration files:
	
	I1028 05:40:16.606572   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf
	I1028 05:40:16.609260   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:40:16.609295   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:40:16.611751   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf
	I1028 05:40:16.614726   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:40:16.614759   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:40:16.617840   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf
	I1028 05:40:16.620611   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:40:16.620643   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:40:16.623238   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf
	I1028 05:40:16.626307   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:40:16.626334   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:40:16.629400   14044 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I1028 05:40:16.646477   14044 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I1028 05:40:16.646506   14044 kubeadm.go:310] [preflight] Running pre-flight checks
	I1028 05:40:16.705727   14044 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1028 05:40:16.705796   14044 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1028 05:40:16.705851   14044 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1028 05:40:16.754312   14044 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1028 05:40:16.758552   14044 out.go:235]   - Generating certificates and keys ...
	I1028 05:40:16.758587   14044 kubeadm.go:310] [certs] Using existing ca certificate authority
	I1028 05:40:16.758623   14044 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I1028 05:40:16.758675   14044 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I1028 05:40:16.758730   14044 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I1028 05:40:16.758767   14044 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I1028 05:40:16.758795   14044 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I1028 05:40:16.758826   14044 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I1028 05:40:16.758855   14044 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I1028 05:40:16.758888   14044 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I1028 05:40:16.758928   14044 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I1028 05:40:16.758957   14044 kubeadm.go:310] [certs] Using the existing "sa" key
	I1028 05:40:16.758982   14044 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1028 05:40:16.807830   14044 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1028 05:40:16.867767   14044 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1028 05:40:17.090373   14044 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1028 05:40:17.118045   14044 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1028 05:40:17.146831   14044 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1028 05:40:17.147174   14044 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1028 05:40:17.147306   14044 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I1028 05:40:17.234199   14044 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1028 05:40:17.902778   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:17.902909   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:17.917601   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:17.917685   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:17.930445   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:17.930532   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:17.941739   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:17.941830   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:17.954285   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:17.954374   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:17.966878   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:17.966954   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:17.978174   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:17.978257   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:17.988801   13885 logs.go:282] 0 containers: []
	W1028 05:40:17.988835   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:17.988904   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:18.001470   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:18.001489   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:18.001495   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:18.014973   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:18.014985   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:18.052915   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:18.052927   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:17.238378   14044 out.go:235]   - Booting up control plane ...
	I1028 05:40:17.238427   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1028 05:40:17.238476   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1028 05:40:17.238543   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1028 05:40:17.238626   14044 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1028 05:40:17.238728   14044 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1028 05:40:21.741519   14044 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.503555 seconds
	I1028 05:40:21.741586   14044 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1028 05:40:21.746456   14044 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1028 05:40:22.255737   14044 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I1028 05:40:22.255864   14044 kubeadm.go:310] [mark-control-plane] Marking the node stopped-upgrade-871000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1028 05:40:22.759305   14044 kubeadm.go:310] [bootstrap-token] Using token: 88vf9n.wm73m1u6l0vu61hl
	I1028 05:40:18.074873   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:18.074886   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:18.089591   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:18.089605   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:18.104573   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:18.104585   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:18.120475   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:18.120487   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:18.144187   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:18.144201   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:18.162882   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:18.162899   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:18.176786   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:18.176801   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:18.213548   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:18.213575   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:18.227091   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:18.227102   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:18.240214   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:18.240229   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:18.245949   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:18.245964   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:18.261770   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:18.261783   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:20.788599   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:22.763568   14044 out.go:235]   - Configuring RBAC rules ...
	I1028 05:40:22.763636   14044 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1028 05:40:22.765615   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1028 05:40:22.771703   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1028 05:40:22.772615   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1028 05:40:22.773421   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1028 05:40:22.774176   14044 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1028 05:40:22.777389   14044 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1028 05:40:22.958096   14044 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I1028 05:40:23.167293   14044 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I1028 05:40:23.167791   14044 kubeadm.go:310] 
	I1028 05:40:23.167823   14044 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I1028 05:40:23.167829   14044 kubeadm.go:310] 
	I1028 05:40:23.167932   14044 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I1028 05:40:23.167938   14044 kubeadm.go:310] 
	I1028 05:40:23.167950   14044 kubeadm.go:310]   mkdir -p $HOME/.kube
	I1028 05:40:23.167980   14044 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1028 05:40:23.168021   14044 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1028 05:40:23.168026   14044 kubeadm.go:310] 
	I1028 05:40:23.168059   14044 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I1028 05:40:23.168068   14044 kubeadm.go:310] 
	I1028 05:40:23.168116   14044 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1028 05:40:23.168125   14044 kubeadm.go:310] 
	I1028 05:40:23.168151   14044 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I1028 05:40:23.168193   14044 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1028 05:40:23.168241   14044 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1028 05:40:23.168245   14044 kubeadm.go:310] 
	I1028 05:40:23.168317   14044 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I1028 05:40:23.168354   14044 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I1028 05:40:23.168356   14044 kubeadm.go:310] 
	I1028 05:40:23.168454   14044 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 88vf9n.wm73m1u6l0vu61hl \
	I1028 05:40:23.168512   14044 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 \
	I1028 05:40:23.168528   14044 kubeadm.go:310] 	--control-plane 
	I1028 05:40:23.168531   14044 kubeadm.go:310] 
	I1028 05:40:23.168674   14044 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I1028 05:40:23.168684   14044 kubeadm.go:310] 
	I1028 05:40:23.168729   14044 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 88vf9n.wm73m1u6l0vu61hl \
	I1028 05:40:23.168798   14044 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 
	I1028 05:40:23.168989   14044 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1028 05:40:23.169000   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:40:23.169008   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:40:23.176172   14044 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1028 05:40:23.179151   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1028 05:40:23.182409   14044 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I1028 05:40:23.187111   14044 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1028 05:40:23.187161   14044 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1028 05:40:23.187232   14044 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes stopped-upgrade-871000 minikube.k8s.io/updated_at=2024_10_28T05_40_23_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=stopped-upgrade-871000 minikube.k8s.io/primary=true
	I1028 05:40:23.226995   14044 kubeadm.go:1113] duration metric: took 39.875959ms to wait for elevateKubeSystemPrivileges
	I1028 05:40:23.227017   14044 ops.go:34] apiserver oom_adj: -16
	I1028 05:40:23.236987   14044 kubeadm.go:394] duration metric: took 4m11.585988458s to StartCluster
	I1028 05:40:23.237004   14044 settings.go:142] acquiring lock: {Name:mkccfb5f47d0974e890d9ac591452228f9b915fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:40:23.237098   14044 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:40:23.237549   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:40:23.237767   14044 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:40:23.237776   14044 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 05:40:23.237815   14044 addons.go:69] Setting storage-provisioner=true in profile "stopped-upgrade-871000"
	I1028 05:40:23.237823   14044 addons.go:234] Setting addon storage-provisioner=true in "stopped-upgrade-871000"
	I1028 05:40:23.237853   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:40:23.237891   14044 addons.go:69] Setting default-storageclass=true in profile "stopped-upgrade-871000"
	I1028 05:40:23.237901   14044 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-871000"
	W1028 05:40:23.237895   14044 addons.go:243] addon storage-provisioner should already be in state true
	I1028 05:40:23.237916   14044 host.go:66] Checking if "stopped-upgrade-871000" exists ...
	I1028 05:40:23.238308   14044 retry.go:31] will retry after 664.216304ms: connect: dial unix /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/monitor: connect: connection refused
	I1028 05:40:23.239024   14044 kapi.go:59] client config for stopped-upgrade-871000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1021ae680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:40:23.239150   14044 addons.go:234] Setting addon default-storageclass=true in "stopped-upgrade-871000"
	W1028 05:40:23.239154   14044 addons.go:243] addon default-storageclass should already be in state true
	I1028 05:40:23.239161   14044 host.go:66] Checking if "stopped-upgrade-871000" exists ...
	I1028 05:40:23.239663   14044 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 05:40:23.239668   14044 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 05:40:23.239679   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:40:23.242105   14044 out.go:177] * Verifying Kubernetes components...
	I1028 05:40:23.250102   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:40:23.340500   14044 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:40:23.345650   14044 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:40:23.345704   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:40:23.347571   14044 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 05:40:23.350506   14044 api_server.go:72] duration metric: took 112.727875ms to wait for apiserver process to appear ...
	I1028 05:40:23.350514   14044 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:40:23.350521   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:23.655291   14044 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I1028 05:40:23.655301   14044 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I1028 05:40:23.909279   14044 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:40:25.790958   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:25.791087   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:25.802434   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:25.802518   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:25.813409   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:25.813498   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:25.824349   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:25.824430   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:25.842636   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:25.842716   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:25.855756   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:25.855834   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:25.866218   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:25.866290   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:25.876289   13885 logs.go:282] 0 containers: []
	W1028 05:40:25.876303   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:25.876376   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:25.890885   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:25.890904   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:25.890909   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:25.928809   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:25.928820   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:25.944823   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:25.944833   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:25.956552   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:25.956562   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:25.975712   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:25.975721   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:25.991168   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:25.991180   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:26.004310   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:26.004321   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:26.038802   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:26.038812   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:26.043089   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:26.043096   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:26.067077   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:26.067089   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:26.080023   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:26.080036   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:26.094531   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:26.094541   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:26.106274   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:26.106286   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:26.118048   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:26.118061   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:26.129985   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:26.129997   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:23.913354   14044 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:40:23.913364   14044 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 05:40:23.913377   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:40:23.948308   14044 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:40:28.649793   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:28.352595   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:28.352645   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:33.652109   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:33.652256   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:33.663474   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:33.663552   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:33.673966   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:33.674046   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:33.684911   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:33.684988   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:33.696092   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:33.696164   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:33.706426   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:33.706497   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:33.716540   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:33.716620   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:33.727093   13885 logs.go:282] 0 containers: []
	W1028 05:40:33.727105   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:33.727174   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:33.740779   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:33.740796   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:33.740804   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:33.777299   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:33.777313   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:33.791151   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:33.791166   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:33.803053   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:33.803065   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:33.807297   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:33.807304   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:33.819215   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:33.819228   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:33.831166   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:33.831179   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:33.851140   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:33.851154   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:33.862666   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:33.862675   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:33.898456   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:33.898467   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:33.912507   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:33.912518   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:33.926526   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:33.926540   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:33.942593   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:33.942605   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:33.955062   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:33.955074   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:33.966943   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:33.966954   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:36.494384   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:33.352945   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:33.352967   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:41.496626   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:41.496849   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:41.510760   13885 logs.go:282] 1 containers: [865e18703f88]
	I1028 05:40:41.510848   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:41.521590   13885 logs.go:282] 1 containers: [f235b8b08247]
	I1028 05:40:41.521664   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:41.538790   13885 logs.go:282] 4 containers: [2c90a3e4a20a c5f17bd00a16 26c0d9578065 46ceb5be449d]
	I1028 05:40:41.538877   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:41.549255   13885 logs.go:282] 1 containers: [402c9c222e8d]
	I1028 05:40:41.549329   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:41.559020   13885 logs.go:282] 1 containers: [91edb87621db]
	I1028 05:40:41.559095   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:41.569881   13885 logs.go:282] 1 containers: [8db3227b0119]
	I1028 05:40:41.569953   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:41.580384   13885 logs.go:282] 0 containers: []
	W1028 05:40:41.580397   13885 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:41.580458   13885 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:41.591467   13885 logs.go:282] 1 containers: [c785c0d9a3e1]
	I1028 05:40:41.591485   13885 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:41.591490   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:41.627252   13885 logs.go:123] Gathering logs for kube-apiserver [865e18703f88] ...
	I1028 05:40:41.627263   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 865e18703f88"
	I1028 05:40:41.641956   13885 logs.go:123] Gathering logs for etcd [f235b8b08247] ...
	I1028 05:40:41.641967   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f235b8b08247"
	I1028 05:40:41.656214   13885 logs.go:123] Gathering logs for coredns [2c90a3e4a20a] ...
	I1028 05:40:41.656225   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2c90a3e4a20a"
	I1028 05:40:41.668745   13885 logs.go:123] Gathering logs for coredns [c5f17bd00a16] ...
	I1028 05:40:41.668754   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c5f17bd00a16"
	I1028 05:40:41.680171   13885 logs.go:123] Gathering logs for coredns [26c0d9578065] ...
	I1028 05:40:41.680181   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 26c0d9578065"
	I1028 05:40:41.691767   13885 logs.go:123] Gathering logs for kube-proxy [91edb87621db] ...
	I1028 05:40:41.691776   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 91edb87621db"
	I1028 05:40:41.703461   13885 logs.go:123] Gathering logs for storage-provisioner [c785c0d9a3e1] ...
	I1028 05:40:41.703474   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c785c0d9a3e1"
	I1028 05:40:41.715046   13885 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:41.715057   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:41.719611   13885 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:41.719619   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:41.753735   13885 logs.go:123] Gathering logs for kube-controller-manager [8db3227b0119] ...
	I1028 05:40:41.753746   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8db3227b0119"
	I1028 05:40:41.771628   13885 logs.go:123] Gathering logs for coredns [46ceb5be449d] ...
	I1028 05:40:41.771638   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 46ceb5be449d"
	I1028 05:40:41.783520   13885 logs.go:123] Gathering logs for kube-scheduler [402c9c222e8d] ...
	I1028 05:40:41.783530   13885 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 402c9c222e8d"
	I1028 05:40:41.798237   13885 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:41.798247   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:41.822919   13885 logs.go:123] Gathering logs for container status ...
	I1028 05:40:41.822929   13885 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:38.353262   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:38.353285   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:44.338668   13885 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:43.354041   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:43.354080   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:49.339611   13885 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:49.344490   13885 out.go:201] 
	W1028 05:40:49.349421   13885 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W1028 05:40:49.349426   13885 out.go:270] * 
	W1028 05:40:49.349901   13885 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:40:49.365431   13885 out.go:201] 
	I1028 05:40:48.354835   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:48.354863   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:53.355700   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:53.355732   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W1028 05:40:53.657687   14044 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I1028 05:40:53.663009   14044 out.go:177] * Enabled addons: storage-provisioner
	I1028 05:40:53.671028   14044 addons.go:510] duration metric: took 30.433186916s for enable addons: enabled=[storage-provisioner]
	I1028 05:40:58.357079   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:58.357119   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	
	
	==> Docker <==
	-- Journal begins at Mon 2024-10-28 12:32:00 UTC, ends at Mon 2024-10-28 12:41:05 UTC. --
	Oct 28 12:40:50 running-upgrade-343000 dockerd[2869]: time="2024-10-28T12:40:50.041720241Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Oct 28 12:40:50 running-upgrade-343000 dockerd[2869]: time="2024-10-28T12:40:50.041753824Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Oct 28 12:40:50 running-upgrade-343000 dockerd[2869]: time="2024-10-28T12:40:50.041768449Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Oct 28 12:40:50 running-upgrade-343000 dockerd[2869]: time="2024-10-28T12:40:50.041805156Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/307600fe5521638d3b8d2b657e368a3b919a7c2a0fff15bffdf8acb5e5e16d87 pid=18463 runtime=io.containerd.runc.v2
	Oct 28 12:40:50 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:50Z" level=error msg="ContainerStats resp: {0x40004cdd40 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x40006f3440 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x40006f3680 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x40006f37c0 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x400067c9c0 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x400074f140 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x400067dc00 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=error msg="ContainerStats resp: {0x40009c8000 linux}"
	Oct 28 12:40:51 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:51Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Oct 28 12:40:57 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:40:57Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Oct 28 12:41:02 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:02Z" level=info msg="Using CNI configuration file /etc/cni/net.d/1-k8s.conflist"
	Oct 28 12:41:02 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:02Z" level=error msg="ContainerStats resp: {0x40004cd600 linux}"
	Oct 28 12:41:02 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:02Z" level=error msg="ContainerStats resp: {0x4000358e40 linux}"
	Oct 28 12:41:03 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:03Z" level=error msg="ContainerStats resp: {0x400074f540 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x40000b8540 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x40007b0a80 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x400067c6c0 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x40007b1300 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x400067d240 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x40007b1b40 linux}"
	Oct 28 12:41:04 running-upgrade-343000 cri-dockerd[2712]: time="2024-10-28T12:41:04Z" level=error msg="ContainerStats resp: {0x4000824280 linux}"
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
	307600fe55216       edaa71f2aee88       15 seconds ago      Running             coredns                   2                   9ba3efc878620
	4bcf411dc5b9b       edaa71f2aee88       15 seconds ago      Running             coredns                   2                   ee01321f3ce03
	2c90a3e4a20a9       edaa71f2aee88       2 minutes ago       Exited              coredns                   1                   ee01321f3ce03
	c5f17bd00a16f       edaa71f2aee88       2 minutes ago       Exited              coredns                   1                   9ba3efc878620
	c785c0d9a3e1e       66749159455b3       4 minutes ago       Running             storage-provisioner       0                   0c511c22cd14a
	91edb87621dbb       fcbd620bbac08       4 minutes ago       Running             kube-proxy                0                   baef651cf42dd
	402c9c222e8d7       000c19baf6bba       4 minutes ago       Running             kube-scheduler            0                   016eb129dce50
	865e18703f88d       7c5896a75862a       4 minutes ago       Running             kube-apiserver            0                   a1a4bde4ab5c3
	8db3227b0119d       f61bbe9259d7c       4 minutes ago       Running             kube-controller-manager   0                   42852f5278409
	f235b8b08247d       a9a710bb96df0       4 minutes ago       Running             etcd                      0                   e220c9c749b4f
	
	
	==> coredns [2c90a3e4a20a] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:54528->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:39558->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:49920->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:44102->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:49613->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:54027->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:52636->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:53136->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:39370->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4244417575084772005.6417658703128932926. HINFO: read udp 10.244.0.3:59631->10.0.2.3:53: i/o timeout
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> coredns [307600fe5521] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 7421901527160011011.1917409110412608833. HINFO: read udp 10.244.0.2:33201->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 7421901527160011011.1917409110412608833. HINFO: read udp 10.244.0.2:51351->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 7421901527160011011.1917409110412608833. HINFO: read udp 10.244.0.2:57724->10.0.2.3:53: i/o timeout
	
	
	==> coredns [4bcf411dc5b9] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 4822459336617159705.7149509674339022412. HINFO: read udp 10.244.0.3:50880->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4822459336617159705.7149509674339022412. HINFO: read udp 10.244.0.3:33997->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 4822459336617159705.7149509674339022412. HINFO: read udp 10.244.0.3:45820->10.0.2.3:53: i/o timeout
	
	
	==> coredns [c5f17bd00a16] <==
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
	CoreDNS-1.8.6
	linux/arm64, go1.17.1, 13a9191
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:46352->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:45234->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:54404->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:56007->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:54829->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:55557->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:50356->10.0.2.3:53: i/o timeout
	[ERROR] plugin/errors: 2 3140635768009527837.2684632023343122657. HINFO: read udp 10.244.0.2:57371->10.0.2.3:53: i/o timeout
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> describe nodes <==
	Name:               running-upgrade-343000
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=running-upgrade-343000
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc
	                    minikube.k8s.io/name=running-upgrade-343000
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_10_28T05_36_48_0700
	                    minikube.k8s.io/version=v1.34.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 28 Oct 2024 12:36:46 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  running-upgrade-343000
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 28 Oct 2024 12:41:04 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 28 Oct 2024 12:36:48 +0000   Mon, 28 Oct 2024 12:36:44 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 28 Oct 2024 12:36:48 +0000   Mon, 28 Oct 2024 12:36:44 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 28 Oct 2024 12:36:48 +0000   Mon, 28 Oct 2024 12:36:44 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 28 Oct 2024 12:36:48 +0000   Mon, 28 Oct 2024 12:36:48 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  10.0.2.15
	  Hostname:    running-upgrade-343000
	Capacity:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             2148820Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             2148820Ki
	  pods:               110
	System Info:
	  Machine ID:                 af08b29778374c678b6b50fa7e34e3db
	  System UUID:                af08b29778374c678b6b50fa7e34e3db
	  Boot ID:                    fdf17a6d-ab73-48ab-9696-c90662388b89
	  Kernel Version:             5.10.57
	  OS Image:                   Buildroot 2021.02.12
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://20.10.16
	  Kubelet Version:            v1.24.1
	  Kube-Proxy Version:         v1.24.1
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-6d4b75cb6d-9md9k                          100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     4m4s
	  kube-system                 coredns-6d4b75cb6d-tsjgx                          100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     4m4s
	  kube-system                 etcd-running-upgrade-343000                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         4m17s
	  kube-system                 kube-apiserver-running-upgrade-343000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         4m17s
	  kube-system                 kube-controller-manager-running-upgrade-343000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         4m18s
	  kube-system                 kube-proxy-2zmqb                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m5s
	  kube-system                 kube-scheduler-running-upgrade-343000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         4m18s
	  kube-system                 storage-provisioner                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                850m (42%)   0 (0%)
	  memory             240Mi (11%)  340Mi (16%)
	  ephemeral-storage  0 (0%)       0 (0%)
	  hugepages-1Gi      0 (0%)       0 (0%)
	  hugepages-2Mi      0 (0%)       0 (0%)
	  hugepages-32Mi     0 (0%)       0 (0%)
	  hugepages-64Ki     0 (0%)       0 (0%)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 4m2s   kube-proxy       
	  Normal  NodeReady                4m17s  kubelet          Node running-upgrade-343000 status is now: NodeReady
	  Normal  NodeAllocatableEnforced  4m17s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  4m17s  kubelet          Node running-upgrade-343000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m17s  kubelet          Node running-upgrade-343000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m17s  kubelet          Node running-upgrade-343000 status is now: NodeHasSufficientPID
	  Normal  Starting                 4m17s  kubelet          Starting kubelet.
	  Normal  RegisteredNode           4m5s   node-controller  Node running-upgrade-343000 event: Registered Node running-upgrade-343000 in Controller
	
	
	==> dmesg <==
	[  +1.770867] systemd-fstab-generator[877]: Ignoring "noauto" for root device
	[  +0.082690] systemd-fstab-generator[888]: Ignoring "noauto" for root device
	[  +0.080435] systemd-fstab-generator[899]: Ignoring "noauto" for root device
	[  +1.137683] kauditd_printk_skb: 53 callbacks suppressed
	[  +0.088661] systemd-fstab-generator[1048]: Ignoring "noauto" for root device
	[  +0.076857] systemd-fstab-generator[1059]: Ignoring "noauto" for root device
	[  +2.776429] systemd-fstab-generator[1284]: Ignoring "noauto" for root device
	[  +9.167841] systemd-fstab-generator[1942]: Ignoring "noauto" for root device
	[  +2.679394] systemd-fstab-generator[2218]: Ignoring "noauto" for root device
	[  +0.146713] systemd-fstab-generator[2252]: Ignoring "noauto" for root device
	[  +0.094487] systemd-fstab-generator[2263]: Ignoring "noauto" for root device
	[  +0.096862] systemd-fstab-generator[2279]: Ignoring "noauto" for root device
	[  +1.383013] kauditd_printk_skb: 47 callbacks suppressed
	[  +0.132054] systemd-fstab-generator[2668]: Ignoring "noauto" for root device
	[  +0.075297] systemd-fstab-generator[2680]: Ignoring "noauto" for root device
	[  +0.079962] systemd-fstab-generator[2691]: Ignoring "noauto" for root device
	[  +0.100441] systemd-fstab-generator[2705]: Ignoring "noauto" for root device
	[  +2.301203] systemd-fstab-generator[2856]: Ignoring "noauto" for root device
	[  +3.182093] systemd-fstab-generator[3232]: Ignoring "noauto" for root device
	[  +1.212935] systemd-fstab-generator[3533]: Ignoring "noauto" for root device
	[ +17.039242] kauditd_printk_skb: 68 callbacks suppressed
	[Oct28 12:36] kauditd_printk_skb: 23 callbacks suppressed
	[  +1.414704] systemd-fstab-generator[11543]: Ignoring "noauto" for root device
	[  +5.129331] systemd-fstab-generator[12135]: Ignoring "noauto" for root device
	[  +0.478466] systemd-fstab-generator[12267]: Ignoring "noauto" for root device
	
	
	==> etcd [f235b8b08247] <==
	{"level":"info","ts":"2024-10-28T12:36:44.097Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 switched to configuration voters=(17326651331455243045)"}
	{"level":"info","ts":"2024-10-28T12:36:44.098Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"ef296cf39f5d9d66","local-member-id":"f074a195de705325","added-peer-id":"f074a195de705325","added-peer-peer-urls":["https://10.0.2.15:2380"]}
	{"level":"info","ts":"2024-10-28T12:36:44.099Z","caller":"embed/etcd.go:688","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2024-10-28T12:36:44.099Z","caller":"embed/etcd.go:277","msg":"now serving peer/client/metrics","local-member-id":"f074a195de705325","initial-advertise-peer-urls":["https://10.0.2.15:2380"],"listen-peer-urls":["https://10.0.2.15:2380"],"advertise-client-urls":["https://10.0.2.15:2379"],"listen-client-urls":["https://10.0.2.15:2379","https://127.0.0.1:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2024-10-28T12:36:44.099Z","caller":"embed/etcd.go:763","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2024-10-28T12:36:44.099Z","caller":"embed/etcd.go:581","msg":"serving peer traffic","address":"10.0.2.15:2380"}
	{"level":"info","ts":"2024-10-28T12:36:44.099Z","caller":"embed/etcd.go:553","msg":"cmux::serve","address":"10.0.2.15:2380"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 is starting a new election at term 1"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became pre-candidate at term 1"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 received MsgPreVoteResp from f074a195de705325 at term 1"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became candidate at term 2"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 received MsgVoteResp from f074a195de705325 at term 2"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f074a195de705325 became leader at term 2"}
	{"level":"info","ts":"2024-10-28T12:36:44.789Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: f074a195de705325 elected leader f074a195de705325 at term 2"}
	{"level":"info","ts":"2024-10-28T12:36:44.790Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2024-10-28T12:36:44.790Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"ef296cf39f5d9d66","local-member-id":"f074a195de705325","cluster-version":"3.5"}
	{"level":"info","ts":"2024-10-28T12:36:44.790Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2024-10-28T12:36:44.790Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2024-10-28T12:36:44.790Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"f074a195de705325","local-member-attributes":"{Name:running-upgrade-343000 ClientURLs:[https://10.0.2.15:2379]}","request-path":"/0/members/f074a195de705325/attributes","cluster-id":"ef296cf39f5d9d66","publish-timeout":"7s"}
	{"level":"info","ts":"2024-10-28T12:36:44.791Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-10-28T12:36:44.791Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2024-10-28T12:36:44.791Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2024-10-28T12:36:44.791Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
	{"level":"info","ts":"2024-10-28T12:36:44.792Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2024-10-28T12:36:44.792Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"10.0.2.15:2379"}
	
	
	==> kernel <==
	 12:41:05 up 9 min,  0 users,  load average: 0.11, 0.25, 0.15
	Linux running-upgrade-343000 5.10.57 #1 SMP PREEMPT Thu Jun 16 21:01:29 UTC 2022 aarch64 GNU/Linux
	PRETTY_NAME="Buildroot 2021.02.12"
	
	
	==> kube-apiserver [865e18703f88] <==
	I1028 12:36:45.993938       1 shared_informer.go:262] Caches are synced for node_authorizer
	I1028 12:36:45.995036       1 apf_controller.go:322] Running API Priority and Fairness config worker
	I1028 12:36:45.995063       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I1028 12:36:45.995076       1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
	I1028 12:36:45.995085       1 cache.go:39] Caches are synced for autoregister controller
	I1028 12:36:45.995047       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I1028 12:36:46.006796       1 shared_informer.go:262] Caches are synced for crd-autoregister
	I1028 12:36:46.723984       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I1028 12:36:46.899085       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
	I1028 12:36:46.901325       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
	I1028 12:36:46.901380       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I1028 12:36:47.052015       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I1028 12:36:47.062239       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I1028 12:36:47.160750       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]
	W1028 12:36:47.162436       1 lease.go:234] Resetting endpoints for master service "kubernetes" to [10.0.2.15]
	I1028 12:36:47.162823       1 controller.go:611] quota admission added evaluator for: endpoints
	I1028 12:36:47.164020       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I1028 12:36:48.021601       1 controller.go:611] quota admission added evaluator for: serviceaccounts
	I1028 12:36:48.408525       1 controller.go:611] quota admission added evaluator for: deployments.apps
	I1028 12:36:48.411555       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]
	I1028 12:36:48.415784       1 controller.go:611] quota admission added evaluator for: daemonsets.apps
	I1028 12:36:48.465746       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
	I1028 12:37:00.925245       1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps
	I1028 12:37:01.426071       1 controller.go:611] quota admission added evaluator for: replicasets.apps
	I1028 12:37:02.952468       1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
	
	
	==> kube-controller-manager [8db3227b0119] <==
	I1028 12:37:00.871697       1 shared_informer.go:262] Caches are synced for cronjob
	I1028 12:37:00.871716       1 shared_informer.go:262] Caches are synced for stateful set
	I1028 12:37:00.873860       1 shared_informer.go:262] Caches are synced for taint
	I1028 12:37:00.873867       1 shared_informer.go:262] Caches are synced for job
	I1028 12:37:00.873902       1 node_lifecycle_controller.go:1399] Initializing eviction metric for zone: 
	W1028 12:37:00.873927       1 node_lifecycle_controller.go:1014] Missing timestamp for Node running-upgrade-343000. Assuming now as a timestamp.
	I1028 12:37:00.873949       1 node_lifecycle_controller.go:1215] Controller detected that zone  is now in state Normal.
	I1028 12:37:00.873965       1 taint_manager.go:187] "Starting NoExecuteTaintManager"
	I1028 12:37:00.874074       1 event.go:294] "Event occurred" object="running-upgrade-343000" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node running-upgrade-343000 event: Registered Node running-upgrade-343000 in Controller"
	I1028 12:37:00.874107       1 shared_informer.go:262] Caches are synced for ephemeral
	I1028 12:37:00.874550       1 shared_informer.go:262] Caches are synced for ClusterRoleAggregator
	I1028 12:37:00.874822       1 shared_informer.go:262] Caches are synced for bootstrap_signer
	I1028 12:37:00.922075       1 shared_informer.go:262] Caches are synced for persistent volume
	I1028 12:37:00.923717       1 shared_informer.go:262] Caches are synced for PV protection
	I1028 12:37:00.924937       1 shared_informer.go:262] Caches are synced for attach detach
	I1028 12:37:00.927846       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-2zmqb"
	I1028 12:37:00.961393       1 shared_informer.go:262] Caches are synced for expand
	I1028 12:37:01.050468       1 shared_informer.go:262] Caches are synced for resource quota
	I1028 12:37:01.077029       1 shared_informer.go:262] Caches are synced for resource quota
	I1028 12:37:01.427886       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
	I1028 12:37:01.488753       1 shared_informer.go:262] Caches are synced for garbage collector
	I1028 12:37:01.543554       1 shared_informer.go:262] Caches are synced for garbage collector
	I1028 12:37:01.543572       1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I1028 12:37:01.875706       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-tsjgx"
	I1028 12:37:01.880248       1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-6d4b75cb6d-9md9k"
	
	
	==> kube-proxy [91edb87621db] <==
	I1028 12:37:02.939892       1 node.go:163] Successfully retrieved node IP: 10.0.2.15
	I1028 12:37:02.940030       1 server_others.go:138] "Detected node IP" address="10.0.2.15"
	I1028 12:37:02.940074       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
	I1028 12:37:02.950342       1 server_others.go:199] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
	I1028 12:37:02.950352       1 server_others.go:206] "Using iptables Proxier"
	I1028 12:37:02.950424       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
	I1028 12:37:02.950610       1 server.go:661] "Version info" version="v1.24.1"
	I1028 12:37:02.950617       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1028 12:37:02.950949       1 config.go:317] "Starting service config controller"
	I1028 12:37:02.950995       1 shared_informer.go:255] Waiting for caches to sync for service config
	I1028 12:37:02.951011       1 config.go:226] "Starting endpoint slice config controller"
	I1028 12:37:02.951048       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
	I1028 12:37:02.951401       1 config.go:444] "Starting node config controller"
	I1028 12:37:02.951405       1 shared_informer.go:255] Waiting for caches to sync for node config
	I1028 12:37:03.051451       1 shared_informer.go:262] Caches are synced for endpoint slice config
	I1028 12:37:03.051465       1 shared_informer.go:262] Caches are synced for service config
	I1028 12:37:03.051452       1 shared_informer.go:262] Caches are synced for node config
	
	
	==> kube-scheduler [402c9c222e8d] <==
	W1028 12:36:45.954024       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1028 12:36:45.954582       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W1028 12:36:45.954037       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1028 12:36:45.954586       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W1028 12:36:45.954050       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E1028 12:36:45.954591       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W1028 12:36:45.954120       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E1028 12:36:45.954596       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W1028 12:36:45.954165       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E1028 12:36:45.954600       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W1028 12:36:45.954252       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1028 12:36:45.954606       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W1028 12:36:45.955403       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1028 12:36:45.955458       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W1028 12:36:46.861992       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E1028 12:36:46.862023       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W1028 12:36:46.864544       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1028 12:36:46.864566       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W1028 12:36:46.956578       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1028 12:36:46.956595       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W1028 12:36:46.965173       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1028 12:36:46.965239       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W1028 12:36:47.038999       1 reflector.go:324] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1028 12:36:47.039085       1 reflector.go:138] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I1028 12:36:49.951980       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	-- Journal begins at Mon 2024-10-28 12:32:00 UTC, ends at Mon 2024-10-28 12:41:05 UTC. --
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.060920   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/7f24f422-18c6-47a2-a494-4c6212cc0db9-xtables-lock\") pod \"kube-proxy-2zmqb\" (UID: \"7f24f422-18c6-47a2-a494-4c6212cc0db9\") " pod="kube-system/kube-proxy-2zmqb"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.060937   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f24f422-18c6-47a2-a494-4c6212cc0db9-lib-modules\") pod \"kube-proxy-2zmqb\" (UID: \"7f24f422-18c6-47a2-a494-4c6212cc0db9\") " pod="kube-system/kube-proxy-2zmqb"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.060948   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-proxy\") pod \"kube-proxy-2zmqb\" (UID: \"7f24f422-18c6-47a2-a494-4c6212cc0db9\") " pod="kube-system/kube-proxy-2zmqb"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.060958   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8vr\" (UniqueName: \"kubernetes.io/projected/19877f88-cad9-42ea-8503-5bfbba657c05-kube-api-access-ss8vr\") pod \"storage-provisioner\" (UID: \"19877f88-cad9-42ea-8503-5bfbba657c05\") " pod="kube-system/storage-provisioner"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.060970   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwr5b\" (UniqueName: \"kubernetes.io/projected/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-api-access-dwr5b\") pod \"kube-proxy-2zmqb\" (UID: \"7f24f422-18c6-47a2-a494-4c6212cc0db9\") " pod="kube-system/kube-proxy-2zmqb"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166645   12141 projected.go:286] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166662   12141 projected.go:192] Error preparing data for projected volume kube-api-access-dwr5b for pod kube-system/kube-proxy-2zmqb: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166692   12141 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/projected/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-api-access-dwr5b podName:7f24f422-18c6-47a2-a494-4c6212cc0db9 nodeName:}" failed. No retries permitted until 2024-10-28 12:37:01.666680296 +0000 UTC m=+13.269113836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dwr5b" (UniqueName: "kubernetes.io/projected/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-api-access-dwr5b") pod "kube-proxy-2zmqb" (UID: "7f24f422-18c6-47a2-a494-4c6212cc0db9") : configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166767   12141 projected.go:286] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166777   12141 projected.go:192] Error preparing data for projected volume kube-api-access-ss8vr for pod kube-system/storage-provisioner: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.166793   12141 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/projected/19877f88-cad9-42ea-8503-5bfbba657c05-kube-api-access-ss8vr podName:19877f88-cad9-42ea-8503-5bfbba657c05 nodeName:}" failed. No retries permitted until 2024-10-28 12:37:01.666787628 +0000 UTC m=+13.269221168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ss8vr" (UniqueName: "kubernetes.io/projected/19877f88-cad9-42ea-8503-5bfbba657c05-kube-api-access-ss8vr") pod "storage-provisioner" (UID: "19877f88-cad9-42ea-8503-5bfbba657c05") : configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675361   12141 projected.go:286] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675377   12141 projected.go:192] Error preparing data for projected volume kube-api-access-dwr5b for pod kube-system/kube-proxy-2zmqb: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675402   12141 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/projected/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-api-access-dwr5b podName:7f24f422-18c6-47a2-a494-4c6212cc0db9 nodeName:}" failed. No retries permitted until 2024-10-28 12:37:02.675392691 +0000 UTC m=+14.277826273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwr5b" (UniqueName: "kubernetes.io/projected/7f24f422-18c6-47a2-a494-4c6212cc0db9-kube-api-access-dwr5b") pod "kube-proxy-2zmqb" (UID: "7f24f422-18c6-47a2-a494-4c6212cc0db9") : configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675641   12141 projected.go:286] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675645   12141 projected.go:192] Error preparing data for projected volume kube-api-access-ss8vr for pod kube-system/storage-provisioner: configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: E1028 12:37:01.675657   12141 nestedpendingoperations.go:335] Operation for "{volumeName:kubernetes.io/projected/19877f88-cad9-42ea-8503-5bfbba657c05-kube-api-access-ss8vr podName:19877f88-cad9-42ea-8503-5bfbba657c05 nodeName:}" failed. No retries permitted until 2024-10-28 12:37:02.675652729 +0000 UTC m=+14.278086311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ss8vr" (UniqueName: "kubernetes.io/projected/19877f88-cad9-42ea-8503-5bfbba657c05-kube-api-access-ss8vr") pod "storage-provisioner" (UID: "19877f88-cad9-42ea-8503-5bfbba657c05") : configmap "kube-root-ca.crt" not found
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.879380   12141 topology_manager.go:200] "Topology Admit Handler"
	Oct 28 12:37:01 running-upgrade-343000 kubelet[12141]: I1028 12:37:01.881668   12141 topology_manager.go:200] "Topology Admit Handler"
	Oct 28 12:37:02 running-upgrade-343000 kubelet[12141]: I1028 12:37:02.078004   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f4ad7a89-adad-4785-b7a9-c1fd6ee312d1-config-volume\") pod \"coredns-6d4b75cb6d-9md9k\" (UID: \"f4ad7a89-adad-4785-b7a9-c1fd6ee312d1\") " pod="kube-system/coredns-6d4b75cb6d-9md9k"
	Oct 28 12:37:02 running-upgrade-343000 kubelet[12141]: I1028 12:37:02.078048   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckdp\" (UniqueName: \"kubernetes.io/projected/f4ad7a89-adad-4785-b7a9-c1fd6ee312d1-kube-api-access-6ckdp\") pod \"coredns-6d4b75cb6d-9md9k\" (UID: \"f4ad7a89-adad-4785-b7a9-c1fd6ee312d1\") " pod="kube-system/coredns-6d4b75cb6d-9md9k"
	Oct 28 12:37:02 running-upgrade-343000 kubelet[12141]: I1028 12:37:02.078065   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpx2d\" (UniqueName: \"kubernetes.io/projected/0b3fe5bd-a3bc-47e5-97ab-5e2edb1fdd92-kube-api-access-hpx2d\") pod \"coredns-6d4b75cb6d-tsjgx\" (UID: \"0b3fe5bd-a3bc-47e5-97ab-5e2edb1fdd92\") " pod="kube-system/coredns-6d4b75cb6d-tsjgx"
	Oct 28 12:37:02 running-upgrade-343000 kubelet[12141]: I1028 12:37:02.078078   12141 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0b3fe5bd-a3bc-47e5-97ab-5e2edb1fdd92-config-volume\") pod \"coredns-6d4b75cb6d-tsjgx\" (UID: \"0b3fe5bd-a3bc-47e5-97ab-5e2edb1fdd92\") " pod="kube-system/coredns-6d4b75cb6d-tsjgx"
	Oct 28 12:40:50 running-upgrade-343000 kubelet[12141]: I1028 12:40:50.896594   12141 scope.go:110] "RemoveContainer" containerID="46ceb5be449dc25b96a549b21aad535cd3f3bc7ab6d835c5e518449e88770532"
	Oct 28 12:40:50 running-upgrade-343000 kubelet[12141]: I1028 12:40:50.912065   12141 scope.go:110] "RemoveContainer" containerID="26c0d9578065506a34befaa33d8b55d183b1aea6ab11f5be4ac7c76a3312e427"
	
	
	==> storage-provisioner [c785c0d9a3e1] <==
	I1028 12:37:02.906678       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1028 12:37:02.914987       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1028 12:37:02.915079       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1028 12:37:02.920459       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1028 12:37:02.921134       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b42c7f60-ee2f-4cbe-b6ad-fe44e0cb29f8", APIVersion:"v1", ResourceVersion:"370", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' running-upgrade-343000_e4daad42-68dd-49f0-a8db-1dd104ddc3b6 became leader
	I1028 12:37:02.921183       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_running-upgrade-343000_e4daad42-68dd-49f0-a8db-1dd104ddc3b6!
	I1028 12:37:03.023517       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_running-upgrade-343000_e4daad42-68dd-49f0-a8db-1dd104ddc3b6!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p running-upgrade-343000 -n running-upgrade-343000
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.APIServer}} -p running-upgrade-343000 -n running-upgrade-343000: exit status 2 (15.574340458s)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "running-upgrade-343000" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-343000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p running-upgrade-343000
--- FAIL: TestRunningBinaryUpgrade (589.49s)

                                                
                                    
x
+
TestKubernetesUpgrade (19.08s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (9.942603709s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-386000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kubernetes-upgrade-386000" primary control-plane node in "kubernetes-upgrade-386000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubernetes-upgrade-386000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:34:32.461784   13962 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:34:32.461961   13962 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:34:32.461964   13962 out.go:358] Setting ErrFile to fd 2...
	I1028 05:34:32.461966   13962 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:34:32.462113   13962 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:34:32.463269   13962 out.go:352] Setting JSON to false
	I1028 05:34:32.480912   13962 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7443,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:34:32.480985   13962 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:34:32.487367   13962 out.go:177] * [kubernetes-upgrade-386000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:34:32.494464   13962 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:34:32.494511   13962 notify.go:220] Checking for updates...
	I1028 05:34:32.499777   13962 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:34:32.502346   13962 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:34:32.506327   13962 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:34:32.507421   13962 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:34:32.510329   13962 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:34:32.513648   13962 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:34:32.513718   13962 config.go:182] Loaded profile config "running-upgrade-343000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:34:32.513788   13962 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:34:32.518206   13962 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:34:32.525309   13962 start.go:297] selected driver: qemu2
	I1028 05:34:32.525315   13962 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:34:32.525320   13962 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:34:32.527752   13962 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:34:32.531198   13962 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:34:32.534378   13962 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:34:32.534398   13962 cni.go:84] Creating CNI manager for ""
	I1028 05:34:32.534417   13962 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1028 05:34:32.534446   13962 start.go:340] cluster config:
	{Name:kubernetes-upgrade-386000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-386000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:34:32.538596   13962 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:34:32.546244   13962 out.go:177] * Starting "kubernetes-upgrade-386000" primary control-plane node in "kubernetes-upgrade-386000" cluster
	I1028 05:34:32.552363   13962 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:34:32.552382   13962 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:34:32.552390   13962 cache.go:56] Caching tarball of preloaded images
	I1028 05:34:32.552474   13962 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:34:32.552480   13962 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I1028 05:34:32.552539   13962 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kubernetes-upgrade-386000/config.json ...
	I1028 05:34:32.552550   13962 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kubernetes-upgrade-386000/config.json: {Name:mkc43575233dd1b75f14d279bd0be4bc2cc63594 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:34:32.552775   13962 start.go:360] acquireMachinesLock for kubernetes-upgrade-386000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:34:32.552820   13962 start.go:364] duration metric: took 37.667µs to acquireMachinesLock for "kubernetes-upgrade-386000"
	I1028 05:34:32.552831   13962 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-386000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-386000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:34:32.552855   13962 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:34:32.556381   13962 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:34:32.581940   13962 start.go:159] libmachine.API.Create for "kubernetes-upgrade-386000" (driver="qemu2")
	I1028 05:34:32.581990   13962 client.go:168] LocalClient.Create starting
	I1028 05:34:32.582088   13962 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:34:32.582130   13962 main.go:141] libmachine: Decoding PEM data...
	I1028 05:34:32.582139   13962 main.go:141] libmachine: Parsing certificate...
	I1028 05:34:32.582179   13962 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:34:32.582209   13962 main.go:141] libmachine: Decoding PEM data...
	I1028 05:34:32.582218   13962 main.go:141] libmachine: Parsing certificate...
	I1028 05:34:32.582590   13962 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:34:32.752526   13962 main.go:141] libmachine: Creating SSH key...
	I1028 05:34:32.809411   13962 main.go:141] libmachine: Creating Disk image...
	I1028 05:34:32.809420   13962 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:34:32.809624   13962 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:32.820738   13962 main.go:141] libmachine: STDOUT: 
	I1028 05:34:32.820759   13962 main.go:141] libmachine: STDERR: 
	I1028 05:34:32.820814   13962 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2 +20000M
	I1028 05:34:32.829678   13962 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:34:32.829698   13962 main.go:141] libmachine: STDERR: 
	I1028 05:34:32.829721   13962 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:32.829726   13962 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:34:32.829737   13962 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:34:32.829769   13962 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:9b:a7:6b:f7:e0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:32.831598   13962 main.go:141] libmachine: STDOUT: 
	I1028 05:34:32.831610   13962 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:34:32.831630   13962 client.go:171] duration metric: took 249.633917ms to LocalClient.Create
	I1028 05:34:34.833728   13962 start.go:128] duration metric: took 2.280853292s to createHost
	I1028 05:34:34.833745   13962 start.go:83] releasing machines lock for "kubernetes-upgrade-386000", held for 2.280916291s
	W1028 05:34:34.833757   13962 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:34:34.844165   13962 out.go:177] * Deleting "kubernetes-upgrade-386000" in qemu2 ...
	W1028 05:34:34.854645   13962 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:34:34.854660   13962 start.go:729] Will try again in 5 seconds ...
	I1028 05:34:39.856853   13962 start.go:360] acquireMachinesLock for kubernetes-upgrade-386000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:34:39.857504   13962 start.go:364] duration metric: took 542.083µs to acquireMachinesLock for "kubernetes-upgrade-386000"
	I1028 05:34:39.857655   13962 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-386000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-386000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:34:39.857845   13962 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:34:39.867596   13962 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:34:39.916538   13962 start.go:159] libmachine.API.Create for "kubernetes-upgrade-386000" (driver="qemu2")
	I1028 05:34:39.916582   13962 client.go:168] LocalClient.Create starting
	I1028 05:34:39.916730   13962 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:34:39.916821   13962 main.go:141] libmachine: Decoding PEM data...
	I1028 05:34:39.916839   13962 main.go:141] libmachine: Parsing certificate...
	I1028 05:34:39.916902   13962 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:34:39.916961   13962 main.go:141] libmachine: Decoding PEM data...
	I1028 05:34:39.916986   13962 main.go:141] libmachine: Parsing certificate...
	I1028 05:34:39.917806   13962 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:34:40.088445   13962 main.go:141] libmachine: Creating SSH key...
	I1028 05:34:40.302686   13962 main.go:141] libmachine: Creating Disk image...
	I1028 05:34:40.302698   13962 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:34:40.302955   13962 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:40.313484   13962 main.go:141] libmachine: STDOUT: 
	I1028 05:34:40.313508   13962 main.go:141] libmachine: STDERR: 
	I1028 05:34:40.313571   13962 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2 +20000M
	I1028 05:34:40.322469   13962 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:34:40.322481   13962 main.go:141] libmachine: STDERR: 
	I1028 05:34:40.322494   13962 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:40.322498   13962 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:34:40.322509   13962 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:34:40.322544   13962 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:d8:74:74:74:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:40.324388   13962 main.go:141] libmachine: STDOUT: 
	I1028 05:34:40.324402   13962 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:34:40.324415   13962 client.go:171] duration metric: took 407.827417ms to LocalClient.Create
	I1028 05:34:42.326642   13962 start.go:128] duration metric: took 2.468748083s to createHost
	I1028 05:34:42.326723   13962 start.go:83] releasing machines lock for "kubernetes-upgrade-386000", held for 2.469185583s
	W1028 05:34:42.327227   13962 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-386000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-386000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:34:42.341079   13962 out.go:201] 
	W1028 05:34:42.344102   13962 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:34:42.344141   13962 out.go:270] * 
	* 
	W1028 05:34:42.346740   13962 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:34:42.357967   13962 out.go:201] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-arm64 stop -p kubernetes-upgrade-386000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-arm64 stop -p kubernetes-upgrade-386000: (3.708290375s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-arm64 -p kubernetes-upgrade-386000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p kubernetes-upgrade-386000 status --format={{.Host}}: exit status 7 (62.889666ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (5.188926167s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-386000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "kubernetes-upgrade-386000" primary control-plane node in "kubernetes-upgrade-386000" cluster
	* Restarting existing qemu2 VM for "kubernetes-upgrade-386000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "kubernetes-upgrade-386000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:34:46.178971   13999 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:34:46.179129   13999 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:34:46.179132   13999 out.go:358] Setting ErrFile to fd 2...
	I1028 05:34:46.179135   13999 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:34:46.179250   13999 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:34:46.180358   13999 out.go:352] Setting JSON to false
	I1028 05:34:46.198542   13999 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7457,"bootTime":1730111429,"procs":521,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:34:46.198617   13999 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:34:46.203208   13999 out.go:177] * [kubernetes-upgrade-386000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:34:46.211296   13999 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:34:46.211378   13999 notify.go:220] Checking for updates...
	I1028 05:34:46.219238   13999 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:34:46.222249   13999 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:34:46.226215   13999 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:34:46.229261   13999 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:34:46.232123   13999 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:34:46.235487   13999 config.go:182] Loaded profile config "kubernetes-upgrade-386000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I1028 05:34:46.235743   13999 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:34:46.240225   13999 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:34:46.247185   13999 start.go:297] selected driver: qemu2
	I1028 05:34:46.247192   13999 start.go:901] validating driver "qemu2" against &{Name:kubernetes-upgrade-386000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-386000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:34:46.247246   13999 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:34:46.249917   13999 cni.go:84] Creating CNI manager for ""
	I1028 05:34:46.249954   13999 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:34:46.249973   13999 start.go:340] cluster config:
	{Name:kubernetes-upgrade-386000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:kubernetes-upgrade-386000 Namespace:
default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnet
ClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:34:46.254370   13999 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:34:46.262186   13999 out.go:177] * Starting "kubernetes-upgrade-386000" primary control-plane node in "kubernetes-upgrade-386000" cluster
	I1028 05:34:46.266258   13999 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:34:46.266276   13999 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:34:46.266292   13999 cache.go:56] Caching tarball of preloaded images
	I1028 05:34:46.266375   13999 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:34:46.266380   13999 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:34:46.266443   13999 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kubernetes-upgrade-386000/config.json ...
	I1028 05:34:46.266918   13999 start.go:360] acquireMachinesLock for kubernetes-upgrade-386000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:34:46.266948   13999 start.go:364] duration metric: took 21.75µs to acquireMachinesLock for "kubernetes-upgrade-386000"
	I1028 05:34:46.266956   13999 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:34:46.266961   13999 fix.go:54] fixHost starting: 
	I1028 05:34:46.267072   13999 fix.go:112] recreateIfNeeded on kubernetes-upgrade-386000: state=Stopped err=<nil>
	W1028 05:34:46.267090   13999 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:34:46.274263   13999 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-386000" ...
	I1028 05:34:46.278154   13999 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:34:46.278198   13999 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:d8:74:74:74:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:46.280259   13999 main.go:141] libmachine: STDOUT: 
	I1028 05:34:46.280275   13999 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:34:46.280299   13999 fix.go:56] duration metric: took 13.338083ms for fixHost
	I1028 05:34:46.280303   13999 start.go:83] releasing machines lock for "kubernetes-upgrade-386000", held for 13.350708ms
	W1028 05:34:46.280307   13999 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:34:46.280348   13999 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:34:46.280351   13999 start.go:729] Will try again in 5 seconds ...
	I1028 05:34:51.282504   13999 start.go:360] acquireMachinesLock for kubernetes-upgrade-386000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:34:51.282880   13999 start.go:364] duration metric: took 300.875µs to acquireMachinesLock for "kubernetes-upgrade-386000"
	I1028 05:34:51.282961   13999 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:34:51.282974   13999 fix.go:54] fixHost starting: 
	I1028 05:34:51.283466   13999 fix.go:112] recreateIfNeeded on kubernetes-upgrade-386000: state=Stopped err=<nil>
	W1028 05:34:51.283484   13999 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:34:51.287846   13999 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-386000" ...
	I1028 05:34:51.291898   13999 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:34:51.292013   13999 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:d8:74:74:74:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubernetes-upgrade-386000/disk.qcow2
	I1028 05:34:51.300430   13999 main.go:141] libmachine: STDOUT: 
	I1028 05:34:51.300498   13999 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:34:51.300561   13999 fix.go:56] duration metric: took 17.58725ms for fixHost
	I1028 05:34:51.300575   13999 start.go:83] releasing machines lock for "kubernetes-upgrade-386000", held for 17.679209ms
	W1028 05:34:51.300749   13999 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-386000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-386000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:34:51.308832   13999 out.go:201] 
	W1028 05:34:51.312932   13999 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:34:51.312951   13999 out.go:270] * 
	* 
	W1028 05:34:51.314524   13999 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:34:51.324799   13999 out.go:201] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-arm64 start -p kubernetes-upgrade-386000 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=qemu2  : exit status 80
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-386000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-386000 version --output=json: exit status 1 (53.695125ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-386000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:629: *** TestKubernetesUpgrade FAILED at 2024-10-28 05:34:51.390106 -0700 PDT m=+875.667479584
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-386000 -n kubernetes-upgrade-386000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-386000 -n kubernetes-upgrade-386000: exit status 7 (36.78375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-386000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-386000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p kubernetes-upgrade-386000
--- FAIL: TestKubernetesUpgrade (19.08s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.34.0 on darwin (arm64)
- MINIKUBE_LOCATION=19865
- KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2669785442/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.01s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.34.0 on darwin (arm64)
- MINIKUBE_LOCATION=19865
- KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2886293233/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.01s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (572.19s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3392287415 start -p stopped-upgrade-871000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:183: (dbg) Done: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3392287415 start -p stopped-upgrade-871000 --memory=2200 --vm-driver=qemu2 : (38.645556625s)
version_upgrade_test.go:192: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3392287415 -p stopped-upgrade-871000 stop
version_upgrade_test.go:192: (dbg) Done: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.26.0.3392287415 -p stopped-upgrade-871000 stop: (12.120518625s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-darwin-arm64 start -p stopped-upgrade-871000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:198: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p stopped-upgrade-871000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (8m41.344902667s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-871000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	* Using the qemu2 driver based on existing profile
	* Starting "stopped-upgrade-871000" primary control-plane node in "stopped-upgrade-871000" cluster
	* Restarting existing qemu2 VM for "stopped-upgrade-871000" ...
	* Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	  - Generating certificates and keys ...
	  - Booting up control plane ...
	  - Configuring RBAC rules ...
	* Configuring bridge CNI (Container Networking Interface) ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	* Enabled addons: storage-provisioner
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:35:43.332785   14044 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:35:43.332991   14044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:35:43.332995   14044 out.go:358] Setting ErrFile to fd 2...
	I1028 05:35:43.332998   14044 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:35:43.333143   14044 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:35:43.334495   14044 out.go:352] Setting JSON to false
	I1028 05:35:43.354665   14044 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7514,"bootTime":1730111429,"procs":524,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:35:43.354736   14044 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:35:43.358322   14044 out.go:177] * [stopped-upgrade-871000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:35:43.365351   14044 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:35:43.365427   14044 notify.go:220] Checking for updates...
	I1028 05:35:43.372338   14044 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:35:43.375418   14044 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:35:43.379358   14044 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:35:43.382412   14044 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:35:43.385448   14044 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:35:43.388655   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:35:43.392347   14044 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	I1028 05:35:43.395441   14044 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:35:43.398352   14044 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:35:43.405484   14044 start.go:297] selected driver: qemu2
	I1028 05:35:43.405496   14044 start.go:901] validating driver "qemu2" against &{Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgra
de-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizat
ions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:35:43.405553   14044 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:35:43.408183   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:35:43.408212   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:35:43.408243   14044 start.go:340] cluster config:
	{Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:35:43.408294   14044 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:35:43.417378   14044 out.go:177] * Starting "stopped-upgrade-871000" primary control-plane node in "stopped-upgrade-871000" cluster
	I1028 05:35:43.420242   14044 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:35:43.420259   14044 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4
	I1028 05:35:43.420266   14044 cache.go:56] Caching tarball of preloaded images
	I1028 05:35:43.420328   14044 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:35:43.420334   14044 cache.go:59] Finished verifying existence of preloaded tar for v1.24.1 on docker
	I1028 05:35:43.420386   14044 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/config.json ...
	I1028 05:35:43.420844   14044 start.go:360] acquireMachinesLock for stopped-upgrade-871000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:35:43.420877   14044 start.go:364] duration metric: took 25.667µs to acquireMachinesLock for "stopped-upgrade-871000"
	I1028 05:35:43.420885   14044 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:35:43.420890   14044 fix.go:54] fixHost starting: 
	I1028 05:35:43.420997   14044 fix.go:112] recreateIfNeeded on stopped-upgrade-871000: state=Stopped err=<nil>
	W1028 05:35:43.421004   14044 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:35:43.424449   14044 out.go:177] * Restarting existing qemu2 VM for "stopped-upgrade-871000" ...
	I1028 05:35:43.432327   14044 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:35:43.432403   14044 main.go:141] libmachine: executing: qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/9.1.1/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/qemu.pid -nic user,model=virtio,hostfwd=tcp::59232-:22,hostfwd=tcp::59233-:2376,hostname=stopped-upgrade-871000 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/disk.qcow2
	I1028 05:35:43.478524   14044 main.go:141] libmachine: STDOUT: 
	I1028 05:35:43.478568   14044 main.go:141] libmachine: STDERR: 
	I1028 05:35:43.478575   14044 main.go:141] libmachine: Waiting for VM to start (ssh -p 59232 docker@127.0.0.1)...
	I1028 05:36:02.963563   14044 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/config.json ...
	I1028 05:36:02.964105   14044 machine.go:93] provisionDockerMachine start ...
	I1028 05:36:02.964223   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:02.964547   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:02.964557   14044 main.go:141] libmachine: About to run SSH command:
	hostname
	I1028 05:36:03.036927   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube
	
	I1028 05:36:03.036944   14044 buildroot.go:166] provisioning hostname "stopped-upgrade-871000"
	I1028 05:36:03.037024   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.037137   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.037143   14044 main.go:141] libmachine: About to run SSH command:
	sudo hostname stopped-upgrade-871000 && echo "stopped-upgrade-871000" | sudo tee /etc/hostname
	I1028 05:36:03.101120   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: stopped-upgrade-871000
	
	I1028 05:36:03.101194   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.101309   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.101317   14044 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sstopped-upgrade-871000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 stopped-upgrade-871000/g' /etc/hosts;
				else 
					echo '127.0.1.1 stopped-upgrade-871000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1028 05:36:03.163111   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 05:36:03.163123   14044 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19865-11397/.minikube CaCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19865-11397/.minikube}
	I1028 05:36:03.163129   14044 buildroot.go:174] setting up certificates
	I1028 05:36:03.163134   14044 provision.go:84] configureAuth start
	I1028 05:36:03.163140   14044 provision.go:143] copyHostCerts
	I1028 05:36:03.163216   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem, removing ...
	I1028 05:36:03.163222   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem
	I1028 05:36:03.163474   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/cert.pem (1123 bytes)
	I1028 05:36:03.164389   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem, removing ...
	I1028 05:36:03.164395   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem
	I1028 05:36:03.164462   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/key.pem (1679 bytes)
	I1028 05:36:03.164595   14044 exec_runner.go:144] found /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem, removing ...
	I1028 05:36:03.164599   14044 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem
	I1028 05:36:03.164655   14044 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.pem (1078 bytes)
	I1028 05:36:03.164746   14044 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem org=jenkins.stopped-upgrade-871000 san=[127.0.0.1 localhost minikube stopped-upgrade-871000]
	I1028 05:36:03.345080   14044 provision.go:177] copyRemoteCerts
	I1028 05:36:03.345138   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1028 05:36:03.345148   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.378487   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I1028 05:36:03.385141   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
	I1028 05:36:03.391875   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I1028 05:36:03.399136   14044 provision.go:87] duration metric: took 235.993917ms to configureAuth
	I1028 05:36:03.399146   14044 buildroot.go:189] setting minikube options for container-runtime
	I1028 05:36:03.399250   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:36:03.399300   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.399412   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.399417   14044 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1028 05:36:03.461135   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I1028 05:36:03.461144   14044 buildroot.go:70] root file system type: tmpfs
	I1028 05:36:03.461197   14044 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
	I1028 05:36:03.461257   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.461365   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.461400   14044 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1028 05:36:03.526494   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1028 05:36:03.526570   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.526686   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.526695   14044 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1028 05:36:03.877398   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
	
	I1028 05:36:03.877413   14044 machine.go:96] duration metric: took 913.297042ms to provisionDockerMachine
	I1028 05:36:03.877419   14044 start.go:293] postStartSetup for "stopped-upgrade-871000" (driver="qemu2")
	I1028 05:36:03.877426   14044 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1028 05:36:03.877494   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1028 05:36:03.877504   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.907751   14044 ssh_runner.go:195] Run: cat /etc/os-release
	I1028 05:36:03.909147   14044 info.go:137] Remote host: Buildroot 2021.02.12
	I1028 05:36:03.909158   14044 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/addons for local assets ...
	I1028 05:36:03.909258   14044 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19865-11397/.minikube/files for local assets ...
	I1028 05:36:03.909407   14044 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem -> 119092.pem in /etc/ssl/certs
	I1028 05:36:03.909575   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1028 05:36:03.911968   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:36:03.919367   14044 start.go:296] duration metric: took 41.94275ms for postStartSetup
	I1028 05:36:03.919379   14044 fix.go:56] duration metric: took 20.498448291s for fixHost
	I1028 05:36:03.919416   14044 main.go:141] libmachine: Using SSH client type: native
	I1028 05:36:03.919524   14044 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1007525f0] 0x100754e30 <nil>  [] 0s} localhost 59232 <nil> <nil>}
	I1028 05:36:03.919531   14044 main.go:141] libmachine: About to run SSH command:
	date +%s.%N
	I1028 05:36:03.980366   14044 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730118963.647835087
	
	I1028 05:36:03.980375   14044 fix.go:216] guest clock: 1730118963.647835087
	I1028 05:36:03.980379   14044 fix.go:229] Guest: 2024-10-28 05:36:03.647835087 -0700 PDT Remote: 2024-10-28 05:36:03.919381 -0700 PDT m=+20.621373876 (delta=-271.545913ms)
	I1028 05:36:03.980391   14044 fix.go:200] guest clock delta is within tolerance: -271.545913ms
	I1028 05:36:03.980395   14044 start.go:83] releasing machines lock for "stopped-upgrade-871000", held for 20.559470459s
	I1028 05:36:03.980485   14044 ssh_runner.go:195] Run: cat /version.json
	I1028 05:36:03.980495   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:36:03.981175   14044 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1028 05:36:03.981198   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	W1028 05:36:04.013321   14044 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I1028 05:36:04.013379   14044 ssh_runner.go:195] Run: systemctl --version
	I1028 05:36:04.055659   14044 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W1028 05:36:04.057468   14044 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I1028 05:36:04.057512   14044 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I1028 05:36:04.060459   14044 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I1028 05:36:04.065467   14044 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1028 05:36:04.065476   14044 start.go:495] detecting cgroup driver to use...
	I1028 05:36:04.065562   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:36:04.072416   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.7"|' /etc/containerd/config.toml"
	I1028 05:36:04.075714   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1028 05:36:04.079265   14044 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1028 05:36:04.079297   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1028 05:36:04.082580   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:36:04.085685   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1028 05:36:04.088599   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 05:36:04.091721   14044 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1028 05:36:04.095467   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1028 05:36:04.098823   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I1028 05:36:04.102234   14044 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I1028 05:36:04.105148   14044 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1028 05:36:04.107861   14044 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1028 05:36:04.111014   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:04.194609   14044 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1028 05:36:04.201868   14044 start.go:495] detecting cgroup driver to use...
	I1028 05:36:04.201957   14044 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1028 05:36:04.207568   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:36:04.212703   14044 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I1028 05:36:04.226346   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1028 05:36:04.231274   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 05:36:04.236087   14044 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I1028 05:36:04.266268   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 05:36:04.270936   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 05:36:04.276864   14044 ssh_runner.go:195] Run: which cri-dockerd
	I1028 05:36:04.278187   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1028 05:36:04.280633   14044 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1028 05:36:04.285488   14044 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1028 05:36:04.363698   14044 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1028 05:36:04.434357   14044 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
	I1028 05:36:04.434419   14044 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1028 05:36:04.439802   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:04.511765   14044 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:36:05.652863   14044 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.141077166s)
	I1028 05:36:05.652936   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
	I1028 05:36:05.657424   14044 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
	I1028 05:36:05.663772   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:36:05.668719   14044 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1028 05:36:05.740495   14044 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1028 05:36:05.827606   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:05.907993   14044 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1028 05:36:05.914104   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
	I1028 05:36:05.918345   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:05.995111   14044 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
	I1028 05:36:06.035013   14044 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1028 05:36:06.035108   14044 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1028 05:36:06.038530   14044 start.go:563] Will wait 60s for crictl version
	I1028 05:36:06.038585   14044 ssh_runner.go:195] Run: which crictl
	I1028 05:36:06.040030   14044 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1028 05:36:06.055548   14044 start.go:579] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  20.10.16
	RuntimeApiVersion:  1.41.0
	I1028 05:36:06.055621   14044 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:36:06.072991   14044 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1028 05:36:06.096022   14044 out.go:235] * Preparing Kubernetes v1.24.1 on Docker 20.10.16 ...
	I1028 05:36:06.096282   14044 ssh_runner.go:195] Run: grep 10.0.2.2	host.minikube.internal$ /etc/hosts
	I1028 05:36:06.097554   14044 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "10.0.2.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 05:36:06.101082   14044 kubeadm.go:883] updating cluster {Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName
:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s} ...
	I1028 05:36:06.101150   14044 preload.go:131] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I1028 05:36:06.101202   14044 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:36:06.111563   14044 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	k8s.gcr.io/pause:3.6
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:36:06.111577   14044 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:36:06.111638   14044 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:36:06.115339   14044 ssh_runner.go:195] Run: which lz4
	I1028 05:36:06.116638   14044 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
	I1028 05:36:06.117875   14044 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1028 05:36:06.117887   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (359514331 bytes)
	I1028 05:36:07.102203   14044 docker.go:653] duration metric: took 985.603541ms to copy over tarball
	I1028 05:36:07.102284   14044 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I1028 05:36:08.280035   14044 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.177734792s)
	I1028 05:36:08.280050   14044 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1028 05:36:08.296025   14044 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1028 05:36:08.299319   14044 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
	I1028 05:36:08.304590   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:08.387727   14044 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1028 05:36:09.954024   14044 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.566269083s)
	I1028 05:36:09.954232   14044 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1028 05:36:09.967182   14044 docker.go:689] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-apiserver:v1.24.1
	k8s.gcr.io/kube-proxy:v1.24.1
	k8s.gcr.io/kube-controller-manager:v1.24.1
	k8s.gcr.io/kube-scheduler:v1.24.1
	k8s.gcr.io/etcd:3.5.3-0
	k8s.gcr.io/pause:3.7
	k8s.gcr.io/coredns/coredns:v1.8.6
	<none>:<none>
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1028 05:36:09.967190   14044 docker.go:695] registry.k8s.io/kube-apiserver:v1.24.1 wasn't preloaded
	I1028 05:36:09.967194   14044 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.24.1 registry.k8s.io/kube-controller-manager:v1.24.1 registry.k8s.io/kube-scheduler:v1.24.1 registry.k8s.io/kube-proxy:v1.24.1 registry.k8s.io/pause:3.7 registry.k8s.io/etcd:3.5.3-0 registry.k8s.io/coredns/coredns:v1.8.6 gcr.io/k8s-minikube/storage-provisioner:v5]
	I1028 05:36:09.971682   14044 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:09.973517   14044 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:09.975805   14044 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:09.975869   14044 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:09.978016   14044 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:09.978212   14044 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:09.979427   14044 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:09.979441   14044 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:09.981347   14044 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:09.981552   14044 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:09.982117   14044 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.1: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:09.983183   14044 image.go:135] retrieving image: registry.k8s.io/pause:3.7
	I1028 05:36:09.984104   14044 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:09.984312   14044 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:09.986389   14044 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:09.986505   14044 image.go:178] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1028 05:36:10.530007   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.542373   14044 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.24.1" needs transfer: "registry.k8s.io/kube-proxy:v1.24.1" does not exist at hash "fcbd620bbac080b658602c597709b377cb2b3fec134a097a27f94cba9b2ed2fa" in container runtime
	I1028 05:36:10.542407   14044 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.542491   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.24.1
	I1028 05:36:10.553123   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.561398   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1
	I1028 05:36:10.566692   14044 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.24.1" needs transfer: "registry.k8s.io/kube-apiserver:v1.24.1" does not exist at hash "7c5896a75862a8bc252122185a929cec1393db2c525f6440137d4fbf46bbf6f9" in container runtime
	I1028 05:36:10.566726   14044 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.566797   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.24.1
	I1028 05:36:10.577443   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.1
	I1028 05:36:10.583948   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.594899   14044 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.24.1" needs transfer: "registry.k8s.io/kube-controller-manager:v1.24.1" does not exist at hash "f61bbe9259d7caa580deb6c8e4bfd1780c7b5887efe3aa3adc7cc74f68a27c1b" in container runtime
	I1028 05:36:10.594930   14044 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.595024   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.24.1
	I1028 05:36:10.607788   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.1
	I1028 05:36:10.642873   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.653165   14044 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.24.1" needs transfer: "registry.k8s.io/kube-scheduler:v1.24.1" does not exist at hash "000c19baf6bba51ff7ae5449f4c7a16d9190cef0263f58070dbf62cea9c4982f" in container runtime
	I1028 05:36:10.653185   14044 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.653245   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.24.1
	I1028 05:36:10.663208   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.1
	I1028 05:36:10.716768   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.728624   14044 cache_images.go:116] "registry.k8s.io/etcd:3.5.3-0" needs transfer: "registry.k8s.io/etcd:3.5.3-0" does not exist at hash "a9a710bb96df080e6b9c720eb85dc5b832ff84abf77263548d74fedec6466a5a" in container runtime
	I1028 05:36:10.728651   14044 docker.go:337] Removing image: registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.728718   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.3-0
	I1028 05:36:10.738673   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	W1028 05:36:10.767868   14044 image.go:283] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I1028 05:36:10.768055   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.783988   14044 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.8.6" needs transfer: "registry.k8s.io/coredns/coredns:v1.8.6" does not exist at hash "6af7f860a8197bfa3fdb7dec2061aa33870253e87a1e91c492d55b8a4fd38d14" in container runtime
	I1028 05:36:10.784009   14044 docker.go:337] Removing image: registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.784070   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.8.6
	I1028 05:36:10.793960   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I1028 05:36:10.794106   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:36:10.795787   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/coredns_v1.8.6: stat -c "%s %y" /var/lib/minikube/images/coredns_v1.8.6: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/coredns_v1.8.6': No such file or directory
	I1028 05:36:10.795798   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 --> /var/lib/minikube/images/coredns_v1.8.6 (12318720 bytes)
	I1028 05:36:10.832040   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.7
	I1028 05:36:10.841286   14044 docker.go:304] Loading image: /var/lib/minikube/images/coredns_v1.8.6
	I1028 05:36:10.841300   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/coredns_v1.8.6 | docker load"
	I1028 05:36:10.850397   14044 cache_images.go:116] "registry.k8s.io/pause:3.7" needs transfer: "registry.k8s.io/pause:3.7" does not exist at hash "e5a475a0380575fb5df454b2e32bdec93e1ec0094d8a61e895b41567cb884550" in container runtime
	I1028 05:36:10.850421   14044 docker.go:337] Removing image: registry.k8s.io/pause:3.7
	I1028 05:36:10.850483   14044 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.7
	I1028 05:36:10.881772   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 from cache
	I1028 05:36:10.881793   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I1028 05:36:10.881938   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.7
	I1028 05:36:10.883324   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.7: stat -c "%s %y" /var/lib/minikube/images/pause_3.7: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/pause_3.7': No such file or directory
	I1028 05:36:10.883338   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 --> /var/lib/minikube/images/pause_3.7 (268288 bytes)
	I1028 05:36:10.890635   14044 docker.go:304] Loading image: /var/lib/minikube/images/pause_3.7
	I1028 05:36:10.890644   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/pause_3.7 | docker load"
	I1028 05:36:10.918250   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 from cache
	W1028 05:36:10.999413   14044 image.go:283] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1028 05:36:10.999589   14044 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.013088   14044 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I1028 05:36:11.013113   14044 docker.go:337] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.013184   14044 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:36:11.028489   14044 cache_images.go:289] Loading image from: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1028 05:36:11.028620   14044 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:36:11.030095   14044 ssh_runner.go:352] existence check for /var/lib/minikube/images/storage-provisioner_v5: stat -c "%s %y" /var/lib/minikube/images/storage-provisioner_v5: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/images/storage-provisioner_v5': No such file or directory
	I1028 05:36:11.030123   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 --> /var/lib/minikube/images/storage-provisioner_v5 (8035840 bytes)
	I1028 05:36:11.064696   14044 docker.go:304] Loading image: /var/lib/minikube/images/storage-provisioner_v5
	I1028 05:36:11.064720   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo cat /var/lib/minikube/images/storage-provisioner_v5 | docker load"
	I1028 05:36:11.303706   14044 cache_images.go:321] Transferred and loaded /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
	I1028 05:36:11.303746   14044 cache_images.go:92] duration metric: took 1.336543s to LoadCachedImages
	W1028 05:36:11.303799   14044 out.go:270] X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	X Unable to load cached images: LoadCachedImages: stat /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.1: no such file or directory
	I1028 05:36:11.303812   14044 kubeadm.go:934] updating node { 10.0.2.15 8443 v1.24.1 docker true true} ...
	I1028 05:36:11.303876   14044 kubeadm.go:946] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.24.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=stopped-upgrade-871000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.0.2.15
	
	[Install]
	 config:
	{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I1028 05:36:11.303949   14044 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1028 05:36:11.318896   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:36:11.318913   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:36:11.318920   14044 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I1028 05:36:11.318928   14044 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.0.2.15 APIServerPort:8443 KubernetesVersion:v1.24.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:stopped-upgrade-871000 NodeName:stopped-upgrade-871000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.0.2.15"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.0.2.15 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1028 05:36:11.318988   14044 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 10.0.2.15
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "stopped-upgrade-871000"
	  kubeletExtraArgs:
	    node-ip: 10.0.2.15
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "10.0.2.15"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.24.1
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1028 05:36:11.319060   14044 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.1
	I1028 05:36:11.322557   14044 binaries.go:44] Found k8s binaries, skipping transfer
	I1028 05:36:11.322593   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1028 05:36:11.325285   14044 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)
	I1028 05:36:11.330016   14044 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1028 05:36:11.335025   14044 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I1028 05:36:11.340515   14044 ssh_runner.go:195] Run: grep 10.0.2.15	control-plane.minikube.internal$ /etc/hosts
	I1028 05:36:11.341844   14044 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "10.0.2.15	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 05:36:11.345104   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:36:11.415611   14044 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:36:11.421152   14044 certs.go:68] Setting up /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000 for IP: 10.0.2.15
	I1028 05:36:11.421164   14044 certs.go:194] generating shared ca certs ...
	I1028 05:36:11.421173   14044 certs.go:226] acquiring lock for ca certs: {Name:mk98e4a9e20bbb7ca9edab1be452077f88dfe469 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.421350   14044 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key
	I1028 05:36:11.422115   14044 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key
	I1028 05:36:11.422128   14044 certs.go:256] generating profile certs ...
	I1028 05:36:11.422402   14044 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key
	I1028 05:36:11.422421   14044 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c
	I1028 05:36:11.422433   14044 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.0.2.15]
	I1028 05:36:11.523083   14044 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c ...
	I1028 05:36:11.523100   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c: {Name:mkbbeae012350cf78dc275aaf7cb4a1e3fe56f25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.524415   14044 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c ...
	I1028 05:36:11.524422   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c: {Name:mk2a1db50910931c74bce4df59653784fccf808a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.524786   14044 certs.go:381] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt.4d16460c -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt
	I1028 05:36:11.525098   14044 certs.go:385] copying /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key.4d16460c -> /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key
	I1028 05:36:11.525430   14044 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.key
	I1028 05:36:11.525604   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem (1338 bytes)
	W1028 05:36:11.525796   14044 certs.go:480] ignoring /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909_empty.pem, impossibly tiny 0 bytes
	I1028 05:36:11.525803   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca-key.pem (1675 bytes)
	I1028 05:36:11.525823   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem (1078 bytes)
	I1028 05:36:11.525845   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem (1123 bytes)
	I1028 05:36:11.525863   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/key.pem (1679 bytes)
	I1028 05:36:11.525914   14044 certs.go:484] found cert: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem (1708 bytes)
	I1028 05:36:11.526294   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1028 05:36:11.533568   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I1028 05:36:11.540310   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1028 05:36:11.547423   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1028 05:36:11.554522   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I1028 05:36:11.561121   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I1028 05:36:11.567735   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1028 05:36:11.574872   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1028 05:36:11.581700   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1028 05:36:11.588172   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/11909.pem --> /usr/share/ca-certificates/11909.pem (1338 bytes)
	I1028 05:36:11.595313   14044 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/ssl/certs/119092.pem --> /usr/share/ca-certificates/119092.pem (1708 bytes)
	I1028 05:36:11.602620   14044 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1028 05:36:11.608035   14044 ssh_runner.go:195] Run: openssl version
	I1028 05:36:11.609870   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11909.pem && ln -fs /usr/share/ca-certificates/11909.pem /etc/ssl/certs/11909.pem"
	I1028 05:36:11.612700   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.614090   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 12:21 /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.614124   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11909.pem
	I1028 05:36:11.615771   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11909.pem /etc/ssl/certs/51391683.0"
	I1028 05:36:11.619016   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/119092.pem && ln -fs /usr/share/ca-certificates/119092.pem /etc/ssl/certs/119092.pem"
	I1028 05:36:11.622246   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.623572   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 12:21 /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.623608   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/119092.pem
	I1028 05:36:11.625370   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/119092.pem /etc/ssl/certs/3ec20f2e.0"
	I1028 05:36:11.628237   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1028 05:36:11.631654   14044 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.633117   14044 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:32 /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.633142   14044 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1028 05:36:11.634772   14044 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1028 05:36:11.637674   14044 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I1028 05:36:11.639129   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I1028 05:36:11.641322   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I1028 05:36:11.643125   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I1028 05:36:11.645177   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I1028 05:36:11.646876   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I1028 05:36:11.648538   14044 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I1028 05:36:11.650471   14044 kubeadm.go:392] StartCluster: {Name:stopped-upgrade-871000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:59266 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:st
opped-upgrade-871000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disab
leOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:0s}
	I1028 05:36:11.650543   14044 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:36:11.660799   14044 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1028 05:36:11.663915   14044 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I1028 05:36:11.663925   14044 kubeadm.go:593] restartPrimaryControlPlane start ...
	I1028 05:36:11.663956   14044 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I1028 05:36:11.666919   14044 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I1028 05:36:11.667270   14044 kubeconfig.go:47] verify endpoint returned: get endpoint: "stopped-upgrade-871000" does not appear in /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:36:11.667371   14044 kubeconfig.go:62] /Users/jenkins/minikube-integration/19865-11397/kubeconfig needs updating (will repair): [kubeconfig missing "stopped-upgrade-871000" cluster setting kubeconfig missing "stopped-upgrade-871000" context setting]
	I1028 05:36:11.667576   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:36:11.668033   14044 kapi.go:59] client config for stopped-upgrade-871000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1021ae680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:36:11.668548   14044 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I1028 05:36:11.671637   14044 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml
	+++ /var/tmp/minikube/kubeadm.yaml.new
	@@ -11,7 +11,7 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /var/run/cri-dockerd.sock
	+  criSocket: unix:///var/run/cri-dockerd.sock
	   name: "stopped-upgrade-871000"
	   kubeletExtraArgs:
	     node-ip: 10.0.2.15
	@@ -49,7 +49,9 @@
	 authentication:
	   x509:
	     clientCAFile: /var/lib/minikube/certs/ca.crt
	-cgroupDriver: systemd
	+cgroupDriver: cgroupfs
	+hairpinMode: hairpin-veth
	+runtimeRequestTimeout: 15m
	 clusterDomain: "cluster.local"
	 # disable disk resource management by default
	 imageGCHighThresholdPercent: 100
	
	-- /stdout --
	I1028 05:36:11.671642   14044 kubeadm.go:1160] stopping kube-system containers ...
	I1028 05:36:11.671691   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1028 05:36:11.682701   14044 docker.go:483] Stopping containers: [1d246d72453f 0c37d3667d75 b44a7e22a03f 4cb3d4018f36 75a05b976c8a e4b0e641290b 7426bdc7b812 5274b9f0fa1c]
	I1028 05:36:11.682782   14044 ssh_runner.go:195] Run: docker stop 1d246d72453f 0c37d3667d75 b44a7e22a03f 4cb3d4018f36 75a05b976c8a e4b0e641290b 7426bdc7b812 5274b9f0fa1c
	I1028 05:36:11.693460   14044 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I1028 05:36:11.698769   14044 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:36:11.701650   14044 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:36:11.701656   14044 kubeadm.go:157] found existing configuration files:
	
	I1028 05:36:11.701683   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf
	I1028 05:36:11.704260   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:36:11.704300   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:36:11.707600   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf
	I1028 05:36:11.710721   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:36:11.710752   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:36:11.713374   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf
	I1028 05:36:11.715809   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:36:11.715841   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:36:11.719021   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf
	I1028 05:36:11.721595   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:36:11.721621   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:36:11.724171   14044 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:36:11.727325   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:11.750394   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.165562   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.291609   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.323489   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I1028 05:36:12.342394   14044 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:36:12.342480   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:12.844681   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:13.344378   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:36:13.348804   14044 api_server.go:72] duration metric: took 1.006415417s to wait for apiserver process to appear ...
	I1028 05:36:13.348825   14044 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:36:13.348839   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:18.350946   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:18.350988   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:23.351398   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:23.351443   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:28.351886   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:28.351905   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:33.352672   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:33.352700   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:38.353426   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:38.353466   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:43.354706   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:43.354741   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:48.355958   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:48.355976   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:53.357630   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:53.357708   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:36:58.360248   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:36:58.360288   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:03.362605   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:03.362641   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:08.364964   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:08.365004   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:13.366409   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:13.366882   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:13.397269   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:13.397423   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:13.416795   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:13.416892   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:13.430439   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:13.430515   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:13.448373   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:13.448450   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:13.458813   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:13.458892   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:13.469465   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:13.469543   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:13.480031   14044 logs.go:282] 0 containers: []
	W1028 05:37:13.480041   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:13.480103   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:13.491085   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:13.491103   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:13.491109   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:13.507546   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:13.507565   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:13.519092   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:13.519102   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:13.536217   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:13.536230   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:13.647921   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:13.647935   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:13.662196   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:13.662207   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:13.676279   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:13.676290   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:13.691950   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:13.691964   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:13.705376   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:13.705388   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:13.717414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:13.717426   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:13.728783   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:13.728795   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:13.740840   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:13.740853   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:13.745537   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:13.745547   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:13.757362   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:13.757373   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:13.784196   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:13.784209   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:13.798757   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:13.798768   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:13.839351   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:13.839362   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:16.379924   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:21.382288   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:21.382511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:21.401343   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:21.401454   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:21.414442   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:21.414523   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:21.425947   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:21.426020   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:21.439873   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:21.439963   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:21.450829   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:21.450914   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:21.461638   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:21.461724   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:21.471812   14044 logs.go:282] 0 containers: []
	W1028 05:37:21.471822   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:21.471890   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:21.486514   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:21.486538   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:21.486543   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:21.498213   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:21.498225   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:21.509541   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:21.509554   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:21.520851   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:21.520861   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:21.535225   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:21.535235   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:21.574961   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:21.574971   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:21.612370   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:21.612382   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:21.658542   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:21.658557   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:21.672892   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:21.672904   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:21.687320   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:21.687333   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:21.700813   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:21.700826   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:21.724387   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:21.724394   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:21.728276   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:21.728284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:21.743373   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:21.743384   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:21.757839   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:21.757848   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:21.781533   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:21.781544   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:21.793373   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:21.793386   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:24.306962   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:29.307623   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:29.307807   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:29.320118   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:29.320194   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:29.330984   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:29.331065   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:29.341198   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:29.341274   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:29.351831   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:29.351908   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:29.362731   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:29.362811   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:29.373510   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:29.373595   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:29.383473   14044 logs.go:282] 0 containers: []
	W1028 05:37:29.383485   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:29.383555   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:29.394104   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:29.394122   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:29.394128   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:29.405678   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:29.405690   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:29.429920   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:29.429928   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:29.441748   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:29.441760   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:29.458083   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:29.458094   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:29.476463   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:29.476474   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:29.489861   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:29.489872   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:29.528862   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:29.528873   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:29.543720   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:29.543730   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:29.556338   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:29.556348   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:29.571392   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:29.571403   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:29.583274   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:29.583285   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:29.594922   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:29.594934   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:29.606347   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:29.606358   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:29.643822   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:29.643833   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:29.648168   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:29.648174   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:29.691198   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:29.691209   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:32.215857   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:37.218145   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:37.218266   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:37.233566   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:37.233647   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:37.244732   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:37.244813   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:37.255428   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:37.255511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:37.265483   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:37.265555   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:37.275939   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:37.276014   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:37.290106   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:37.290181   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:37.300342   14044 logs.go:282] 0 containers: []
	W1028 05:37:37.300353   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:37.300418   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:37.310442   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:37.310458   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:37.310463   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:37.324854   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:37.324864   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:37.336231   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:37.336241   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:37.351720   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:37.351729   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:37.363117   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:37.363127   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:37.368447   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:37.368459   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:37.406067   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:37.406080   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:37.419636   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:37.419645   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:37.456322   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:37.456332   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:37.468256   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:37.468270   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:37.482531   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:37.482540   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:37.501180   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:37.501193   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:37.512709   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:37.512720   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:37.536682   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:37.536690   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:37.548417   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:37.548428   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:37.585825   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:37.585835   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:37.599612   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:37.599622   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:40.113591   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:45.115828   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:45.115953   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:45.127366   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:45.127443   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:45.138291   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:45.138360   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:45.149052   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:45.149132   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:45.163811   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:45.163893   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:45.175015   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:45.175092   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:45.185773   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:45.185855   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:45.196573   14044 logs.go:282] 0 containers: []
	W1028 05:37:45.196585   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:45.196650   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:45.207155   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:45.207180   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:45.207186   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:45.247407   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:45.247419   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:45.262100   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:45.262115   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:45.279522   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:45.279533   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:45.292627   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:45.292636   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:45.309968   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:45.309979   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:45.321731   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:45.321742   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:45.336993   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:45.337002   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:45.355122   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:45.355133   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:45.366303   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:45.366314   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:45.384556   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:45.384571   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:45.397004   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:45.397017   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:45.435229   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:45.435242   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:45.439252   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:45.439258   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:45.474715   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:45.474729   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:45.489439   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:45.489453   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:45.501199   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:45.501213   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:48.030570   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:37:53.032982   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:37:53.033275   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:37:53.057825   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:37:53.057957   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:37:53.073514   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:37:53.073607   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:37:53.086866   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:37:53.086946   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:37:53.098212   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:37:53.098298   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:37:53.109349   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:37:53.109423   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:37:53.120167   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:37:53.120245   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:37:53.130414   14044 logs.go:282] 0 containers: []
	W1028 05:37:53.130426   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:37:53.130486   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:37:53.141468   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:37:53.141488   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:37:53.141496   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:37:53.156365   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:37:53.156376   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:37:53.167886   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:37:53.167896   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:37:53.186261   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:37:53.186271   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:37:53.202388   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:37:53.202399   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:37:53.224975   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:37:53.224986   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:37:53.287963   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:37:53.287973   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:37:53.301973   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:37:53.301984   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:37:53.315753   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:37:53.315764   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:37:53.327767   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:37:53.327781   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:37:53.352302   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:37:53.352309   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:37:53.389644   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:37:53.389654   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:37:53.426294   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:37:53.426303   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:37:53.438546   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:37:53.438559   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:37:53.442744   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:37:53.442750   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:37:53.453630   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:37:53.453641   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:37:53.464827   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:37:53.464838   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:37:55.980570   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:00.982848   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:00.983002   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:00.998861   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:00.998960   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:01.011506   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:01.011592   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:01.022531   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:01.022605   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:01.033821   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:01.033905   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:01.044539   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:01.044610   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:01.055297   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:01.055377   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:01.065370   14044 logs.go:282] 0 containers: []
	W1028 05:38:01.065383   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:01.065451   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:01.075908   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:01.075926   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:01.075945   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:01.112357   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:01.112368   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:01.127262   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:01.127275   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:01.141742   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:01.141756   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:01.179142   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:01.179155   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:01.221830   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:01.221849   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:01.239084   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:01.239094   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:01.253696   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:01.253708   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:01.265929   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:01.265941   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:01.278234   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:01.278248   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:01.292688   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:01.292698   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:01.305851   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:01.305861   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:01.310085   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:01.310090   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:01.323878   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:01.323890   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:01.335855   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:01.335867   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:01.347582   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:01.347593   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:01.371666   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:01.371675   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:03.886944   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:08.889344   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:08.889633   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:08.915104   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:08.915248   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:08.938323   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:08.938413   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:08.951095   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:08.951172   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:08.961299   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:08.961374   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:08.971532   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:08.971612   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:08.982354   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:08.982419   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:08.993087   14044 logs.go:282] 0 containers: []
	W1028 05:38:08.993102   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:08.993170   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:09.004393   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:09.004410   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:09.004415   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:09.015802   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:09.015813   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:09.028653   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:09.028664   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:09.040673   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:09.040685   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:09.079310   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:09.079319   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:09.083829   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:09.083836   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:09.095606   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:09.095617   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:09.115573   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:09.115583   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:09.133507   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:09.133517   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:09.157139   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:09.157150   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:09.170995   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:09.171005   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:09.182036   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:09.182047   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:09.195576   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:09.195586   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:09.210966   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:09.210976   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:09.224414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:09.224425   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:09.235957   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:09.235968   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:09.270219   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:09.270231   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:11.814682   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:16.816731   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:16.816946   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:16.836382   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:16.836484   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:16.851119   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:16.851206   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:16.863594   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:16.863677   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:16.874003   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:16.874081   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:16.884281   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:16.884356   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:16.894894   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:16.894963   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:16.905627   14044 logs.go:282] 0 containers: []
	W1028 05:38:16.905641   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:16.905706   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:16.919659   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:16.919678   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:16.919683   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:16.930645   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:16.930658   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:16.946525   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:16.946539   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:16.964434   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:16.964449   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:16.979804   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:16.979816   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:16.996324   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:16.996336   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:17.021865   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:17.021875   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:17.060664   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:17.060673   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:17.077293   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:17.077303   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:17.091594   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:17.091603   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:17.107706   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:17.107721   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:17.119195   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:17.119210   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:17.133739   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:17.133753   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:17.145044   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:17.145054   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:17.180643   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:17.180653   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:17.192647   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:17.192657   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:17.231023   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:17.231035   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:19.740080   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:24.743056   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:24.743367   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:24.770943   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:24.771081   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:24.787783   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:24.787880   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:24.801046   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:24.801133   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:24.812566   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:24.812650   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:24.823514   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:24.823590   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:24.833912   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:24.833988   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:24.844630   14044 logs.go:282] 0 containers: []
	W1028 05:38:24.844641   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:24.844707   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:24.855360   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:24.855380   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:24.855385   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:24.869729   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:24.869739   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:24.888112   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:24.888121   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:24.900063   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:24.900072   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:24.937702   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:24.937714   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:24.950225   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:24.950237   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:24.987986   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:24.987996   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:25.032272   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:25.032284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:25.047699   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:25.047709   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:25.061733   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:25.061745   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:25.085133   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:25.085144   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:25.098302   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:25.098311   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:25.109520   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:25.109529   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:25.113984   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:25.113990   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:25.125685   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:25.125696   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:25.140490   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:25.140499   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:25.165648   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:25.165655   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:27.679257   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:32.681181   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:32.681319   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:32.693794   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:32.693869   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:32.705846   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:32.705922   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:32.716605   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:32.716672   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:32.727249   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:32.727329   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:32.737632   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:32.737701   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:32.748337   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:32.748445   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:32.758335   14044 logs.go:282] 0 containers: []
	W1028 05:38:32.758345   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:32.758401   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:32.768877   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:32.768897   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:32.768902   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:32.781820   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:32.781829   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:32.804799   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:32.804806   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:32.819396   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:32.819406   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:32.830883   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:32.830895   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:32.842763   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:32.842774   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:32.858347   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:32.858356   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:32.870598   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:32.870608   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:32.884017   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:32.884026   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:32.921199   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:32.921215   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:32.932978   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:32.932989   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:32.946910   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:32.946922   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:32.984636   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:32.984651   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:32.998696   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:32.998711   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:33.038006   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:33.038017   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:33.042421   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:33.042429   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:33.057072   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:33.057083   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:35.585187   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:40.587582   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:40.587838   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:40.609882   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:40.610003   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:40.632129   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:40.632207   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:40.646929   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:40.647004   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:40.657359   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:40.657441   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:40.667930   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:40.668009   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:40.678010   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:40.678085   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:40.688583   14044 logs.go:282] 0 containers: []
	W1028 05:38:40.688596   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:40.688658   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:40.699111   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:40.699135   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:40.699140   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:40.712168   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:40.712177   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:40.725573   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:40.725587   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:40.763643   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:40.763658   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:40.775992   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:40.776006   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:40.787488   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:40.787499   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:40.800554   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:40.800564   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:40.835472   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:40.835483   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:40.839695   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:40.839703   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:40.853707   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:40.853717   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:40.869291   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:40.869306   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:40.880964   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:40.880975   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:40.892793   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:40.892803   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:40.915362   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:40.915371   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:40.933017   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:40.933027   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:40.974335   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:40.974345   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:40.987092   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:40.987104   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:43.512299   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:48.514772   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:48.514932   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:48.525771   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:48.525849   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:48.536503   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:48.536593   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:48.547673   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:48.547752   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:48.558124   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:48.558200   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:48.569028   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:48.569100   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:48.579906   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:48.580060   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:48.590811   14044 logs.go:282] 0 containers: []
	W1028 05:38:48.590821   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:48.590885   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:48.601583   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:48.601601   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:48.601607   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:48.622388   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:48.622402   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:48.659669   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:48.659679   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:48.675929   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:48.675943   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:48.690430   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:48.690444   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:48.702252   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:48.702262   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:48.743103   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:48.743113   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:48.757374   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:48.757386   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:48.774692   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:48.774706   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:48.809435   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:48.809450   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:48.823608   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:48.823618   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:48.838034   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:48.838048   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:48.857852   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:48.857863   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:48.869876   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:48.869888   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:48.882274   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:48.882285   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:48.886914   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:48.886920   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:48.909551   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:48.909560   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:51.422596   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:38:56.424896   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:38:56.425012   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:38:56.436406   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:38:56.436492   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:38:56.447702   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:38:56.447793   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:38:56.458527   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:38:56.458597   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:38:56.474522   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:38:56.474601   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:38:56.485000   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:38:56.485077   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:38:56.495624   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:38:56.495691   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:38:56.505587   14044 logs.go:282] 0 containers: []
	W1028 05:38:56.505597   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:38:56.505663   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:38:56.516874   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:38:56.516895   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:38:56.516900   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:38:56.530205   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:38:56.530217   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:38:56.554891   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:38:56.554901   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:38:56.558997   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:38:56.559006   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:38:56.573585   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:38:56.573597   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:38:56.586641   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:38:56.586654   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:38:56.601221   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:38:56.601230   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:38:56.615541   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:38:56.615551   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:38:56.627414   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:38:56.627424   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:38:56.638436   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:38:56.638446   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:38:56.673272   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:38:56.673283   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:38:56.684787   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:38:56.684798   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:38:56.702526   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:38:56.702536   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:38:56.718456   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:38:56.718467   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:38:56.730367   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:38:56.730379   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:38:56.768099   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:38:56.768110   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:38:56.782206   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:38:56.782216   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:38:59.321702   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:04.324027   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:04.324301   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:04.343958   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:04.344066   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:04.358323   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:04.358404   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:04.370142   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:04.370221   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:04.381301   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:04.381374   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:04.392013   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:04.392084   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:04.402634   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:04.402716   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:04.415787   14044 logs.go:282] 0 containers: []
	W1028 05:39:04.415799   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:04.415866   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:04.432002   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:04.432019   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:04.432024   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:04.436049   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:04.436058   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:04.449485   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:04.449495   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:04.463651   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:04.463661   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:04.475686   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:04.475697   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:04.489621   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:04.489631   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:04.527521   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:04.527533   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:04.538649   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:04.538660   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:04.550602   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:04.550615   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:04.563397   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:04.563406   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:04.574585   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:04.574595   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:04.598933   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:04.598941   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:04.637647   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:04.637655   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:04.672469   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:04.672479   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:04.687380   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:04.687390   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:04.699002   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:04.699013   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:04.716813   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:04.716824   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:07.228981   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:12.231239   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:12.231511   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:12.253523   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:12.253620   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:12.267371   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:12.267456   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:12.279214   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:12.279286   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:12.293030   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:12.293118   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:12.308214   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:12.308283   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:12.319727   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:12.319804   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:12.330096   14044 logs.go:282] 0 containers: []
	W1028 05:39:12.330108   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:12.330169   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:12.340998   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:12.341017   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:12.341023   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:12.354865   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:12.354875   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:12.367526   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:12.367537   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:12.391262   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:12.391269   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:12.402954   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:12.402966   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:12.407092   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:12.407102   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:12.428672   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:12.428687   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:12.443517   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:12.443528   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:12.458220   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:12.458236   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:12.473332   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:12.473343   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:12.491823   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:12.491837   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:12.505196   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:12.505206   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:12.516520   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:12.516531   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:12.556219   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:12.556228   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:12.593173   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:12.593183   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:12.604474   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:12.604484   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:12.641559   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:12.641569   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:15.156624   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:20.158823   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:20.159086   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:20.181691   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:20.181796   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:20.196874   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:20.196959   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:20.208325   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:20.208408   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:20.218584   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:20.218673   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:20.229515   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:20.229593   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:20.240052   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:20.240125   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:20.250585   14044 logs.go:282] 0 containers: []
	W1028 05:39:20.250600   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:20.250665   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:20.261059   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:20.261086   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:20.261091   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:20.280387   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:20.280399   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:20.304899   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:20.304909   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:20.309668   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:20.309674   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:20.323769   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:20.323780   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:20.362067   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:20.362078   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:20.378161   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:20.378174   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:20.389849   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:20.389860   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:20.404759   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:20.404769   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:20.418722   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:20.418733   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:20.430096   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:20.430107   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:20.442053   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:20.442065   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:20.477214   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:20.477224   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:20.492107   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:20.492115   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:20.531358   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:20.531368   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:20.545655   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:20.545665   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:20.557322   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:20.557331   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:23.080692   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:28.082933   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:28.083181   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:28.102623   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:28.102729   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:28.116575   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:28.116663   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:28.128584   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:28.128664   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:28.139280   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:28.139363   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:28.153094   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:28.153178   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:28.163971   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:28.164039   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:28.174058   14044 logs.go:282] 0 containers: []
	W1028 05:39:28.174071   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:28.174139   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:28.184698   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:28.184713   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:28.184719   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:28.224598   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:28.224609   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:28.238568   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:28.238580   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:28.250273   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:28.250283   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:28.261847   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:28.261857   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:28.279379   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:28.279389   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:28.317804   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:28.317816   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:28.329744   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:28.329753   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:28.348227   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:28.348237   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:28.359798   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:28.359808   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:28.364010   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:28.364019   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:28.382162   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:28.382172   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:28.402966   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:28.402975   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:28.416031   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:28.416041   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:28.427389   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:28.427399   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:28.466742   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:28.466751   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:28.482400   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:28.482411   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:31.008230   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:36.010432   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:36.010713   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:36.029184   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:36.029285   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:36.045089   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:36.045179   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:36.063258   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:36.063332   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:36.073610   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:36.073678   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:36.084319   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:36.084403   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:36.095205   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:36.095288   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:36.107679   14044 logs.go:282] 0 containers: []
	W1028 05:39:36.107692   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:36.107759   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:36.118461   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:36.118478   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:36.118484   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:36.132776   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:36.132787   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:36.146471   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:36.146482   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:36.185298   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:36.185308   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:36.220305   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:36.220317   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:36.234512   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:36.234521   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:36.247843   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:36.247852   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:36.259335   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:36.259350   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:36.263881   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:36.263891   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:36.286381   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:36.286392   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:36.298123   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:36.298132   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:36.320951   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:36.320960   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:36.358402   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:36.358413   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:36.372598   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:36.372607   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:36.388347   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:36.388358   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:36.403634   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:36.403644   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:36.415241   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:36.415254   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:38.927276   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:43.929474   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:43.929738   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:43.950453   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:43.950554   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:43.964519   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:43.964602   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:43.982065   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:43.982141   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:43.992727   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:43.992798   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:44.007822   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:44.007899   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:44.019794   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:44.019865   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:44.031301   14044 logs.go:282] 0 containers: []
	W1028 05:39:44.031312   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:44.031380   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:44.041849   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:44.041869   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:44.041876   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:44.055599   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:44.055612   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:44.093434   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:44.093442   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:44.128709   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:44.128721   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:44.143888   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:44.143899   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:44.158542   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:44.158554   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:44.169531   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:44.169545   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:44.183406   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:44.183417   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:44.197628   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:44.197637   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:44.209451   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:44.209461   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:44.227373   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:44.227384   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:44.239326   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:44.239338   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:44.243940   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:44.243946   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:44.281086   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:44.281097   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:44.292795   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:44.292804   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:44.307709   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:44.307720   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:44.318817   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:44.318830   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:46.843904   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:51.846133   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:51.846413   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:51.874671   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:51.874822   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:51.892667   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:51.892758   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:51.906224   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:51.906309   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:51.917745   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:51.917850   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:51.928148   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:51.928223   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:51.939766   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:51.939846   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:51.950714   14044 logs.go:282] 0 containers: []
	W1028 05:39:51.950725   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:51.950794   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:51.961363   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:51.961382   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:51.961387   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:39:51.973256   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:39:51.973267   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:39:51.991195   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:51.991205   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:52.005090   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:39:52.005100   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:39:52.009428   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:52.009435   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:52.028296   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:39:52.028311   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:39:52.074967   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:52.074977   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:52.097330   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:39:52.097341   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:39:52.108625   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:39:52.108635   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:39:52.143050   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:39:52.143066   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:39:52.157546   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:52.157555   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:52.168890   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:52.168901   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:52.207995   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:39:52.208003   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:39:52.220047   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:39:52.220057   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:39:52.235003   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:39:52.235015   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:39:52.249825   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:39:52.249836   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:39:52.261480   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:52.261495   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:54.778304   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:39:59.780605   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:39:59.780780   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:39:59.794698   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:39:59.794783   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:39:59.805899   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:39:59.805976   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:39:59.816407   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:39:59.816478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:39:59.826748   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:39:59.826833   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:39:59.837406   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:39:59.837478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:39:59.847989   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:39:59.848067   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:39:59.863094   14044 logs.go:282] 0 containers: []
	W1028 05:39:59.863104   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:39:59.863162   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:39:59.873739   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:39:59.873757   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:39:59.873762   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:39:59.884982   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:39:59.884991   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:39:59.899814   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:39:59.899827   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:39:59.922863   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:39:59.922872   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:39:59.962907   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:39:59.962920   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:39:59.977374   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:39:59.977383   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:39:59.992391   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:39:59.992402   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:40:00.005006   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:00.005017   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:00.009061   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:40:00.009070   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:40:00.022936   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:40:00.022948   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:40:00.037548   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:40:00.037559   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:40:00.058051   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:40:00.058065   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:40:00.068888   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:40:00.068898   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:00.080484   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:00.080496   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:00.115622   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:40:00.115633   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:40:00.154052   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:40:00.154065   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:40:00.175621   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:40:00.175631   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:40:02.690490   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:07.692765   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:07.692915   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:40:07.709064   14044 logs.go:282] 2 containers: [7ae3acf28c3e 1d246d72453f]
	I1028 05:40:07.709196   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:40:07.723250   14044 logs.go:282] 2 containers: [877194f04f03 0c37d3667d75]
	I1028 05:40:07.723332   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:40:07.737357   14044 logs.go:282] 1 containers: [77c48742e06e]
	I1028 05:40:07.737439   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:40:07.748491   14044 logs.go:282] 2 containers: [5ed635e9e019 b44a7e22a03f]
	I1028 05:40:07.748569   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:40:07.758911   14044 logs.go:282] 1 containers: [2306d9047dd7]
	I1028 05:40:07.758985   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:40:07.770001   14044 logs.go:282] 2 containers: [ef0a9e26c552 4cb3d4018f36]
	I1028 05:40:07.770080   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:40:07.779749   14044 logs.go:282] 0 containers: []
	W1028 05:40:07.779761   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:40:07.779831   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:40:07.789960   14044 logs.go:282] 2 containers: [d86fe2c804a9 114fece080e6]
	I1028 05:40:07.789976   14044 logs.go:123] Gathering logs for etcd [877194f04f03] ...
	I1028 05:40:07.789982   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 877194f04f03"
	I1028 05:40:07.803785   14044 logs.go:123] Gathering logs for kube-controller-manager [ef0a9e26c552] ...
	I1028 05:40:07.803797   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ef0a9e26c552"
	I1028 05:40:07.821761   14044 logs.go:123] Gathering logs for kube-controller-manager [4cb3d4018f36] ...
	I1028 05:40:07.821776   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4cb3d4018f36"
	I1028 05:40:07.836003   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:40:07.836013   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:40:07.873768   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:40:07.873777   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:40:07.908725   14044 logs.go:123] Gathering logs for kube-apiserver [7ae3acf28c3e] ...
	I1028 05:40:07.908739   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ae3acf28c3e"
	I1028 05:40:07.923026   14044 logs.go:123] Gathering logs for kube-proxy [2306d9047dd7] ...
	I1028 05:40:07.923037   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2306d9047dd7"
	I1028 05:40:07.942273   14044 logs.go:123] Gathering logs for storage-provisioner [d86fe2c804a9] ...
	I1028 05:40:07.942284   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d86fe2c804a9"
	I1028 05:40:07.954057   14044 logs.go:123] Gathering logs for storage-provisioner [114fece080e6] ...
	I1028 05:40:07.954066   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 114fece080e6"
	I1028 05:40:07.965976   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:40:07.965987   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:40:07.988183   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:40:07.988193   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:40:08.000240   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:40:08.000251   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:40:08.004523   14044 logs.go:123] Gathering logs for kube-apiserver [1d246d72453f] ...
	I1028 05:40:08.004530   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d246d72453f"
	I1028 05:40:08.042875   14044 logs.go:123] Gathering logs for kube-scheduler [5ed635e9e019] ...
	I1028 05:40:08.042887   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5ed635e9e019"
	I1028 05:40:08.055081   14044 logs.go:123] Gathering logs for etcd [0c37d3667d75] ...
	I1028 05:40:08.055093   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0c37d3667d75"
	I1028 05:40:08.071892   14044 logs.go:123] Gathering logs for coredns [77c48742e06e] ...
	I1028 05:40:08.071902   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 77c48742e06e"
	I1028 05:40:08.083222   14044 logs.go:123] Gathering logs for kube-scheduler [b44a7e22a03f] ...
	I1028 05:40:08.083232   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b44a7e22a03f"
	I1028 05:40:10.600376   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:15.602660   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:15.602755   14044 kubeadm.go:597] duration metric: took 4m3.938314s to restartPrimaryControlPlane
	W1028 05:40:15.602824   14044 out.go:270] ! Unable to restart control-plane node(s), will reset cluster: <no value>
	! Unable to restart control-plane node(s), will reset cluster: <no value>
	I1028 05:40:15.602858   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"
	I1028 05:40:16.595897   14044 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 05:40:16.600960   14044 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1028 05:40:16.603706   14044 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1028 05:40:16.606541   14044 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1028 05:40:16.606546   14044 kubeadm.go:157] found existing configuration files:
	
	I1028 05:40:16.606572   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf
	I1028 05:40:16.609260   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I1028 05:40:16.609295   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I1028 05:40:16.611751   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf
	I1028 05:40:16.614726   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I1028 05:40:16.614759   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I1028 05:40:16.617840   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf
	I1028 05:40:16.620611   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I1028 05:40:16.620643   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I1028 05:40:16.623238   14044 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf
	I1028 05:40:16.626307   14044 kubeadm.go:163] "https://control-plane.minikube.internal:59266" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:59266 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I1028 05:40:16.626334   14044 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I1028 05:40:16.629400   14044 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I1028 05:40:16.646477   14044 kubeadm.go:310] [init] Using Kubernetes version: v1.24.1
	I1028 05:40:16.646506   14044 kubeadm.go:310] [preflight] Running pre-flight checks
	I1028 05:40:16.705727   14044 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1028 05:40:16.705796   14044 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1028 05:40:16.705851   14044 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1028 05:40:16.754312   14044 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1028 05:40:16.758552   14044 out.go:235]   - Generating certificates and keys ...
	I1028 05:40:16.758587   14044 kubeadm.go:310] [certs] Using existing ca certificate authority
	I1028 05:40:16.758623   14044 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I1028 05:40:16.758675   14044 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
	I1028 05:40:16.758730   14044 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
	I1028 05:40:16.758767   14044 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
	I1028 05:40:16.758795   14044 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
	I1028 05:40:16.758826   14044 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
	I1028 05:40:16.758855   14044 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
	I1028 05:40:16.758888   14044 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
	I1028 05:40:16.758928   14044 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
	I1028 05:40:16.758957   14044 kubeadm.go:310] [certs] Using the existing "sa" key
	I1028 05:40:16.758982   14044 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1028 05:40:16.807830   14044 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1028 05:40:16.867767   14044 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1028 05:40:17.090373   14044 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1028 05:40:17.118045   14044 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1028 05:40:17.146831   14044 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1028 05:40:17.147174   14044 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1028 05:40:17.147306   14044 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I1028 05:40:17.234199   14044 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1028 05:40:17.238378   14044 out.go:235]   - Booting up control plane ...
	I1028 05:40:17.238427   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1028 05:40:17.238476   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1028 05:40:17.238543   14044 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1028 05:40:17.238626   14044 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1028 05:40:17.238728   14044 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1028 05:40:21.741519   14044 kubeadm.go:310] [apiclient] All control plane components are healthy after 4.503555 seconds
	I1028 05:40:21.741586   14044 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1028 05:40:21.746456   14044 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1028 05:40:22.255737   14044 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I1028 05:40:22.255864   14044 kubeadm.go:310] [mark-control-plane] Marking the node stopped-upgrade-871000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1028 05:40:22.759305   14044 kubeadm.go:310] [bootstrap-token] Using token: 88vf9n.wm73m1u6l0vu61hl
	I1028 05:40:22.763568   14044 out.go:235]   - Configuring RBAC rules ...
	I1028 05:40:22.763636   14044 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1028 05:40:22.765615   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1028 05:40:22.771703   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1028 05:40:22.772615   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1028 05:40:22.773421   14044 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1028 05:40:22.774176   14044 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1028 05:40:22.777389   14044 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1028 05:40:22.958096   14044 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I1028 05:40:23.167293   14044 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I1028 05:40:23.167791   14044 kubeadm.go:310] 
	I1028 05:40:23.167823   14044 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I1028 05:40:23.167829   14044 kubeadm.go:310] 
	I1028 05:40:23.167932   14044 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I1028 05:40:23.167938   14044 kubeadm.go:310] 
	I1028 05:40:23.167950   14044 kubeadm.go:310]   mkdir -p $HOME/.kube
	I1028 05:40:23.167980   14044 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1028 05:40:23.168021   14044 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1028 05:40:23.168026   14044 kubeadm.go:310] 
	I1028 05:40:23.168059   14044 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I1028 05:40:23.168068   14044 kubeadm.go:310] 
	I1028 05:40:23.168116   14044 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1028 05:40:23.168125   14044 kubeadm.go:310] 
	I1028 05:40:23.168151   14044 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I1028 05:40:23.168193   14044 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1028 05:40:23.168241   14044 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1028 05:40:23.168245   14044 kubeadm.go:310] 
	I1028 05:40:23.168317   14044 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I1028 05:40:23.168354   14044 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I1028 05:40:23.168356   14044 kubeadm.go:310] 
	I1028 05:40:23.168454   14044 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 88vf9n.wm73m1u6l0vu61hl \
	I1028 05:40:23.168512   14044 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 \
	I1028 05:40:23.168528   14044 kubeadm.go:310] 	--control-plane 
	I1028 05:40:23.168531   14044 kubeadm.go:310] 
	I1028 05:40:23.168674   14044 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I1028 05:40:23.168684   14044 kubeadm.go:310] 
	I1028 05:40:23.168729   14044 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 88vf9n.wm73m1u6l0vu61hl \
	I1028 05:40:23.168798   14044 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:5b744a356800251f8c75e2ab5170e374668c21e9c6e5c5f14cf2f43e8b21b576 
	I1028 05:40:23.168989   14044 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1028 05:40:23.169000   14044 cni.go:84] Creating CNI manager for ""
	I1028 05:40:23.169008   14044 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:40:23.176172   14044 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1028 05:40:23.179151   14044 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1028 05:40:23.182409   14044 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
	I1028 05:40:23.187111   14044 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1028 05:40:23.187161   14044 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1028 05:40:23.187232   14044 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes stopped-upgrade-871000 minikube.k8s.io/updated_at=2024_10_28T05_40_23_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=stopped-upgrade-871000 minikube.k8s.io/primary=true
	I1028 05:40:23.226995   14044 kubeadm.go:1113] duration metric: took 39.875959ms to wait for elevateKubeSystemPrivileges
	I1028 05:40:23.227017   14044 ops.go:34] apiserver oom_adj: -16
	I1028 05:40:23.236987   14044 kubeadm.go:394] duration metric: took 4m11.585988458s to StartCluster
	I1028 05:40:23.237004   14044 settings.go:142] acquiring lock: {Name:mkccfb5f47d0974e890d9ac591452228f9b915fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:40:23.237098   14044 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:40:23.237549   14044 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/kubeconfig: {Name:mk1f492e0e3be5b70a817bcbef170c65e4c41fed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:40:23.237767   14044 start.go:235] Will wait 6m0s for node &{Name: IP:10.0.2.15 Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:40:23.237776   14044 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 05:40:23.237815   14044 addons.go:69] Setting storage-provisioner=true in profile "stopped-upgrade-871000"
	I1028 05:40:23.237823   14044 addons.go:234] Setting addon storage-provisioner=true in "stopped-upgrade-871000"
	I1028 05:40:23.237853   14044 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:40:23.237891   14044 addons.go:69] Setting default-storageclass=true in profile "stopped-upgrade-871000"
	I1028 05:40:23.237901   14044 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "stopped-upgrade-871000"
	W1028 05:40:23.237895   14044 addons.go:243] addon storage-provisioner should already be in state true
	I1028 05:40:23.237916   14044 host.go:66] Checking if "stopped-upgrade-871000" exists ...
	I1028 05:40:23.238308   14044 retry.go:31] will retry after 664.216304ms: connect: dial unix /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/monitor: connect: connection refused
	I1028 05:40:23.239024   14044 kapi.go:59] client config for stopped-upgrade-871000: &rest.Config{Host:"https://10.0.2.15:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/stopped-upgrade-871000/client.key", CAFile:"/Users/jenkins/minikube-integration/19865-11397/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[
]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1021ae680), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I1028 05:40:23.239150   14044 addons.go:234] Setting addon default-storageclass=true in "stopped-upgrade-871000"
	W1028 05:40:23.239154   14044 addons.go:243] addon default-storageclass should already be in state true
	I1028 05:40:23.239161   14044 host.go:66] Checking if "stopped-upgrade-871000" exists ...
	I1028 05:40:23.239663   14044 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 05:40:23.239668   14044 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 05:40:23.239679   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:40:23.242105   14044 out.go:177] * Verifying Kubernetes components...
	I1028 05:40:23.250102   14044 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 05:40:23.340500   14044 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 05:40:23.345650   14044 api_server.go:52] waiting for apiserver process to appear ...
	I1028 05:40:23.345704   14044 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 05:40:23.347571   14044 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 05:40:23.350506   14044 api_server.go:72] duration metric: took 112.727875ms to wait for apiserver process to appear ...
	I1028 05:40:23.350514   14044 api_server.go:88] waiting for apiserver healthz status ...
	I1028 05:40:23.350521   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:23.655291   14044 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I1028 05:40:23.655301   14044 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I1028 05:40:23.909279   14044 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 05:40:23.913354   14044 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:40:23.913364   14044 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 05:40:23.913377   14044 sshutil.go:53] new ssh client: &{IP:localhost Port:59232 SSHKeyPath:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/stopped-upgrade-871000/id_rsa Username:docker}
	I1028 05:40:23.948308   14044 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 05:40:28.352595   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:28.352645   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:33.352945   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:33.352967   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:38.353262   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:38.353285   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:43.354041   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:43.354080   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:48.354835   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:48.354863   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:40:53.355700   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:53.355732   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	W1028 05:40:53.657687   14044 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://10.0.2.15:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 10.0.2.15:8443: i/o timeout]
	I1028 05:40:53.663009   14044 out.go:177] * Enabled addons: storage-provisioner
	I1028 05:40:53.671028   14044 addons.go:510] duration metric: took 30.433186916s for enable addons: enabled=[storage-provisioner]
	I1028 05:40:58.357079   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:40:58.357119   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:03.358536   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:03.358554   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:08.360160   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:08.360236   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:13.362725   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:13.362754   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:18.364944   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:18.364979   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:23.367214   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:23.367416   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:41:23.422338   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:41:23.422414   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:41:23.433338   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:41:23.433418   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:41:23.443433   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:41:23.443510   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:41:23.454322   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:41:23.454397   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:41:23.465178   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:41:23.465281   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:41:23.475906   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:41:23.475974   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:41:23.485887   14044 logs.go:282] 0 containers: []
	W1028 05:41:23.485900   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:41:23.485966   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:41:23.500714   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:41:23.500731   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:41:23.500737   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:41:23.537465   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:41:23.537478   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:41:23.548798   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:41:23.548807   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:41:23.560617   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:41:23.560629   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:41:23.585853   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:41:23.585861   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:41:23.590458   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:41:23.590466   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:41:23.606821   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:41:23.606832   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:41:23.620905   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:41:23.620914   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:41:23.635821   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:41:23.635831   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:41:23.647412   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:41:23.647424   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:41:23.665222   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:41:23.665232   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:41:23.676471   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:41:23.676480   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:41:23.690675   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:41:23.690686   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:41:26.226590   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:31.229360   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:31.229587   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:41:31.242890   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:41:31.242974   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:41:31.253564   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:41:31.253637   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:41:31.264423   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:41:31.264494   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:41:31.274870   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:41:31.274946   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:41:31.285077   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:41:31.285155   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:41:31.296202   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:41:31.296278   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:41:31.306152   14044 logs.go:282] 0 containers: []
	W1028 05:41:31.306169   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:41:31.306234   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:41:31.316561   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:41:31.316576   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:41:31.316581   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:41:31.354121   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:41:31.354134   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:41:31.369044   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:41:31.369056   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:41:31.382977   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:41:31.382988   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:41:31.397715   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:41:31.397727   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:41:31.409151   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:41:31.409165   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:41:31.430813   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:41:31.430822   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:41:31.454759   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:41:31.454772   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:41:31.491146   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:41:31.491155   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:41:31.505566   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:41:31.505578   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:41:31.516503   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:41:31.516517   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:41:31.529273   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:41:31.529287   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:41:31.540981   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:41:31.540994   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:41:34.047836   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:39.050781   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:39.051284   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:41:39.098243   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:41:39.098380   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:41:39.118290   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:41:39.118389   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:41:39.132788   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:41:39.132880   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:41:39.144661   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:41:39.144737   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:41:39.154996   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:41:39.155075   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:41:39.165766   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:41:39.165831   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:41:39.175804   14044 logs.go:282] 0 containers: []
	W1028 05:41:39.175813   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:41:39.175878   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:41:39.186338   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:41:39.186353   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:41:39.186358   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:41:39.190849   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:41:39.190857   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:41:39.202187   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:41:39.202199   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:41:39.214392   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:41:39.214403   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:41:39.232350   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:41:39.232363   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:41:39.257333   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:41:39.257344   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:41:39.273272   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:41:39.273281   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:41:39.285247   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:41:39.285258   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:41:39.296573   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:41:39.296588   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:41:39.330627   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:41:39.330635   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:41:39.364448   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:41:39.364459   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:41:39.386485   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:41:39.386503   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:41:39.402519   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:41:39.402536   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:41:41.916166   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:46.918485   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:46.919093   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:41:46.962790   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:41:46.962924   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:41:46.985407   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:41:46.985526   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:41:47.000113   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:41:47.000200   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:41:47.011993   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:41:47.012063   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:41:47.023091   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:41:47.023157   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:41:47.033627   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:41:47.033707   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:41:47.044352   14044 logs.go:282] 0 containers: []
	W1028 05:41:47.044363   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:41:47.044427   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:41:47.061068   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:41:47.061084   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:41:47.061091   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:41:47.095734   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:41:47.095742   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:41:47.130327   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:41:47.130341   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:41:47.144527   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:41:47.144542   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:41:47.166558   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:41:47.166568   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:41:47.192323   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:41:47.192346   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:41:47.199518   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:41:47.199530   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:41:47.215204   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:41:47.215217   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:41:47.230425   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:41:47.230435   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:41:47.243047   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:41:47.243056   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:41:47.257793   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:41:47.257801   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:41:47.270793   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:41:47.270806   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:41:47.282473   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:41:47.282481   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:41:49.795945   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:41:54.798448   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:41:54.798957   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:41:54.844506   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:41:54.844652   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:41:54.865110   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:41:54.865216   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:41:54.879501   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:41:54.879581   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:41:54.891493   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:41:54.891571   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:41:54.902025   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:41:54.902100   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:41:54.912702   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:41:54.912780   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:41:54.923870   14044 logs.go:282] 0 containers: []
	W1028 05:41:54.923882   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:41:54.923948   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:41:54.934140   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:41:54.934159   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:41:54.934164   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:41:54.946509   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:41:54.946523   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:41:54.964295   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:41:54.964307   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:41:55.000780   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:41:55.000789   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:41:55.036440   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:41:55.036451   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:41:55.051133   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:41:55.051143   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:41:55.065890   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:41:55.065903   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:41:55.077938   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:41:55.077951   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:41:55.103353   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:41:55.103366   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:41:55.126393   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:41:55.126404   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:41:55.137731   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:41:55.137746   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:41:55.142367   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:41:55.142374   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:41:55.154520   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:41:55.154534   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:41:57.668223   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:02.670944   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:02.671565   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:02.713636   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:02.713791   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:02.736040   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:02.736182   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:02.755509   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:42:02.755601   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:02.767635   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:02.767714   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:02.778586   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:02.778671   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:02.789734   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:02.789811   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:02.800224   14044 logs.go:282] 0 containers: []
	W1028 05:42:02.800235   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:02.800302   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:02.810440   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:02.810458   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:02.810463   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:02.814874   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:02.814883   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:02.828888   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:02.828901   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:02.844457   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:02.844469   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:02.856012   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:02.856024   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:02.880940   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:02.880947   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:02.892679   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:02.892692   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:02.910123   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:02.910132   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:02.921515   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:02.921527   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:02.955289   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:02.955296   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:02.994996   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:02.995008   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:03.009957   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:03.009971   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:03.024948   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:03.024962   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:05.538592   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:10.541442   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:10.541988   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:10.580877   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:10.581027   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:10.605706   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:10.605805   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:10.619850   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:42:10.619933   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:10.632053   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:10.632146   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:10.642790   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:10.642868   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:10.653672   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:10.653753   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:10.664882   14044 logs.go:282] 0 containers: []
	W1028 05:42:10.664892   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:10.664960   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:10.675342   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:10.675357   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:10.675362   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:10.690789   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:10.690802   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:10.702547   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:10.702560   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:10.722426   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:10.722438   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:10.734627   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:10.734638   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:10.768194   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:10.768204   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:10.772565   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:10.772575   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:10.790342   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:10.790351   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:10.819202   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:10.819216   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:10.844978   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:10.844989   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:10.856549   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:10.856559   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:10.891385   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:10.891398   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:10.903827   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:10.903870   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:13.422998   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:18.424212   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:18.424722   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:18.459787   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:18.459933   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:18.484936   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:18.485031   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:18.505049   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:42:18.505131   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:18.515686   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:18.515762   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:18.526113   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:18.526192   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:18.536759   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:18.536831   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:18.550824   14044 logs.go:282] 0 containers: []
	W1028 05:42:18.550835   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:18.550900   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:18.561360   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:18.561372   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:18.561377   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:18.582413   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:18.582423   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:18.595843   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:18.595856   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:18.630381   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:18.630393   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:18.644387   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:18.644397   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:18.656318   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:18.656327   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:18.667400   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:18.667411   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:18.682043   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:18.682055   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:18.696200   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:18.696212   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:18.700959   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:18.700967   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:18.738714   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:18.738724   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:18.753229   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:18.753243   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:18.764681   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:18.764690   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:21.291850   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:26.294447   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:26.294838   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:26.328397   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:26.328551   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:26.348381   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:26.348478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:26.362712   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:42:26.362797   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:26.375079   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:26.375150   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:26.386112   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:26.386194   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:26.396821   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:26.396903   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:26.417297   14044 logs.go:282] 0 containers: []
	W1028 05:42:26.417306   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:26.417368   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:26.428726   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:26.428748   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:26.428752   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:26.464477   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:26.464490   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:26.482663   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:26.482675   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:26.498827   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:26.498838   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:26.524033   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:26.524043   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:26.535407   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:26.535420   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:26.539703   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:26.539710   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:26.573931   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:26.573947   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:26.589224   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:26.589239   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:26.601522   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:26.601532   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:26.613560   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:26.613570   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:26.625118   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:26.625127   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:26.642342   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:26.642352   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:29.156593   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:34.159101   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:34.159425   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:34.187284   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:34.187427   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:34.204554   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:34.204640   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:34.222891   14044 logs.go:282] 2 containers: [07d23992c04a ae8d295515cc]
	I1028 05:42:34.222963   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:34.234955   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:34.235026   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:34.245956   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:34.246030   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:34.256787   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:34.256859   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:34.268481   14044 logs.go:282] 0 containers: []
	W1028 05:42:34.268493   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:34.268545   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:34.279596   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:34.279608   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:34.279614   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:34.284427   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:34.284434   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:34.298476   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:34.298487   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:34.328289   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:34.328300   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:34.347316   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:34.347327   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:34.388110   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:34.388130   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:34.432461   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:34.432471   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:34.457522   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:34.457530   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:34.493138   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:34.493148   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:34.507889   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:34.507899   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:34.519364   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:34.519374   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:34.534155   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:34.534165   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:34.546290   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:34.546300   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:37.085092   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:42.087693   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:42.088327   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:42.126552   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:42.126705   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:42.149103   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:42.149217   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:42.168160   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:42:42.168248   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:42.183072   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:42.183149   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:42.193806   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:42.193881   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:42.203984   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:42.204052   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:42.213772   14044 logs.go:282] 0 containers: []
	W1028 05:42:42.213784   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:42.213847   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:42.224407   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:42.224423   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:42.224429   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:42.229132   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:42.229140   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:42.240642   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:42.240652   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:42.257760   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:42.257772   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:42.269463   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:42.269475   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:42.280767   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:42.280781   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:42.314659   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:42.314671   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:42.328992   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:42:42.329003   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:42:42.340313   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:42.340323   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:42.365437   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:42.365445   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:42.379408   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:42.379419   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:42.391296   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:42.391309   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:42.427403   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:42:42.427411   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:42:42.439096   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:42.439107   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:42.453916   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:42.453929   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:44.967273   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:49.969607   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:49.970111   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:50.013129   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:50.013283   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:50.035383   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:50.035517   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:50.050712   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:42:50.050800   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:50.063395   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:50.063474   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:50.075349   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:50.075431   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:50.085895   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:50.085970   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:50.096280   14044 logs.go:282] 0 containers: []
	W1028 05:42:50.096290   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:50.096353   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:50.106666   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:50.106681   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:50.106687   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:50.130902   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:50.130911   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:50.142450   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:50.142463   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:50.146525   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:50.146535   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:50.180050   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:50.180064   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:50.195018   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:50.195031   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:50.206356   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:50.206368   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:50.222072   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:50.222098   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:50.240977   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:50.240987   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:50.259347   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:50.259357   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:50.295890   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:42:50.295910   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:42:50.318674   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:50.318684   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:42:50.330469   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:50.330484   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:50.342103   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:42:50.342113   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:42:50.353890   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:50.353903   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:52.870489   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:42:57.872860   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:42:57.873304   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:42:57.913961   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:42:57.914100   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:42:57.934982   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:42:57.935104   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:42:57.951127   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:42:57.951211   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:42:57.963353   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:42:57.963422   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:42:57.975259   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:42:57.975341   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:42:57.986162   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:42:57.986233   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:42:57.996376   14044 logs.go:282] 0 containers: []
	W1028 05:42:57.996388   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:42:57.996454   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:42:58.007057   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:42:58.007074   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:42:58.007080   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:42:58.020994   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:42:58.021005   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:42:58.032349   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:42:58.032363   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:42:58.057027   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:42:58.057035   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:42:58.068535   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:42:58.068549   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:42:58.072789   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:42:58.072797   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:42:58.106479   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:42:58.106491   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:42:58.122709   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:42:58.122722   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:42:58.158855   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:42:58.158862   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:42:58.179643   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:42:58.179654   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:42:58.198696   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:42:58.198705   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:42:58.210544   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:42:58.210553   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:42:58.222735   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:42:58.222746   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:42:58.236760   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:42:58.236770   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:42:58.248249   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:42:58.248262   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:00.766266   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:05.769299   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:05.769791   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:05.816198   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:05.816370   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:05.835639   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:05.835737   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:05.851847   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:05.851929   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:05.863390   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:05.863468   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:05.874172   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:05.874248   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:05.884982   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:05.885054   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:05.895814   14044 logs.go:282] 0 containers: []
	W1028 05:43:05.895827   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:05.895884   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:05.906056   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:05.906075   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:05.906080   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:05.922391   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:05.922403   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:05.940040   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:05.940050   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:05.952012   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:05.952025   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:05.986664   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:05.986677   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:06.001192   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:06.001206   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:06.016825   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:06.016838   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:06.021112   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:06.021121   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:06.032962   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:06.032971   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:06.045004   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:06.045020   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:06.056500   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:06.056513   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:06.079991   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:06.079998   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:06.091511   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:06.091523   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:06.125748   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:06.125764   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:06.137871   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:06.137884   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:08.651934   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:13.654154   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:13.654334   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:13.667925   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:13.668002   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:13.678209   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:13.678286   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:13.688716   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:13.688803   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:13.698870   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:13.698940   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:13.709404   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:13.709478   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:13.719640   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:13.719710   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:13.736547   14044 logs.go:282] 0 containers: []
	W1028 05:43:13.736557   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:13.736612   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:13.753321   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:13.753338   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:13.753343   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:13.778234   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:13.778242   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:13.789394   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:13.789404   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:13.808303   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:13.808316   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:13.826939   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:13.826951   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:13.845474   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:13.845485   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:13.856266   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:13.856279   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:13.870545   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:13.870554   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:13.882544   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:13.882558   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:13.887249   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:13.887258   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:13.901741   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:13.901751   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:13.915455   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:13.915468   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:13.948716   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:13.948730   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:13.960794   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:13.960804   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:13.997292   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:13.997304   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:16.510905   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:21.513239   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:21.513338   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:21.526064   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:21.526139   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:21.537761   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:21.537819   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:21.549448   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:21.549524   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:21.560189   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:21.560264   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:21.572084   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:21.572146   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:21.584799   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:21.584864   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:21.598258   14044 logs.go:282] 0 containers: []
	W1028 05:43:21.598268   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:21.598327   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:21.609220   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:21.609237   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:21.609243   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:21.629411   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:21.629431   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:21.642386   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:21.642397   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:21.678584   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:21.678604   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:21.694313   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:21.694325   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:21.706352   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:21.706365   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:21.723983   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:21.723997   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:21.741030   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:21.741038   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:21.745179   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:21.745184   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:21.759335   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:21.759346   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:21.773654   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:21.773665   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:21.798173   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:21.798185   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:21.837290   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:21.837302   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:21.849942   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:21.849954   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:21.863786   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:21.863796   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:24.381303   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:29.384170   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:29.384731   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:29.427128   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:29.427269   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:29.448860   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:29.448987   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:29.464314   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:29.464399   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:29.476998   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:29.477069   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:29.488450   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:29.488523   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:29.505054   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:29.505132   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:29.515701   14044 logs.go:282] 0 containers: []
	W1028 05:43:29.515715   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:29.515776   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:29.527009   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:29.527022   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:29.527027   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:29.531526   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:29.531535   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:29.573663   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:29.573678   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:29.587331   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:29.587347   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:29.625802   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:29.625824   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:29.644343   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:29.644359   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:29.664458   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:29.664478   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:29.691229   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:29.691250   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:29.705761   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:29.705773   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:29.720809   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:29.720819   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:29.732643   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:29.732657   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:29.744714   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:29.744726   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:29.756542   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:29.756554   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:29.768996   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:29.769008   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:29.784375   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:29.784387   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:32.299295   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:37.301602   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:37.302107   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:37.341465   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:37.341609   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:37.364255   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:37.364383   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:37.379739   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:37.379826   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:37.392635   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:37.392716   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:37.403318   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:37.403391   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:37.413667   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:37.413735   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:37.423829   14044 logs.go:282] 0 containers: []
	W1028 05:43:37.423843   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:37.423910   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:37.434931   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:37.434952   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:37.434958   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:37.439481   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:37.439490   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:37.453688   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:37.453697   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:37.471852   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:37.471860   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:37.484147   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:37.484155   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:37.509217   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:37.509225   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:37.544333   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:37.544339   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:37.555954   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:37.555964   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:37.567713   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:37.567724   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:37.579529   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:37.579539   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:37.591135   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:37.591144   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:37.608112   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:37.608122   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:37.620356   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:37.620369   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:37.633376   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:37.633388   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:37.647535   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:37.647546   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:40.183398   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:45.184902   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:45.184988   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:45.200737   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:45.200799   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:45.211947   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:45.212008   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:45.223226   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:45.223301   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:45.235100   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:45.235170   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:45.252284   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:45.252346   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:45.263349   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:45.263416   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:45.277257   14044 logs.go:282] 0 containers: []
	W1028 05:43:45.277268   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:45.277329   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:45.289191   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:45.289207   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:45.289212   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:45.295481   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:45.295492   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:45.307971   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:45.307982   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:45.319932   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:45.319942   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:45.340509   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:45.340524   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:45.355572   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:45.355584   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:45.391596   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:45.391610   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:45.406904   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:45.406916   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:45.419931   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:45.419943   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:45.432299   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:45.432312   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:45.469523   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:45.469536   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:45.491913   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:45.491925   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:45.505193   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:45.505204   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:45.520284   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:45.520296   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:45.532469   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:45.532482   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:48.059366   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:43:53.062321   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:43:53.062709   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:43:53.090586   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:43:53.090725   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:43:53.108661   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:43:53.108756   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:43:53.126666   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:43:53.126747   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:43:53.137326   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:43:53.137406   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:43:53.147776   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:43:53.147850   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:43:53.158062   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:43:53.158131   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:43:53.172161   14044 logs.go:282] 0 containers: []
	W1028 05:43:53.172172   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:43:53.172229   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:43:53.182841   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:43:53.182860   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:43:53.182866   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:43:53.194445   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:43:53.194456   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:43:53.208895   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:43:53.208904   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:43:53.223778   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:43:53.223788   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:43:53.238452   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:43:53.238461   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:43:53.253003   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:43:53.253012   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:43:53.264850   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:43:53.264860   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:43:53.276274   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:43:53.276283   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:43:53.299186   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:43:53.299193   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:43:53.335727   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:43:53.335738   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:43:53.347693   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:43:53.347708   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:43:53.351791   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:43:53.351797   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:43:53.368669   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:43:53.368679   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:43:53.380059   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:43:53.380071   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:43:53.391731   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:43:53.391742   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:43:55.929465   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:44:00.932411   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:44:00.932557   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:44:00.944563   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:44:00.944642   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:44:00.954759   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:44:00.954826   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:44:00.965645   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:44:00.965722   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:44:00.975659   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:44:00.975738   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:44:00.985686   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:44:00.985752   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:44:00.996286   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:44:00.996371   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:44:01.006742   14044 logs.go:282] 0 containers: []
	W1028 05:44:01.006753   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:44:01.006819   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:44:01.017491   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:44:01.017515   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:44:01.017520   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:44:01.022236   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:44:01.022245   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:44:01.036401   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:44:01.036414   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:44:01.049058   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:44:01.049073   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:44:01.067142   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:44:01.067153   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:44:01.078511   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:44:01.078521   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:44:01.090854   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:44:01.090868   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:44:01.105650   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:44:01.105662   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:44:01.117209   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:44:01.117222   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:44:01.135754   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:44:01.135768   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:44:01.158868   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:44:01.158875   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:44:01.193630   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:44:01.193640   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:44:01.227205   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:44:01.227219   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:44:01.241213   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:44:01.241225   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:44:01.253004   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:44:01.253020   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:44:03.770286   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:44:08.772852   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:44:08.773205   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:44:08.806294   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:44:08.806433   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:44:08.825095   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:44:08.825198   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:44:08.840269   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:44:08.840370   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:44:08.853225   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:44:08.853319   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:44:08.868665   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:44:08.868730   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:44:08.881670   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:44:08.881763   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:44:08.893529   14044 logs.go:282] 0 containers: []
	W1028 05:44:08.893541   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:44:08.893611   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:44:08.905304   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:44:08.905324   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:44:08.905334   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:44:08.910016   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:44:08.910026   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:44:08.924894   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:44:08.924907   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:44:08.938304   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:44:08.938316   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:44:08.964830   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:44:08.964851   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:44:08.977601   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:44:08.977612   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:44:09.013747   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:44:09.013769   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:44:09.057330   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:44:09.057345   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:44:09.072416   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:44:09.072433   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:44:09.086073   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:44:09.086091   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:44:09.098601   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:44:09.098613   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:44:09.111082   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:44:09.111096   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:44:09.134121   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:44:09.134139   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:44:09.146880   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:44:09.146891   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:44:09.159375   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:44:09.159386   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:44:11.676576   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:44:16.676962   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:44:16.677594   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
	I1028 05:44:16.720721   14044 logs.go:282] 1 containers: [43cac8977b35]
	I1028 05:44:16.720889   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
	I1028 05:44:16.745101   14044 logs.go:282] 1 containers: [d4e8ddcb3e7f]
	I1028 05:44:16.745234   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
	I1028 05:44:16.759548   14044 logs.go:282] 4 containers: [d7625c91a40f a51d9b918227 07d23992c04a ae8d295515cc]
	I1028 05:44:16.759632   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
	I1028 05:44:16.771271   14044 logs.go:282] 1 containers: [ed58e578d099]
	I1028 05:44:16.771346   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
	I1028 05:44:16.786795   14044 logs.go:282] 1 containers: [3c9dcba8db4f]
	I1028 05:44:16.786870   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
	I1028 05:44:16.800082   14044 logs.go:282] 1 containers: [89af1a54ed81]
	I1028 05:44:16.800155   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
	I1028 05:44:16.810498   14044 logs.go:282] 0 containers: []
	W1028 05:44:16.810509   14044 logs.go:284] No container was found matching "kindnet"
	I1028 05:44:16.810575   14044 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
	I1028 05:44:16.821095   14044 logs.go:282] 1 containers: [0159af6ed1d8]
	I1028 05:44:16.821114   14044 logs.go:123] Gathering logs for dmesg ...
	I1028 05:44:16.821120   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 05:44:16.825367   14044 logs.go:123] Gathering logs for container status ...
	I1028 05:44:16.825376   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 05:44:16.836624   14044 logs.go:123] Gathering logs for kubelet ...
	I1028 05:44:16.836637   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 05:44:16.872323   14044 logs.go:123] Gathering logs for kube-apiserver [43cac8977b35] ...
	I1028 05:44:16.872331   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 43cac8977b35"
	I1028 05:44:16.886803   14044 logs.go:123] Gathering logs for coredns [ae8d295515cc] ...
	I1028 05:44:16.886816   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae8d295515cc"
	I1028 05:44:16.898480   14044 logs.go:123] Gathering logs for kube-scheduler [ed58e578d099] ...
	I1028 05:44:16.898492   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed58e578d099"
	I1028 05:44:16.914125   14044 logs.go:123] Gathering logs for kube-controller-manager [89af1a54ed81] ...
	I1028 05:44:16.914137   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 89af1a54ed81"
	I1028 05:44:16.933557   14044 logs.go:123] Gathering logs for etcd [d4e8ddcb3e7f] ...
	I1028 05:44:16.933567   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d4e8ddcb3e7f"
	I1028 05:44:16.951717   14044 logs.go:123] Gathering logs for coredns [a51d9b918227] ...
	I1028 05:44:16.951730   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a51d9b918227"
	I1028 05:44:16.963061   14044 logs.go:123] Gathering logs for kube-proxy [3c9dcba8db4f] ...
	I1028 05:44:16.963070   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3c9dcba8db4f"
	I1028 05:44:16.976926   14044 logs.go:123] Gathering logs for Docker ...
	I1028 05:44:16.976935   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
	I1028 05:44:17.000372   14044 logs.go:123] Gathering logs for describe nodes ...
	I1028 05:44:17.000381   14044 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 05:44:17.033904   14044 logs.go:123] Gathering logs for coredns [d7625c91a40f] ...
	I1028 05:44:17.033918   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d7625c91a40f"
	I1028 05:44:17.045295   14044 logs.go:123] Gathering logs for coredns [07d23992c04a] ...
	I1028 05:44:17.045307   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 07d23992c04a"
	I1028 05:44:17.064891   14044 logs.go:123] Gathering logs for storage-provisioner [0159af6ed1d8] ...
	I1028 05:44:17.064905   14044 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 0159af6ed1d8"
	I1028 05:44:19.578647   14044 api_server.go:253] Checking apiserver healthz at https://10.0.2.15:8443/healthz ...
	I1028 05:44:24.581516   14044 api_server.go:269] stopped: https://10.0.2.15:8443/healthz: Get "https://10.0.2.15:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I1028 05:44:24.591830   14044 out.go:201] 
	W1028 05:44:24.594837   14044 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: context deadline exceeded
	W1028 05:44:24.594846   14044 out.go:270] * 
	* 
	W1028 05:44:24.595405   14044 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:24.607725   14044 out.go:201] 

                                                
                                                
** /stderr **
version_upgrade_test.go:200: upgrade from v1.26.0 to HEAD failed: out/minikube-darwin-arm64 start -p stopped-upgrade-871000 --memory=2200 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (572.19s)

                                                
                                    
x
+
TestPause/serial/Start (9.97s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-arm64 start -p pause-357000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p pause-357000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 : exit status 80 (9.92877475s)

                                                
                                                
-- stdout --
	* [pause-357000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "pause-357000" primary control-plane node in "pause-357000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "pause-357000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p pause-357000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-arm64 start -p pause-357000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p pause-357000 -n pause-357000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p pause-357000 -n pause-357000: exit status 7 (38.834209ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-357000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (9.97s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (9.95s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 : exit status 80 (9.873455459s)

                                                
                                                
-- stdout --
	* [NoKubernetes-663000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "NoKubernetes-663000" primary control-plane node in "NoKubernetes-663000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "NoKubernetes-663000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-663000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000: exit status 7 (71.674417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-663000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (9.95s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 : exit status 80 (5.237556542s)

                                                
                                                
-- stdout --
	* [NoKubernetes-663000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-663000
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-663000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000: exit status 7 (38.084583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-663000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 : exit status 80 (5.243928125s)

                                                
                                                
-- stdout --
	* [NoKubernetes-663000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-663000
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-663000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000: exit status 7 (66.670875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-663000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 : exit status 80 (5.260457s)

                                                
                                                
-- stdout --
	* [NoKubernetes-663000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-663000
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-663000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-663000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-663000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-663000 -n NoKubernetes-663000: exit status 7 (39.946833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-663000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (9.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p auto-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p auto-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 : exit status 80 (9.811019833s)

                                                
                                                
-- stdout --
	* [auto-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "auto-615000" primary control-plane node in "auto-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "auto-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:42:32.722327   14281 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:42:32.722497   14281 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:32.722500   14281 out.go:358] Setting ErrFile to fd 2...
	I1028 05:42:32.722503   14281 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:32.722644   14281 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:42:32.723847   14281 out.go:352] Setting JSON to false
	I1028 05:42:32.742031   14281 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7923,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:42:32.742108   14281 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:42:32.748405   14281 out.go:177] * [auto-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:42:32.755349   14281 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:42:32.755378   14281 notify.go:220] Checking for updates...
	I1028 05:42:32.762373   14281 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:42:32.765328   14281 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:42:32.768363   14281 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:42:32.771288   14281 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:42:32.774367   14281 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:42:32.777729   14281 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:42:32.777809   14281 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:42:32.777864   14281 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:42:32.782218   14281 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:42:32.789296   14281 start.go:297] selected driver: qemu2
	I1028 05:42:32.789302   14281 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:42:32.789308   14281 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:42:32.791764   14281 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:42:32.795397   14281 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:42:32.798452   14281 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:42:32.798478   14281 cni.go:84] Creating CNI manager for ""
	I1028 05:42:32.798504   14281 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:42:32.798509   14281 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:42:32.798557   14281 start.go:340] cluster config:
	{Name:auto-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:auto-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:dock
er CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_clie
nt SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:42:32.803127   14281 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:42:32.811308   14281 out.go:177] * Starting "auto-615000" primary control-plane node in "auto-615000" cluster
	I1028 05:42:32.815303   14281 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:42:32.815322   14281 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:42:32.815330   14281 cache.go:56] Caching tarball of preloaded images
	I1028 05:42:32.815401   14281 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:42:32.815407   14281 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:42:32.815455   14281 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/auto-615000/config.json ...
	I1028 05:42:32.815466   14281 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/auto-615000/config.json: {Name:mkf580607638a31b2de9840eab3bb098cb97f828 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:42:32.815836   14281 start.go:360] acquireMachinesLock for auto-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:42:32.815883   14281 start.go:364] duration metric: took 41.416µs to acquireMachinesLock for "auto-615000"
	I1028 05:42:32.815895   14281 start.go:93] Provisioning new machine with config: &{Name:auto-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.31.2 ClusterName:auto-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:42:32.815932   14281 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:42:32.819320   14281 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:42:32.835292   14281 start.go:159] libmachine.API.Create for "auto-615000" (driver="qemu2")
	I1028 05:42:32.835318   14281 client.go:168] LocalClient.Create starting
	I1028 05:42:32.835388   14281 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:42:32.835425   14281 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:32.835436   14281 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:32.835480   14281 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:42:32.835513   14281 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:32.835520   14281 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:32.835904   14281 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:42:32.993490   14281 main.go:141] libmachine: Creating SSH key...
	I1028 05:42:33.077160   14281 main.go:141] libmachine: Creating Disk image...
	I1028 05:42:33.077171   14281 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:42:33.077370   14281 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:33.087329   14281 main.go:141] libmachine: STDOUT: 
	I1028 05:42:33.087346   14281 main.go:141] libmachine: STDERR: 
	I1028 05:42:33.087408   14281 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2 +20000M
	I1028 05:42:33.096105   14281 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:42:33.096127   14281 main.go:141] libmachine: STDERR: 
	I1028 05:42:33.096141   14281 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:33.096146   14281 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:42:33.096162   14281 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:42:33.096188   14281 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:b4:d9:a2:29:60 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:33.098173   14281 main.go:141] libmachine: STDOUT: 
	I1028 05:42:33.098187   14281 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:42:33.098207   14281 client.go:171] duration metric: took 262.882084ms to LocalClient.Create
	I1028 05:42:35.100321   14281 start.go:128] duration metric: took 2.284370959s to createHost
	I1028 05:42:35.100354   14281 start.go:83] releasing machines lock for "auto-615000", held for 2.28446075s
	W1028 05:42:35.100405   14281 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:35.106469   14281 out.go:177] * Deleting "auto-615000" in qemu2 ...
	W1028 05:42:35.117355   14281 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:35.117369   14281 start.go:729] Will try again in 5 seconds ...
	I1028 05:42:40.119664   14281 start.go:360] acquireMachinesLock for auto-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:42:40.120279   14281 start.go:364] duration metric: took 496.625µs to acquireMachinesLock for "auto-615000"
	I1028 05:42:40.120419   14281 start.go:93] Provisioning new machine with config: &{Name:auto-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubern
etesVersion:v1.31.2 ClusterName:auto-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP
ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:42:40.120719   14281 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:42:40.126966   14281 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:42:40.175426   14281 start.go:159] libmachine.API.Create for "auto-615000" (driver="qemu2")
	I1028 05:42:40.175488   14281 client.go:168] LocalClient.Create starting
	I1028 05:42:40.175659   14281 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:42:40.175743   14281 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:40.175759   14281 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:40.175826   14281 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:42:40.175886   14281 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:40.175902   14281 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:40.176436   14281 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:42:40.342318   14281 main.go:141] libmachine: Creating SSH key...
	I1028 05:42:40.444170   14281 main.go:141] libmachine: Creating Disk image...
	I1028 05:42:40.444178   14281 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:42:40.444369   14281 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:40.454565   14281 main.go:141] libmachine: STDOUT: 
	I1028 05:42:40.454582   14281 main.go:141] libmachine: STDERR: 
	I1028 05:42:40.454655   14281 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2 +20000M
	I1028 05:42:40.463240   14281 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:42:40.463258   14281 main.go:141] libmachine: STDERR: 
	I1028 05:42:40.463273   14281 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:40.463277   14281 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:42:40.463288   14281 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:42:40.463336   14281 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:55:93:28:28:2e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/auto-615000/disk.qcow2
	I1028 05:42:40.465214   14281 main.go:141] libmachine: STDOUT: 
	I1028 05:42:40.465226   14281 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:42:40.465240   14281 client.go:171] duration metric: took 289.746166ms to LocalClient.Create
	I1028 05:42:42.467288   14281 start.go:128] duration metric: took 2.346543208s to createHost
	I1028 05:42:42.467303   14281 start.go:83] releasing machines lock for "auto-615000", held for 2.346999083s
	W1028 05:42:42.467372   14281 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p auto-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p auto-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:42.473612   14281 out.go:201] 
	W1028 05:42:42.477597   14281 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:42:42.477607   14281 out.go:270] * 
	* 
	W1028 05:42:42.478141   14281 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:42:42.493493   14281 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/auto/Start (9.81s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (9.9s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kindnet-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kindnet-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 : exit status 80 (9.897084459s)

                                                
                                                
-- stdout --
	* [kindnet-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kindnet-615000" primary control-plane node in "kindnet-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kindnet-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:42:44.919700   14392 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:42:44.919866   14392 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:44.919869   14392 out.go:358] Setting ErrFile to fd 2...
	I1028 05:42:44.919871   14392 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:44.920014   14392 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:42:44.921261   14392 out.go:352] Setting JSON to false
	I1028 05:42:44.939407   14392 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7935,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:42:44.939476   14392 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:42:44.944280   14392 out.go:177] * [kindnet-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:42:44.951162   14392 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:42:44.951242   14392 notify.go:220] Checking for updates...
	I1028 05:42:44.957175   14392 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:42:44.960186   14392 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:42:44.964183   14392 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:42:44.967215   14392 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:42:44.970175   14392 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:42:44.973493   14392 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:42:44.973569   14392 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:42:44.973629   14392 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:42:44.977183   14392 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:42:44.984117   14392 start.go:297] selected driver: qemu2
	I1028 05:42:44.984121   14392 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:42:44.984126   14392 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:42:44.986535   14392 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:42:44.989156   14392 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:42:44.992163   14392 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:42:44.992180   14392 cni.go:84] Creating CNI manager for "kindnet"
	I1028 05:42:44.992184   14392 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I1028 05:42:44.992220   14392 start.go:340] cluster config:
	{Name:kindnet-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:kindnet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/sock
et_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:42:44.996547   14392 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:42:45.004094   14392 out.go:177] * Starting "kindnet-615000" primary control-plane node in "kindnet-615000" cluster
	I1028 05:42:45.008149   14392 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:42:45.008165   14392 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:42:45.008174   14392 cache.go:56] Caching tarball of preloaded images
	I1028 05:42:45.008254   14392 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:42:45.008259   14392 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:42:45.008319   14392 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kindnet-615000/config.json ...
	I1028 05:42:45.008330   14392 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kindnet-615000/config.json: {Name:mk432a714fd19ae4c97d25ddb364f8e02660f1e6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:42:45.008561   14392 start.go:360] acquireMachinesLock for kindnet-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:42:45.008603   14392 start.go:364] duration metric: took 37.042µs to acquireMachinesLock for "kindnet-615000"
	I1028 05:42:45.008617   14392 start.go:93] Provisioning new machine with config: &{Name:kindnet-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:kindnet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:42:45.008641   14392 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:42:45.017172   14392 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:42:45.031914   14392 start.go:159] libmachine.API.Create for "kindnet-615000" (driver="qemu2")
	I1028 05:42:45.031944   14392 client.go:168] LocalClient.Create starting
	I1028 05:42:45.032034   14392 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:42:45.032069   14392 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:45.032081   14392 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:45.032121   14392 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:42:45.032149   14392 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:45.032160   14392 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:45.032510   14392 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:42:45.187648   14392 main.go:141] libmachine: Creating SSH key...
	I1028 05:42:45.350236   14392 main.go:141] libmachine: Creating Disk image...
	I1028 05:42:45.350245   14392 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:42:45.350466   14392 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:45.361317   14392 main.go:141] libmachine: STDOUT: 
	I1028 05:42:45.361341   14392 main.go:141] libmachine: STDERR: 
	I1028 05:42:45.361413   14392 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2 +20000M
	I1028 05:42:45.370171   14392 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:42:45.370186   14392 main.go:141] libmachine: STDERR: 
	I1028 05:42:45.370197   14392 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:45.370205   14392 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:42:45.370218   14392 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:42:45.370250   14392 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=16:44:ba:17:dd:51 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:45.372081   14392 main.go:141] libmachine: STDOUT: 
	I1028 05:42:45.372096   14392 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:42:45.372114   14392 client.go:171] duration metric: took 340.164375ms to LocalClient.Create
	I1028 05:42:47.374330   14392 start.go:128] duration metric: took 2.365653416s to createHost
	I1028 05:42:47.374423   14392 start.go:83] releasing machines lock for "kindnet-615000", held for 2.365805875s
	W1028 05:42:47.374481   14392 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:47.388746   14392 out.go:177] * Deleting "kindnet-615000" in qemu2 ...
	W1028 05:42:47.412776   14392 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:47.412798   14392 start.go:729] Will try again in 5 seconds ...
	I1028 05:42:52.414968   14392 start.go:360] acquireMachinesLock for kindnet-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:42:52.415647   14392 start.go:364] duration metric: took 574.084µs to acquireMachinesLock for "kindnet-615000"
	I1028 05:42:52.415766   14392 start.go:93] Provisioning new machine with config: &{Name:kindnet-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:kindnet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:42:52.416082   14392 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:42:52.426582   14392 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:42:52.476018   14392 start.go:159] libmachine.API.Create for "kindnet-615000" (driver="qemu2")
	I1028 05:42:52.476076   14392 client.go:168] LocalClient.Create starting
	I1028 05:42:52.476216   14392 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:42:52.476292   14392 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:52.476309   14392 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:52.476371   14392 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:42:52.476438   14392 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:52.476450   14392 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:52.477226   14392 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:42:52.644423   14392 main.go:141] libmachine: Creating SSH key...
	I1028 05:42:52.716655   14392 main.go:141] libmachine: Creating Disk image...
	I1028 05:42:52.716661   14392 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:42:52.716852   14392 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:52.726872   14392 main.go:141] libmachine: STDOUT: 
	I1028 05:42:52.726897   14392 main.go:141] libmachine: STDERR: 
	I1028 05:42:52.726949   14392 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2 +20000M
	I1028 05:42:52.735744   14392 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:42:52.735763   14392 main.go:141] libmachine: STDERR: 
	I1028 05:42:52.735778   14392 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:52.735783   14392 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:42:52.735792   14392 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:42:52.735835   14392 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2e:64:e8:87:2e:2d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kindnet-615000/disk.qcow2
	I1028 05:42:52.737656   14392 main.go:141] libmachine: STDOUT: 
	I1028 05:42:52.737671   14392 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:42:52.737683   14392 client.go:171] duration metric: took 261.601209ms to LocalClient.Create
	I1028 05:42:54.739953   14392 start.go:128] duration metric: took 2.323823917s to createHost
	I1028 05:42:54.740109   14392 start.go:83] releasing machines lock for "kindnet-615000", held for 2.324375708s
	W1028 05:42:54.740447   14392 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p kindnet-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kindnet-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:54.750113   14392 out.go:201] 
	W1028 05:42:54.755338   14392 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:42:54.755366   14392 out.go:270] * 
	* 
	W1028 05:42:54.758193   14392 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:42:54.769165   14392 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kindnet/Start (9.90s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (9.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p calico-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p calico-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 : exit status 80 (9.766008875s)

                                                
                                                
-- stdout --
	* [calico-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "calico-615000" primary control-plane node in "calico-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "calico-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:42:57.267569   14507 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:42:57.267738   14507 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:57.267742   14507 out.go:358] Setting ErrFile to fd 2...
	I1028 05:42:57.267744   14507 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:42:57.267874   14507 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:42:57.269048   14507 out.go:352] Setting JSON to false
	I1028 05:42:57.287638   14507 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7948,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:42:57.287713   14507 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:42:57.294162   14507 out.go:177] * [calico-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:42:57.301093   14507 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:42:57.301125   14507 notify.go:220] Checking for updates...
	I1028 05:42:57.309143   14507 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:42:57.312080   14507 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:42:57.316136   14507 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:42:57.319146   14507 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:42:57.322047   14507 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:42:57.325409   14507 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:42:57.325480   14507 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:42:57.325529   14507 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:42:57.329042   14507 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:42:57.336077   14507 start.go:297] selected driver: qemu2
	I1028 05:42:57.336084   14507 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:42:57.336093   14507 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:42:57.338440   14507 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:42:57.341156   14507 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:42:57.348182   14507 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:42:57.348199   14507 cni.go:84] Creating CNI manager for "calico"
	I1028 05:42:57.348203   14507 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I1028 05:42:57.348243   14507 start.go:340] cluster config:
	{Name:calico-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:calico-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:42:57.352654   14507 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:42:57.360908   14507 out.go:177] * Starting "calico-615000" primary control-plane node in "calico-615000" cluster
	I1028 05:42:57.365029   14507 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:42:57.365053   14507 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:42:57.365060   14507 cache.go:56] Caching tarball of preloaded images
	I1028 05:42:57.365125   14507 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:42:57.365130   14507 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:42:57.365183   14507 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/calico-615000/config.json ...
	I1028 05:42:57.365193   14507 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/calico-615000/config.json: {Name:mk76896c7a3bd7142b3933a7f79f7a422ef26f0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:42:57.365529   14507 start.go:360] acquireMachinesLock for calico-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:42:57.365571   14507 start.go:364] duration metric: took 37.042µs to acquireMachinesLock for "calico-615000"
	I1028 05:42:57.365581   14507 start.go:93] Provisioning new machine with config: &{Name:calico-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:calico-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:42:57.365619   14507 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:42:57.370112   14507 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:42:57.384871   14507 start.go:159] libmachine.API.Create for "calico-615000" (driver="qemu2")
	I1028 05:42:57.384901   14507 client.go:168] LocalClient.Create starting
	I1028 05:42:57.384993   14507 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:42:57.385029   14507 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:57.385043   14507 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:57.385077   14507 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:42:57.385106   14507 main.go:141] libmachine: Decoding PEM data...
	I1028 05:42:57.385115   14507 main.go:141] libmachine: Parsing certificate...
	I1028 05:42:57.385467   14507 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:42:57.544035   14507 main.go:141] libmachine: Creating SSH key...
	I1028 05:42:57.596964   14507 main.go:141] libmachine: Creating Disk image...
	I1028 05:42:57.596973   14507 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:42:57.597181   14507 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:42:57.607421   14507 main.go:141] libmachine: STDOUT: 
	I1028 05:42:57.607437   14507 main.go:141] libmachine: STDERR: 
	I1028 05:42:57.607507   14507 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2 +20000M
	I1028 05:42:57.616274   14507 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:42:57.616298   14507 main.go:141] libmachine: STDERR: 
	I1028 05:42:57.616322   14507 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:42:57.616329   14507 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:42:57.616342   14507 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:42:57.616401   14507 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e2:3e:6d:25:83:fe -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:42:57.618274   14507 main.go:141] libmachine: STDOUT: 
	I1028 05:42:57.618289   14507 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:42:57.618310   14507 client.go:171] duration metric: took 233.401542ms to LocalClient.Create
	I1028 05:42:59.620511   14507 start.go:128] duration metric: took 2.2548565s to createHost
	I1028 05:42:59.620672   14507 start.go:83] releasing machines lock for "calico-615000", held for 2.255021666s
	W1028 05:42:59.620730   14507 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:59.630641   14507 out.go:177] * Deleting "calico-615000" in qemu2 ...
	W1028 05:42:59.657049   14507 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:42:59.657101   14507 start.go:729] Will try again in 5 seconds ...
	I1028 05:43:04.659297   14507 start.go:360] acquireMachinesLock for calico-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:04.660141   14507 start.go:364] duration metric: took 718.25µs to acquireMachinesLock for "calico-615000"
	I1028 05:43:04.660328   14507 start.go:93] Provisioning new machine with config: &{Name:calico-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:calico-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:04.660589   14507 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:04.670254   14507 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:04.715228   14507 start.go:159] libmachine.API.Create for "calico-615000" (driver="qemu2")
	I1028 05:43:04.715297   14507 client.go:168] LocalClient.Create starting
	I1028 05:43:04.715444   14507 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:04.715529   14507 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:04.715545   14507 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:04.715620   14507 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:04.715678   14507 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:04.715690   14507 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:04.716246   14507 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:04.883325   14507 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:04.939816   14507 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:04.939822   14507 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:04.940015   14507 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:43:04.949899   14507 main.go:141] libmachine: STDOUT: 
	I1028 05:43:04.949930   14507 main.go:141] libmachine: STDERR: 
	I1028 05:43:04.949982   14507 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2 +20000M
	I1028 05:43:04.958783   14507 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:04.958809   14507 main.go:141] libmachine: STDERR: 
	I1028 05:43:04.958827   14507 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:43:04.958833   14507 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:04.958840   14507 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:04.958869   14507 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=26:81:d1:41:6f:05 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/calico-615000/disk.qcow2
	I1028 05:43:04.960746   14507 main.go:141] libmachine: STDOUT: 
	I1028 05:43:04.960781   14507 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:04.960796   14507 client.go:171] duration metric: took 245.491917ms to LocalClient.Create
	I1028 05:43:06.963004   14507 start.go:128] duration metric: took 2.302362375s to createHost
	I1028 05:43:06.963107   14507 start.go:83] releasing machines lock for "calico-615000", held for 2.302917958s
	W1028 05:43:06.963540   14507 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p calico-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p calico-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:06.978901   14507 out.go:201] 
	W1028 05:43:06.982078   14507 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:43:06.982094   14507 out.go:270] * 
	* 
	W1028 05:43:06.983656   14507 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:43:06.991958   14507 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (9.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (9.83s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p custom-flannel-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p custom-flannel-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 : exit status 80 (9.824316291s)

                                                
                                                
-- stdout --
	* [custom-flannel-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "custom-flannel-615000" primary control-plane node in "custom-flannel-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "custom-flannel-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:43:09.582457   14625 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:43:09.582611   14625 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:09.582614   14625 out.go:358] Setting ErrFile to fd 2...
	I1028 05:43:09.582617   14625 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:09.582756   14625 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:43:09.583904   14625 out.go:352] Setting JSON to false
	I1028 05:43:09.602097   14625 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7960,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:43:09.602186   14625 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:43:09.609083   14625 out.go:177] * [custom-flannel-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:43:09.617081   14625 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:43:09.617174   14625 notify.go:220] Checking for updates...
	I1028 05:43:09.625077   14625 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:43:09.628054   14625 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:43:09.632080   14625 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:43:09.634969   14625 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:43:09.638066   14625 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:43:09.641554   14625 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:43:09.641632   14625 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:43:09.641681   14625 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:43:09.645955   14625 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:43:09.653049   14625 start.go:297] selected driver: qemu2
	I1028 05:43:09.653055   14625 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:43:09.653062   14625 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:43:09.655405   14625 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:43:09.659043   14625 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:43:09.662119   14625 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:43:09.662137   14625 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I1028 05:43:09.662143   14625 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I1028 05:43:09.662173   14625 start.go:340] cluster config:
	{Name:custom-flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:custom-flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClie
ntPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:43:09.666486   14625 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:43:09.675000   14625 out.go:177] * Starting "custom-flannel-615000" primary control-plane node in "custom-flannel-615000" cluster
	I1028 05:43:09.678963   14625 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:43:09.678976   14625 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:43:09.678985   14625 cache.go:56] Caching tarball of preloaded images
	I1028 05:43:09.679048   14625 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:43:09.679053   14625 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:43:09.679101   14625 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/custom-flannel-615000/config.json ...
	I1028 05:43:09.679111   14625 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/custom-flannel-615000/config.json: {Name:mkec1151068eb8f7c9f9861e0959eabb00b9e0a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:43:09.679450   14625 start.go:360] acquireMachinesLock for custom-flannel-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:09.679500   14625 start.go:364] duration metric: took 44.25µs to acquireMachinesLock for "custom-flannel-615000"
	I1028 05:43:09.679511   14625 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.2 ClusterName:custom-flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:09.679538   14625 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:09.684067   14625 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:09.699856   14625 start.go:159] libmachine.API.Create for "custom-flannel-615000" (driver="qemu2")
	I1028 05:43:09.699905   14625 client.go:168] LocalClient.Create starting
	I1028 05:43:09.699985   14625 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:09.700029   14625 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:09.700042   14625 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:09.700081   14625 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:09.700111   14625 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:09.700119   14625 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:09.700516   14625 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:09.856663   14625 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:09.946801   14625 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:09.946808   14625 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:09.946993   14625 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:09.956885   14625 main.go:141] libmachine: STDOUT: 
	I1028 05:43:09.956907   14625 main.go:141] libmachine: STDERR: 
	I1028 05:43:09.956961   14625 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2 +20000M
	I1028 05:43:09.965501   14625 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:09.965522   14625 main.go:141] libmachine: STDERR: 
	I1028 05:43:09.965542   14625 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:09.965548   14625 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:09.965560   14625 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:09.965595   14625 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a2:0f:1a:ac:a1:82 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:09.967487   14625 main.go:141] libmachine: STDOUT: 
	I1028 05:43:09.967502   14625 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:09.967520   14625 client.go:171] duration metric: took 267.60475ms to LocalClient.Create
	I1028 05:43:11.969744   14625 start.go:128] duration metric: took 2.290172459s to createHost
	I1028 05:43:11.969835   14625 start.go:83] releasing machines lock for "custom-flannel-615000", held for 2.290320125s
	W1028 05:43:11.969957   14625 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:11.985356   14625 out.go:177] * Deleting "custom-flannel-615000" in qemu2 ...
	W1028 05:43:12.009756   14625 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:12.009783   14625 start.go:729] Will try again in 5 seconds ...
	I1028 05:43:17.012044   14625 start.go:360] acquireMachinesLock for custom-flannel-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:17.012564   14625 start.go:364] duration metric: took 423.958µs to acquireMachinesLock for "custom-flannel-615000"
	I1028 05:43:17.012626   14625 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.31.2 ClusterName:custom-flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mou
ntIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:17.012833   14625 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:17.019285   14625 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:17.062279   14625 start.go:159] libmachine.API.Create for "custom-flannel-615000" (driver="qemu2")
	I1028 05:43:17.062337   14625 client.go:168] LocalClient.Create starting
	I1028 05:43:17.062492   14625 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:17.062580   14625 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:17.062603   14625 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:17.062672   14625 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:17.062731   14625 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:17.062745   14625 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:17.063506   14625 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:17.229364   14625 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:17.312485   14625 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:17.312495   14625 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:17.312704   14625 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:17.322560   14625 main.go:141] libmachine: STDOUT: 
	I1028 05:43:17.322583   14625 main.go:141] libmachine: STDERR: 
	I1028 05:43:17.322640   14625 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2 +20000M
	I1028 05:43:17.331209   14625 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:17.331242   14625 main.go:141] libmachine: STDERR: 
	I1028 05:43:17.331261   14625 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:17.331266   14625 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:17.331273   14625 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:17.331301   14625 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:ee:61:bd:2c:d3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/custom-flannel-615000/disk.qcow2
	I1028 05:43:17.333208   14625 main.go:141] libmachine: STDOUT: 
	I1028 05:43:17.333224   14625 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:17.333235   14625 client.go:171] duration metric: took 270.892ms to LocalClient.Create
	I1028 05:43:19.335438   14625 start.go:128] duration metric: took 2.322570584s to createHost
	I1028 05:43:19.335506   14625 start.go:83] releasing machines lock for "custom-flannel-615000", held for 2.322919958s
	W1028 05:43:19.335799   14625 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:19.345438   14625 out.go:201] 
	W1028 05:43:19.348827   14625 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:43:19.348856   14625 out.go:270] * 
	* 
	W1028 05:43:19.351490   14625 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:43:19.360410   14625 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (9.83s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (9.93s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p false-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p false-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 : exit status 80 (9.932401s)

                                                
                                                
-- stdout --
	* [false-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "false-615000" primary control-plane node in "false-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "false-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:43:21.949964   14744 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:43:21.950122   14744 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:21.950124   14744 out.go:358] Setting ErrFile to fd 2...
	I1028 05:43:21.950127   14744 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:21.950266   14744 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:43:21.951454   14744 out.go:352] Setting JSON to false
	I1028 05:43:21.969492   14744 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7972,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:43:21.969564   14744 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:43:21.975861   14744 out.go:177] * [false-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:43:21.983815   14744 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:43:21.983912   14744 notify.go:220] Checking for updates...
	I1028 05:43:21.990749   14744 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:43:21.993767   14744 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:43:21.996786   14744 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:43:21.999784   14744 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:43:22.002840   14744 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:43:22.006223   14744 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:43:22.006295   14744 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:43:22.006337   14744 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:43:22.010740   14744 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:43:22.017810   14744 start.go:297] selected driver: qemu2
	I1028 05:43:22.017815   14744 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:43:22.017821   14744 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:43:22.020201   14744 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:43:22.023732   14744 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:43:22.026853   14744 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:43:22.026880   14744 cni.go:84] Creating CNI manager for "false"
	I1028 05:43:22.026921   14744 start.go:340] cluster config:
	{Name:false-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:false-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do
cker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_
client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:43:22.031283   14744 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:43:22.039770   14744 out.go:177] * Starting "false-615000" primary control-plane node in "false-615000" cluster
	I1028 05:43:22.043714   14744 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:43:22.043732   14744 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:43:22.043746   14744 cache.go:56] Caching tarball of preloaded images
	I1028 05:43:22.043809   14744 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:43:22.043814   14744 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:43:22.043860   14744 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/false-615000/config.json ...
	I1028 05:43:22.043870   14744 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/false-615000/config.json: {Name:mk0016c14b0cbccea69e7628dd0508344c21e907 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:43:22.044098   14744 start.go:360] acquireMachinesLock for false-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:22.044143   14744 start.go:364] duration metric: took 40.125µs to acquireMachinesLock for "false-615000"
	I1028 05:43:22.044154   14744 start.go:93] Provisioning new machine with config: &{Name:false-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.2 ClusterName:false-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:22.044185   14744 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:22.051808   14744 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:22.066412   14744 start.go:159] libmachine.API.Create for "false-615000" (driver="qemu2")
	I1028 05:43:22.066443   14744 client.go:168] LocalClient.Create starting
	I1028 05:43:22.066516   14744 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:22.066551   14744 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:22.066565   14744 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:22.066602   14744 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:22.066630   14744 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:22.066638   14744 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:22.067065   14744 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:22.223785   14744 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:22.461695   14744 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:22.461710   14744 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:22.462011   14744 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:22.473181   14744 main.go:141] libmachine: STDOUT: 
	I1028 05:43:22.473200   14744 main.go:141] libmachine: STDERR: 
	I1028 05:43:22.473268   14744 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2 +20000M
	I1028 05:43:22.482195   14744 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:22.482217   14744 main.go:141] libmachine: STDERR: 
	I1028 05:43:22.482235   14744 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:22.482241   14744 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:22.482259   14744 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:22.482292   14744 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e2:3f:ef:70:8c:40 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:22.484391   14744 main.go:141] libmachine: STDOUT: 
	I1028 05:43:22.484412   14744 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:22.484434   14744 client.go:171] duration metric: took 417.983291ms to LocalClient.Create
	I1028 05:43:24.486689   14744 start.go:128] duration metric: took 2.442475042s to createHost
	I1028 05:43:24.486752   14744 start.go:83] releasing machines lock for "false-615000", held for 2.442594292s
	W1028 05:43:24.486805   14744 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:24.498106   14744 out.go:177] * Deleting "false-615000" in qemu2 ...
	W1028 05:43:24.521543   14744 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:24.521566   14744 start.go:729] Will try again in 5 seconds ...
	I1028 05:43:29.523688   14744 start.go:360] acquireMachinesLock for false-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:29.523818   14744 start.go:364] duration metric: took 106.791µs to acquireMachinesLock for "false-615000"
	I1028 05:43:29.523831   14744 start.go:93] Provisioning new machine with config: &{Name:false-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.2 ClusterName:false-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:29.523868   14744 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:29.528055   14744 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:29.543790   14744 start.go:159] libmachine.API.Create for "false-615000" (driver="qemu2")
	I1028 05:43:29.543815   14744 client.go:168] LocalClient.Create starting
	I1028 05:43:29.543888   14744 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:29.543934   14744 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:29.543944   14744 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:29.543981   14744 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:29.544010   14744 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:29.544019   14744 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:29.544306   14744 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:29.703208   14744 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:29.778143   14744 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:29.778157   14744 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:29.778376   14744 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:29.789368   14744 main.go:141] libmachine: STDOUT: 
	I1028 05:43:29.789390   14744 main.go:141] libmachine: STDERR: 
	I1028 05:43:29.789462   14744 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2 +20000M
	I1028 05:43:29.799341   14744 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:29.799361   14744 main.go:141] libmachine: STDERR: 
	I1028 05:43:29.799376   14744 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:29.799381   14744 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:29.799391   14744 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:29.799418   14744 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3a:c4:44:69:69:09 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/false-615000/disk.qcow2
	I1028 05:43:29.801398   14744 main.go:141] libmachine: STDOUT: 
	I1028 05:43:29.801412   14744 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:29.801425   14744 client.go:171] duration metric: took 257.604125ms to LocalClient.Create
	I1028 05:43:31.803641   14744 start.go:128] duration metric: took 2.27973325s to createHost
	I1028 05:43:31.803751   14744 start.go:83] releasing machines lock for "false-615000", held for 2.279916084s
	W1028 05:43:31.804169   14744 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p false-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p false-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:31.816866   14744 out.go:201] 
	W1028 05:43:31.820924   14744 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:43:31.820958   14744 out.go:270] * 
	* 
	W1028 05:43:31.823652   14744 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:43:31.835833   14744 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/false/Start (9.93s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (9.82s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p enable-default-cni-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p enable-default-cni-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 : exit status 80 (9.82045925s)

                                                
                                                
-- stdout --
	* [enable-default-cni-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "enable-default-cni-615000" primary control-plane node in "enable-default-cni-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "enable-default-cni-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:43:34.226818   14856 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:43:34.226987   14856 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:34.226994   14856 out.go:358] Setting ErrFile to fd 2...
	I1028 05:43:34.226996   14856 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:34.227137   14856 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:43:34.228296   14856 out.go:352] Setting JSON to false
	I1028 05:43:34.246572   14856 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7985,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:43:34.246643   14856 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:43:34.252212   14856 out.go:177] * [enable-default-cni-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:43:34.260137   14856 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:43:34.260177   14856 notify.go:220] Checking for updates...
	I1028 05:43:34.268067   14856 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:43:34.271051   14856 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:43:34.275095   14856 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:43:34.278017   14856 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:43:34.281055   14856 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:43:34.284513   14856 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:43:34.284608   14856 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:43:34.284657   14856 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:43:34.289052   14856 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:43:34.296087   14856 start.go:297] selected driver: qemu2
	I1028 05:43:34.296092   14856 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:43:34.296099   14856 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:43:34.298499   14856 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:43:34.303083   14856 out.go:177] * Automatically selected the socket_vmnet network
	E1028 05:43:34.306149   14856 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I1028 05:43:34.306163   14856 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:43:34.306188   14856 cni.go:84] Creating CNI manager for "bridge"
	I1028 05:43:34.306200   14856 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:43:34.306239   14856 start.go:340] cluster config:
	{Name:enable-default-cni-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:enable-default-cni-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/
socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:43:34.310905   14856 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:43:34.319099   14856 out.go:177] * Starting "enable-default-cni-615000" primary control-plane node in "enable-default-cni-615000" cluster
	I1028 05:43:34.323073   14856 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:43:34.323097   14856 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:43:34.323109   14856 cache.go:56] Caching tarball of preloaded images
	I1028 05:43:34.323187   14856 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:43:34.323192   14856 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:43:34.323251   14856 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/enable-default-cni-615000/config.json ...
	I1028 05:43:34.323261   14856 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/enable-default-cni-615000/config.json: {Name:mk194c2a04efcff1adbec259d7fdc4152040c998 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:43:34.323559   14856 start.go:360] acquireMachinesLock for enable-default-cni-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:34.323618   14856 start.go:364] duration metric: took 48.75µs to acquireMachinesLock for "enable-default-cni-615000"
	I1028 05:43:34.323632   14856 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.2 ClusterName:enable-default-cni-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:34.323661   14856 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:34.331067   14856 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:34.346764   14856 start.go:159] libmachine.API.Create for "enable-default-cni-615000" (driver="qemu2")
	I1028 05:43:34.346795   14856 client.go:168] LocalClient.Create starting
	I1028 05:43:34.346873   14856 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:34.346913   14856 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:34.346924   14856 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:34.346960   14856 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:34.346989   14856 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:34.346995   14856 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:34.347436   14856 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:34.503380   14856 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:34.636403   14856 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:34.636411   14856 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:34.636613   14856 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:34.646673   14856 main.go:141] libmachine: STDOUT: 
	I1028 05:43:34.646702   14856 main.go:141] libmachine: STDERR: 
	I1028 05:43:34.646773   14856 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2 +20000M
	I1028 05:43:34.655346   14856 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:34.655367   14856 main.go:141] libmachine: STDERR: 
	I1028 05:43:34.655387   14856 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:34.655398   14856 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:34.655408   14856 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:34.655440   14856 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:96:9b:6e:31:ac -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:34.657297   14856 main.go:141] libmachine: STDOUT: 
	I1028 05:43:34.657310   14856 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:34.657330   14856 client.go:171] duration metric: took 310.5275ms to LocalClient.Create
	I1028 05:43:36.659422   14856 start.go:128] duration metric: took 2.33574825s to createHost
	I1028 05:43:36.659453   14856 start.go:83] releasing machines lock for "enable-default-cni-615000", held for 2.335823292s
	W1028 05:43:36.659470   14856 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:36.671029   14856 out.go:177] * Deleting "enable-default-cni-615000" in qemu2 ...
	W1028 05:43:36.682478   14856 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:36.682494   14856 start.go:729] Will try again in 5 seconds ...
	I1028 05:43:41.684662   14856 start.go:360] acquireMachinesLock for enable-default-cni-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:41.684862   14856 start.go:364] duration metric: took 158.667µs to acquireMachinesLock for "enable-default-cni-615000"
	I1028 05:43:41.684895   14856 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.2 ClusterName:enable-default-cni-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:41.684978   14856 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:41.693295   14856 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:41.712497   14856 start.go:159] libmachine.API.Create for "enable-default-cni-615000" (driver="qemu2")
	I1028 05:43:41.712529   14856 client.go:168] LocalClient.Create starting
	I1028 05:43:41.712602   14856 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:41.712648   14856 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:41.712666   14856 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:41.712697   14856 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:41.712728   14856 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:41.712736   14856 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:41.713120   14856 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:41.871576   14856 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:41.947859   14856 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:41.947865   14856 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:41.948049   14856 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:41.957877   14856 main.go:141] libmachine: STDOUT: 
	I1028 05:43:41.957893   14856 main.go:141] libmachine: STDERR: 
	I1028 05:43:41.957954   14856 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2 +20000M
	I1028 05:43:41.966574   14856 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:41.966599   14856 main.go:141] libmachine: STDERR: 
	I1028 05:43:41.966614   14856 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:41.966619   14856 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:41.966627   14856 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:41.966653   14856 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:4b:0b:97:5d:ef -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/enable-default-cni-615000/disk.qcow2
	I1028 05:43:41.968448   14856 main.go:141] libmachine: STDOUT: 
	I1028 05:43:41.968464   14856 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:41.968479   14856 client.go:171] duration metric: took 255.944625ms to LocalClient.Create
	I1028 05:43:43.970679   14856 start.go:128] duration metric: took 2.285665333s to createHost
	I1028 05:43:43.970784   14856 start.go:83] releasing machines lock for "enable-default-cni-615000", held for 2.285897417s
	W1028 05:43:43.971190   14856 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:43.979833   14856 out.go:201] 
	W1028 05:43:43.988892   14856 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:43:43.988923   14856 out.go:270] * 
	* 
	W1028 05:43:43.991683   14856 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:43:44.000846   14856 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (9.82s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (9.9s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p flannel-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p flannel-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 : exit status 80 (9.894775708s)

                                                
                                                
-- stdout --
	* [flannel-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "flannel-615000" primary control-plane node in "flannel-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "flannel-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:43:46.414538   14973 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:43:46.414707   14973 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:46.414710   14973 out.go:358] Setting ErrFile to fd 2...
	I1028 05:43:46.414712   14973 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:46.414829   14973 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:43:46.416026   14973 out.go:352] Setting JSON to false
	I1028 05:43:46.434218   14973 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":7997,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:43:46.434292   14973 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:43:46.440325   14973 out.go:177] * [flannel-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:43:46.448260   14973 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:43:46.448325   14973 notify.go:220] Checking for updates...
	I1028 05:43:46.455210   14973 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:43:46.458238   14973 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:43:46.461286   14973 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:43:46.464277   14973 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:43:46.467327   14973 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:43:46.470613   14973 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:43:46.470683   14973 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:43:46.470737   14973 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:43:46.475237   14973 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:43:46.482291   14973 start.go:297] selected driver: qemu2
	I1028 05:43:46.482296   14973 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:43:46.482302   14973 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:43:46.484610   14973 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:43:46.488250   14973 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:43:46.491276   14973 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:43:46.491295   14973 cni.go:84] Creating CNI manager for "flannel"
	I1028 05:43:46.491301   14973 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I1028 05:43:46.491328   14973 start.go:340] cluster config:
	{Name:flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/sock
et_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:43:46.495501   14973 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:43:46.502220   14973 out.go:177] * Starting "flannel-615000" primary control-plane node in "flannel-615000" cluster
	I1028 05:43:46.506254   14973 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:43:46.506270   14973 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:43:46.506282   14973 cache.go:56] Caching tarball of preloaded images
	I1028 05:43:46.506356   14973 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:43:46.506369   14973 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:43:46.506421   14973 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/flannel-615000/config.json ...
	I1028 05:43:46.506437   14973 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/flannel-615000/config.json: {Name:mk56d12b1f1da7f374996bf1f479f73cc9679964 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:43:46.506664   14973 start.go:360] acquireMachinesLock for flannel-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:46.506706   14973 start.go:364] duration metric: took 36.792µs to acquireMachinesLock for "flannel-615000"
	I1028 05:43:46.506717   14973 start.go:93] Provisioning new machine with config: &{Name:flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:46.506753   14973 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:46.511260   14973 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:46.526746   14973 start.go:159] libmachine.API.Create for "flannel-615000" (driver="qemu2")
	I1028 05:43:46.526767   14973 client.go:168] LocalClient.Create starting
	I1028 05:43:46.526834   14973 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:46.526872   14973 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:46.526886   14973 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:46.526921   14973 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:46.526949   14973 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:46.526956   14973 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:46.527309   14973 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:46.682959   14973 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:46.793009   14973 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:46.793016   14973 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:46.793189   14973 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:46.803008   14973 main.go:141] libmachine: STDOUT: 
	I1028 05:43:46.803030   14973 main.go:141] libmachine: STDERR: 
	I1028 05:43:46.803090   14973 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2 +20000M
	I1028 05:43:46.811440   14973 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:46.811456   14973 main.go:141] libmachine: STDERR: 
	I1028 05:43:46.811471   14973 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:46.811475   14973 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:46.811488   14973 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:46.811529   14973 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:ba:c0:bc:2d:15 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:46.813302   14973 main.go:141] libmachine: STDOUT: 
	I1028 05:43:46.813316   14973 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:46.813338   14973 client.go:171] duration metric: took 286.564708ms to LocalClient.Create
	I1028 05:43:48.815438   14973 start.go:128] duration metric: took 2.308667417s to createHost
	I1028 05:43:48.815518   14973 start.go:83] releasing machines lock for "flannel-615000", held for 2.308799292s
	W1028 05:43:48.815551   14973 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:48.823223   14973 out.go:177] * Deleting "flannel-615000" in qemu2 ...
	W1028 05:43:48.836623   14973 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:48.836633   14973 start.go:729] Will try again in 5 seconds ...
	I1028 05:43:53.838951   14973 start.go:360] acquireMachinesLock for flannel-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:53.839683   14973 start.go:364] duration metric: took 629.25µs to acquireMachinesLock for "flannel-615000"
	I1028 05:43:53.839773   14973 start.go:93] Provisioning new machine with config: &{Name:flannel-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:flannel-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti
ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:53.840077   14973 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:53.853552   14973 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:53.896848   14973 start.go:159] libmachine.API.Create for "flannel-615000" (driver="qemu2")
	I1028 05:43:53.896911   14973 client.go:168] LocalClient.Create starting
	I1028 05:43:53.897048   14973 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:53.897128   14973 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:53.897142   14973 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:53.897199   14973 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:53.897253   14973 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:53.897264   14973 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:53.897808   14973 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:54.065209   14973 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:54.207130   14973 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:54.207138   14973 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:54.207334   14973 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:54.217360   14973 main.go:141] libmachine: STDOUT: 
	I1028 05:43:54.217384   14973 main.go:141] libmachine: STDERR: 
	I1028 05:43:54.217443   14973 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2 +20000M
	I1028 05:43:54.226018   14973 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:54.226037   14973 main.go:141] libmachine: STDERR: 
	I1028 05:43:54.226056   14973 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:54.226062   14973 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:54.226072   14973 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:54.226104   14973 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:79:01:8b:e5:18 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/flannel-615000/disk.qcow2
	I1028 05:43:54.227964   14973 main.go:141] libmachine: STDOUT: 
	I1028 05:43:54.227986   14973 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:54.228001   14973 client.go:171] duration metric: took 331.084417ms to LocalClient.Create
	I1028 05:43:56.230225   14973 start.go:128] duration metric: took 2.390103083s to createHost
	I1028 05:43:56.230304   14973 start.go:83] releasing machines lock for "flannel-615000", held for 2.390584708s
	W1028 05:43:56.230726   14973 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p flannel-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p flannel-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:43:56.245486   14973 out.go:201] 
	W1028 05:43:56.249583   14973 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:43:56.249643   14973 out.go:270] * 
	* 
	W1028 05:43:56.252319   14973 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:43:56.263395   14973 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/flannel/Start (9.90s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (9.94s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p bridge-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p bridge-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 : exit status 80 (9.939967625s)

                                                
                                                
-- stdout --
	* [bridge-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "bridge-615000" primary control-plane node in "bridge-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "bridge-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:43:58.857778   15092 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:43:58.857948   15092 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:58.857951   15092 out.go:358] Setting ErrFile to fd 2...
	I1028 05:43:58.857953   15092 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:43:58.858092   15092 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:43:58.859263   15092 out.go:352] Setting JSON to false
	I1028 05:43:58.877122   15092 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8009,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:43:58.877194   15092 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:43:58.882778   15092 out.go:177] * [bridge-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:43:58.889788   15092 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:43:58.889840   15092 notify.go:220] Checking for updates...
	I1028 05:43:58.895722   15092 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:43:58.898690   15092 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:43:58.902750   15092 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:43:58.905736   15092 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:43:58.908745   15092 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:43:58.912136   15092 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:43:58.912207   15092 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:43:58.912244   15092 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:43:58.916724   15092 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:43:58.923717   15092 start.go:297] selected driver: qemu2
	I1028 05:43:58.923723   15092 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:43:58.923728   15092 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:43:58.926106   15092 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:43:58.928762   15092 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:43:58.931843   15092 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:43:58.931868   15092 cni.go:84] Creating CNI manager for "bridge"
	I1028 05:43:58.931872   15092 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:43:58.931909   15092 start.go:340] cluster config:
	{Name:bridge-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:bridge-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:43:58.936401   15092 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:43:58.955642   15092 out.go:177] * Starting "bridge-615000" primary control-plane node in "bridge-615000" cluster
	I1028 05:43:58.959816   15092 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:43:58.959833   15092 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:43:58.959845   15092 cache.go:56] Caching tarball of preloaded images
	I1028 05:43:58.959951   15092 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:43:58.959968   15092 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:43:58.960037   15092 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/bridge-615000/config.json ...
	I1028 05:43:58.960049   15092 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/bridge-615000/config.json: {Name:mk83bac0c2633820998d846a5ac2d2db71519e4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:43:58.960417   15092 start.go:360] acquireMachinesLock for bridge-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:43:58.960473   15092 start.go:364] duration metric: took 49.625µs to acquireMachinesLock for "bridge-615000"
	I1028 05:43:58.960490   15092 start.go:93] Provisioning new machine with config: &{Name:bridge-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:bridge-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:43:58.960546   15092 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:43:58.964687   15092 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:43:58.981749   15092 start.go:159] libmachine.API.Create for "bridge-615000" (driver="qemu2")
	I1028 05:43:58.981776   15092 client.go:168] LocalClient.Create starting
	I1028 05:43:58.981863   15092 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:43:58.981905   15092 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:58.981917   15092 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:58.981953   15092 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:43:58.981984   15092 main.go:141] libmachine: Decoding PEM data...
	I1028 05:43:58.981995   15092 main.go:141] libmachine: Parsing certificate...
	I1028 05:43:58.982445   15092 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:43:59.141044   15092 main.go:141] libmachine: Creating SSH key...
	I1028 05:43:59.306088   15092 main.go:141] libmachine: Creating Disk image...
	I1028 05:43:59.306099   15092 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:43:59.306314   15092 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:43:59.316330   15092 main.go:141] libmachine: STDOUT: 
	I1028 05:43:59.316369   15092 main.go:141] libmachine: STDERR: 
	I1028 05:43:59.316421   15092 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2 +20000M
	I1028 05:43:59.325252   15092 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:43:59.325274   15092 main.go:141] libmachine: STDERR: 
	I1028 05:43:59.325304   15092 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:43:59.325310   15092 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:43:59.325320   15092 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:43:59.325347   15092 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0e:70:85:c4:3b:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:43:59.327168   15092 main.go:141] libmachine: STDOUT: 
	I1028 05:43:59.327181   15092 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:43:59.327199   15092 client.go:171] duration metric: took 345.416167ms to LocalClient.Create
	I1028 05:44:01.329268   15092 start.go:128] duration metric: took 2.368710208s to createHost
	I1028 05:44:01.329282   15092 start.go:83] releasing machines lock for "bridge-615000", held for 2.368798917s
	W1028 05:44:01.329300   15092 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:01.339742   15092 out.go:177] * Deleting "bridge-615000" in qemu2 ...
	W1028 05:44:01.349643   15092 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:01.349652   15092 start.go:729] Will try again in 5 seconds ...
	I1028 05:44:06.351861   15092 start.go:360] acquireMachinesLock for bridge-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:06.352244   15092 start.go:364] duration metric: took 292.625µs to acquireMachinesLock for "bridge-615000"
	I1028 05:44:06.352332   15092 start.go:93] Provisioning new machine with config: &{Name:bridge-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube
rnetesVersion:v1.31.2 ClusterName:bridge-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:06.352435   15092 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:06.359845   15092 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:44:06.386737   15092 start.go:159] libmachine.API.Create for "bridge-615000" (driver="qemu2")
	I1028 05:44:06.386776   15092 client.go:168] LocalClient.Create starting
	I1028 05:44:06.386886   15092 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:06.386949   15092 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:06.386959   15092 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:06.387010   15092 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:06.387056   15092 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:06.387063   15092 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:06.387478   15092 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:06.546600   15092 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:06.698762   15092 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:06.698776   15092 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:06.698994   15092 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:44:06.709080   15092 main.go:141] libmachine: STDOUT: 
	I1028 05:44:06.709103   15092 main.go:141] libmachine: STDERR: 
	I1028 05:44:06.709161   15092 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2 +20000M
	I1028 05:44:06.717777   15092 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:06.717794   15092 main.go:141] libmachine: STDERR: 
	I1028 05:44:06.717815   15092 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:44:06.717821   15092 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:06.717829   15092 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:06.717855   15092 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:0f:ba:5c:67:45 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/bridge-615000/disk.qcow2
	I1028 05:44:06.719698   15092 main.go:141] libmachine: STDOUT: 
	I1028 05:44:06.719714   15092 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:06.719726   15092 client.go:171] duration metric: took 332.941792ms to LocalClient.Create
	I1028 05:44:08.721954   15092 start.go:128] duration metric: took 2.369472541s to createHost
	I1028 05:44:08.722035   15092 start.go:83] releasing machines lock for "bridge-615000", held for 2.369763625s
	W1028 05:44:08.722373   15092 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p bridge-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p bridge-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:08.731960   15092 out.go:201] 
	W1028 05:44:08.738066   15092 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:08.738095   15092 out.go:270] * 
	* 
	W1028 05:44:08.740717   15092 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:08.749911   15092 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/bridge/Start (9.94s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (10s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kubenet-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubenet-615000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 : exit status 80 (9.994257834s)

                                                
                                                
-- stdout --
	* [kubenet-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "kubenet-615000" primary control-plane node in "kubenet-615000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubenet-615000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:11.171196   15209 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:11.171351   15209 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:11.171354   15209 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:11.171356   15209 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:11.171508   15209 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:11.172684   15209 out.go:352] Setting JSON to false
	I1028 05:44:11.190573   15209 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8022,"bootTime":1730111429,"procs":522,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:11.190648   15209 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:11.196601   15209 out.go:177] * [kubenet-615000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:11.204492   15209 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:11.204537   15209 notify.go:220] Checking for updates...
	I1028 05:44:11.210538   15209 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:11.213560   15209 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:11.216557   15209 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:11.219554   15209 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:11.222522   15209 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:11.225971   15209 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:11.226052   15209 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:44:11.226094   15209 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:11.230541   15209 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:44:11.237543   15209 start.go:297] selected driver: qemu2
	I1028 05:44:11.237550   15209 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:44:11.237558   15209 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:11.240044   15209 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:44:11.242514   15209 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:44:11.245520   15209 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:11.245540   15209 cni.go:80] network plugin configured as "kubenet", returning disabled
	I1028 05:44:11.245559   15209 start.go:340] cluster config:
	{Name:kubenet-615000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:kubenet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_
vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:11.249821   15209 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:11.257373   15209 out.go:177] * Starting "kubenet-615000" primary control-plane node in "kubenet-615000" cluster
	I1028 05:44:11.261492   15209 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:44:11.261504   15209 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:44:11.261512   15209 cache.go:56] Caching tarball of preloaded images
	I1028 05:44:11.261577   15209 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:44:11.261593   15209 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:44:11.261644   15209 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kubenet-615000/config.json ...
	I1028 05:44:11.261654   15209 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/kubenet-615000/config.json: {Name:mke8fe8d9ed343a3ef302860d554e749011b9713 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:44:11.261885   15209 start.go:360] acquireMachinesLock for kubenet-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:11.261928   15209 start.go:364] duration metric: took 38µs to acquireMachinesLock for "kubenet-615000"
	I1028 05:44:11.261939   15209 start.go:93] Provisioning new machine with config: &{Name:kubenet-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:kubenet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:11.261971   15209 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:11.265463   15209 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:44:11.280010   15209 start.go:159] libmachine.API.Create for "kubenet-615000" (driver="qemu2")
	I1028 05:44:11.280032   15209 client.go:168] LocalClient.Create starting
	I1028 05:44:11.280093   15209 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:11.280128   15209 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:11.280140   15209 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:11.280180   15209 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:11.280215   15209 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:11.280227   15209 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:11.280574   15209 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:11.438770   15209 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:11.660324   15209 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:11.660334   15209 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:11.660549   15209 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:11.670617   15209 main.go:141] libmachine: STDOUT: 
	I1028 05:44:11.670638   15209 main.go:141] libmachine: STDERR: 
	I1028 05:44:11.670699   15209 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2 +20000M
	I1028 05:44:11.679415   15209 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:11.679432   15209 main.go:141] libmachine: STDERR: 
	I1028 05:44:11.679443   15209 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:11.679449   15209 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:11.679470   15209 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:11.679514   15209 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:ce:cf:d9:13:81 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:11.681365   15209 main.go:141] libmachine: STDOUT: 
	I1028 05:44:11.681379   15209 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:11.681397   15209 client.go:171] duration metric: took 401.357958ms to LocalClient.Create
	I1028 05:44:13.683595   15209 start.go:128] duration metric: took 2.421588708s to createHost
	I1028 05:44:13.683670   15209 start.go:83] releasing machines lock for "kubenet-615000", held for 2.421728292s
	W1028 05:44:13.683777   15209 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:13.694589   15209 out.go:177] * Deleting "kubenet-615000" in qemu2 ...
	W1028 05:44:13.722032   15209 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:13.722064   15209 start.go:729] Will try again in 5 seconds ...
	I1028 05:44:18.724259   15209 start.go:360] acquireMachinesLock for kubenet-615000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:18.725097   15209 start.go:364] duration metric: took 614.958µs to acquireMachinesLock for "kubenet-615000"
	I1028 05:44:18.725212   15209 start.go:93] Provisioning new machine with config: &{Name:kubenet-615000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:3072 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:kubenet-615000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:18.725592   15209 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:18.740279   15209 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1028 05:44:18.787917   15209 start.go:159] libmachine.API.Create for "kubenet-615000" (driver="qemu2")
	I1028 05:44:18.787967   15209 client.go:168] LocalClient.Create starting
	I1028 05:44:18.788092   15209 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:18.788187   15209 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:18.788204   15209 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:18.788275   15209 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:18.788334   15209 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:18.788354   15209 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:18.789088   15209 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:18.956890   15209 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:19.066282   15209 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:19.066295   15209 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:19.066504   15209 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:19.076597   15209 main.go:141] libmachine: STDOUT: 
	I1028 05:44:19.076619   15209 main.go:141] libmachine: STDERR: 
	I1028 05:44:19.076688   15209 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2 +20000M
	I1028 05:44:19.085223   15209 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:19.085238   15209 main.go:141] libmachine: STDERR: 
	I1028 05:44:19.085250   15209 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:19.085254   15209 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:19.085264   15209 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:19.085291   15209 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0e:ba:b3:ad:9d:94 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/kubenet-615000/disk.qcow2
	I1028 05:44:19.087147   15209 main.go:141] libmachine: STDOUT: 
	I1028 05:44:19.087160   15209 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:19.087172   15209 client.go:171] duration metric: took 299.198042ms to LocalClient.Create
	I1028 05:44:21.089344   15209 start.go:128] duration metric: took 2.363727833s to createHost
	I1028 05:44:21.089386   15209 start.go:83] releasing machines lock for "kubenet-615000", held for 2.364227083s
	W1028 05:44:21.089569   15209 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p kubenet-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubenet-615000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:21.106951   15209 out.go:201] 
	W1028 05:44:21.110952   15209 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:21.110969   15209 out.go:270] * 
	* 
	W1028 05:44:21.112524   15209 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:21.121840   15209 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kubenet/Start (10.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (10.17s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0: exit status 80 (10.112347625s)

                                                
                                                
-- stdout --
	* [old-k8s-version-813000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "old-k8s-version-813000" primary control-plane node in "old-k8s-version-813000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "old-k8s-version-813000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:23.506214   15320 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:23.506413   15320 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:23.506418   15320 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:23.506421   15320 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:23.506539   15320 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:23.507959   15320 out.go:352] Setting JSON to false
	I1028 05:44:23.526558   15320 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8034,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:23.526637   15320 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:23.532748   15320 out.go:177] * [old-k8s-version-813000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:23.540595   15320 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:23.540704   15320 notify.go:220] Checking for updates...
	I1028 05:44:23.547754   15320 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:23.549194   15320 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:23.553844   15320 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:23.556787   15320 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:23.558273   15320 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:23.562112   15320 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:23.562182   15320 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:44:23.562223   15320 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:23.566758   15320 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:44:23.571725   15320 start.go:297] selected driver: qemu2
	I1028 05:44:23.571731   15320 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:44:23.571736   15320 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:23.574078   15320 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:44:23.578753   15320 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:44:23.580332   15320 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:23.580356   15320 cni.go:84] Creating CNI manager for ""
	I1028 05:44:23.580388   15320 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1028 05:44:23.580417   15320 start.go:340] cluster config:
	{Name:old-k8s-version-813000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-813000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/
socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:23.584562   15320 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:23.592780   15320 out.go:177] * Starting "old-k8s-version-813000" primary control-plane node in "old-k8s-version-813000" cluster
	I1028 05:44:23.596753   15320 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:44:23.596780   15320 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:44:23.596794   15320 cache.go:56] Caching tarball of preloaded images
	I1028 05:44:23.596892   15320 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:44:23.596897   15320 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I1028 05:44:23.596958   15320 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/old-k8s-version-813000/config.json ...
	I1028 05:44:23.596968   15320 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/old-k8s-version-813000/config.json: {Name:mk6682580f3bd8b8f2334823926dcede78e9ca08 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:44:23.597260   15320 start.go:360] acquireMachinesLock for old-k8s-version-813000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:23.597308   15320 start.go:364] duration metric: took 40.25µs to acquireMachinesLock for "old-k8s-version-813000"
	I1028 05:44:23.597319   15320 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-813000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-813000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:23.597347   15320 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:23.601602   15320 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:44:23.616498   15320 start.go:159] libmachine.API.Create for "old-k8s-version-813000" (driver="qemu2")
	I1028 05:44:23.616523   15320 client.go:168] LocalClient.Create starting
	I1028 05:44:23.616595   15320 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:23.616635   15320 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:23.616647   15320 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:23.616682   15320 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:23.616710   15320 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:23.616716   15320 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:23.617089   15320 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:23.773820   15320 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:23.892745   15320 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:23.892752   15320 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:23.892949   15320 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:23.902797   15320 main.go:141] libmachine: STDOUT: 
	I1028 05:44:23.902819   15320 main.go:141] libmachine: STDERR: 
	I1028 05:44:23.902885   15320 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2 +20000M
	I1028 05:44:23.911386   15320 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:23.911400   15320 main.go:141] libmachine: STDERR: 
	I1028 05:44:23.911414   15320 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:23.911424   15320 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:23.911438   15320 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:23.911465   15320 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:c6:e9:ec:96:ec -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:23.913388   15320 main.go:141] libmachine: STDOUT: 
	I1028 05:44:23.913403   15320 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:23.913424   15320 client.go:171] duration metric: took 296.895125ms to LocalClient.Create
	I1028 05:44:25.915619   15320 start.go:128] duration metric: took 2.3182345s to createHost
	I1028 05:44:25.915691   15320 start.go:83] releasing machines lock for "old-k8s-version-813000", held for 2.318371083s
	W1028 05:44:25.915747   15320 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:25.926723   15320 out.go:177] * Deleting "old-k8s-version-813000" in qemu2 ...
	W1028 05:44:25.952875   15320 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:25.952903   15320 start.go:729] Will try again in 5 seconds ...
	I1028 05:44:30.955153   15320 start.go:360] acquireMachinesLock for old-k8s-version-813000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:30.955742   15320 start.go:364] duration metric: took 482.291µs to acquireMachinesLock for "old-k8s-version-813000"
	I1028 05:44:30.955813   15320 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-813000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-813000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:30.956129   15320 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:30.970688   15320 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:44:31.019700   15320 start.go:159] libmachine.API.Create for "old-k8s-version-813000" (driver="qemu2")
	I1028 05:44:31.019749   15320 client.go:168] LocalClient.Create starting
	I1028 05:44:31.019899   15320 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:31.019984   15320 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:31.020004   15320 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:31.020069   15320 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:31.020130   15320 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:31.020140   15320 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:31.020941   15320 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:31.186982   15320 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:31.521700   15320 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:31.521710   15320 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:31.521953   15320 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:31.532335   15320 main.go:141] libmachine: STDOUT: 
	I1028 05:44:31.532358   15320 main.go:141] libmachine: STDERR: 
	I1028 05:44:31.532447   15320 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2 +20000M
	I1028 05:44:31.541152   15320 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:31.541170   15320 main.go:141] libmachine: STDERR: 
	I1028 05:44:31.541185   15320 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:31.541190   15320 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:31.541200   15320 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:31.541238   15320 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9e:80:a3:d6:b1:ae -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:31.543049   15320 main.go:141] libmachine: STDOUT: 
	I1028 05:44:31.543063   15320 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:31.543075   15320 client.go:171] duration metric: took 523.320625ms to LocalClient.Create
	I1028 05:44:33.545173   15320 start.go:128] duration metric: took 2.589017917s to createHost
	I1028 05:44:33.545205   15320 start.go:83] releasing machines lock for "old-k8s-version-813000", held for 2.589436167s
	W1028 05:44:33.545416   15320 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-813000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-813000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:33.559700   15320 out.go:201] 
	W1028 05:44:33.563716   15320 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:33.563733   15320 out.go:270] * 
	* 
	W1028 05:44:33.565034   15320 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:33.579682   15320 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (56.334875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (10.17s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-813000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-813000 create -f testdata/busybox.yaml: exit status 1 (28.697125ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-813000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-813000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (33.734958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (33.829875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p old-k8s-version-813000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-813000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-813000 describe deploy/metrics-server -n kube-system: exit status 1 (28.335375ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-813000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-813000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (33.845958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (5.26s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0: exit status 80 (5.1960535s)

                                                
                                                
-- stdout --
	* [old-k8s-version-813000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	* Using the qemu2 driver based on existing profile
	* Starting "old-k8s-version-813000" primary control-plane node in "old-k8s-version-813000" cluster
	* Restarting existing qemu2 VM for "old-k8s-version-813000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "old-k8s-version-813000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:35.911431   15366 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:35.911588   15366 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:35.911591   15366 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:35.911593   15366 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:35.911720   15366 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:35.912829   15366 out.go:352] Setting JSON to false
	I1028 05:44:35.930739   15366 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8046,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:35.930829   15366 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:35.936151   15366 out.go:177] * [old-k8s-version-813000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:35.943101   15366 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:35.943145   15366 notify.go:220] Checking for updates...
	I1028 05:44:35.951035   15366 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:35.955035   15366 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:35.958031   15366 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:35.961045   15366 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:35.964080   15366 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:35.965852   15366 config.go:182] Loaded profile config "old-k8s-version-813000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I1028 05:44:35.968973   15366 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	I1028 05:44:35.972038   15366 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:35.975882   15366 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:44:35.983010   15366 start.go:297] selected driver: qemu2
	I1028 05:44:35.983016   15366 start.go:901] validating driver "qemu2" against &{Name:old-k8s-version-813000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-813000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:
0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:35.983062   15366 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:35.985589   15366 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:35.985618   15366 cni.go:84] Creating CNI manager for ""
	I1028 05:44:35.985651   15366 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1028 05:44:35.985682   15366 start.go:340] cluster config:
	{Name:old-k8s-version-813000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-813000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount
9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:35.989978   15366 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:35.998082   15366 out.go:177] * Starting "old-k8s-version-813000" primary control-plane node in "old-k8s-version-813000" cluster
	I1028 05:44:36.001043   15366 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:44:36.001062   15366 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:44:36.001073   15366 cache.go:56] Caching tarball of preloaded images
	I1028 05:44:36.001145   15366 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:44:36.001151   15366 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I1028 05:44:36.001205   15366 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/old-k8s-version-813000/config.json ...
	I1028 05:44:36.001774   15366 start.go:360] acquireMachinesLock for old-k8s-version-813000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:36.001804   15366 start.go:364] duration metric: took 24.292µs to acquireMachinesLock for "old-k8s-version-813000"
	I1028 05:44:36.001812   15366 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:44:36.001816   15366 fix.go:54] fixHost starting: 
	I1028 05:44:36.001921   15366 fix.go:112] recreateIfNeeded on old-k8s-version-813000: state=Stopped err=<nil>
	W1028 05:44:36.001929   15366 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:44:36.006033   15366 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-813000" ...
	I1028 05:44:36.013078   15366 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:36.013111   15366 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9e:80:a3:d6:b1:ae -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:36.015113   15366 main.go:141] libmachine: STDOUT: 
	I1028 05:44:36.015135   15366 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:36.015160   15366 fix.go:56] duration metric: took 13.342792ms for fixHost
	I1028 05:44:36.015167   15366 start.go:83] releasing machines lock for "old-k8s-version-813000", held for 13.35825ms
	W1028 05:44:36.015172   15366 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:36.015209   15366 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:36.015213   15366 start.go:729] Will try again in 5 seconds ...
	I1028 05:44:41.017396   15366 start.go:360] acquireMachinesLock for old-k8s-version-813000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:41.017944   15366 start.go:364] duration metric: took 454.084µs to acquireMachinesLock for "old-k8s-version-813000"
	I1028 05:44:41.018114   15366 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:44:41.018136   15366 fix.go:54] fixHost starting: 
	I1028 05:44:41.018874   15366 fix.go:112] recreateIfNeeded on old-k8s-version-813000: state=Stopped err=<nil>
	W1028 05:44:41.018899   15366 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:44:41.027322   15366 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-813000" ...
	I1028 05:44:41.030278   15366 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:41.030571   15366 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9e:80:a3:d6:b1:ae -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/old-k8s-version-813000/disk.qcow2
	I1028 05:44:41.041348   15366 main.go:141] libmachine: STDOUT: 
	I1028 05:44:41.041405   15366 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:41.041508   15366 fix.go:56] duration metric: took 23.374208ms for fixHost
	I1028 05:44:41.041527   15366 start.go:83] releasing machines lock for "old-k8s-version-813000", held for 23.556ms
	W1028 05:44:41.041723   15366 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-813000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-813000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:41.049375   15366 out.go:201] 
	W1028 05:44:41.053404   15366 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:41.053441   15366 out.go:270] * 
	* 
	W1028 05:44:41.055212   15366 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:41.065336   15366 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p old-k8s-version-813000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (59.827583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (5.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-813000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (36.275583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-813000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-813000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-813000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (29.591959ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-813000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-813000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (34.745208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p old-k8s-version-813000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
  []string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (37.408167ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p old-k8s-version-813000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p old-k8s-version-813000 --alsologtostderr -v=1: exit status 83 (49.410292ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-813000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-813000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:41.356061   15387 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:41.356933   15387 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:41.356936   15387 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:41.356939   15387 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:41.357098   15387 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:41.357322   15387 out.go:352] Setting JSON to false
	I1028 05:44:41.357332   15387 mustload.go:65] Loading cluster: old-k8s-version-813000
	I1028 05:44:41.357602   15387 config.go:182] Loaded profile config "old-k8s-version-813000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I1028 05:44:41.362418   15387 out.go:177] * The control-plane node old-k8s-version-813000 host is not running: state=Stopped
	I1028 05:44:41.365392   15387 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-813000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p old-k8s-version-813000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (34.431625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (44.369208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-813000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (10.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (10.127127875s)

                                                
                                                
-- stdout --
	* [no-preload-504000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "no-preload-504000" primary control-plane node in "no-preload-504000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "no-preload-504000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:41.783612   15404 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:41.783765   15404 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:41.783769   15404 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:41.783771   15404 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:41.783902   15404 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:41.787786   15404 out.go:352] Setting JSON to false
	I1028 05:44:41.806883   15404 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8052,"bootTime":1730111429,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:41.806957   15404 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:41.811398   15404 out.go:177] * [no-preload-504000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:41.817440   15404 notify.go:220] Checking for updates...
	I1028 05:44:41.821383   15404 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:41.832377   15404 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:41.846466   15404 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:41.857376   15404 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:41.860329   15404 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:41.867410   15404 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:41.873714   15404 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:41.873774   15404 config.go:182] Loaded profile config "stopped-upgrade-871000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I1028 05:44:41.873820   15404 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:41.885405   15404 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:44:41.890376   15404 start.go:297] selected driver: qemu2
	I1028 05:44:41.890383   15404 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:44:41.890389   15404 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:41.893272   15404 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:44:41.897391   15404 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:44:41.900493   15404 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:41.900528   15404 cni.go:84] Creating CNI manager for ""
	I1028 05:44:41.900563   15404 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:44:41.900572   15404 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:44:41.900620   15404 start.go:340] cluster config:
	{Name:no-preload-504000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket
_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:41.905615   15404 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.915352   15404 out.go:177] * Starting "no-preload-504000" primary control-plane node in "no-preload-504000" cluster
	I1028 05:44:41.919288   15404 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:44:41.919507   15404 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/no-preload-504000/config.json ...
	I1028 05:44:41.919558   15404 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/no-preload-504000/config.json: {Name:mk4c600a6e3e0e49a483da272a1b936d3f1c22c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:44:41.919740   15404 cache.go:107] acquiring lock: {Name:mk77ae2f700184c7e0ae932a9014a53b70714e9a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.919882   15404 cache.go:107] acquiring lock: {Name:mkdf4f5425ef2245571390a4e94284301b047254 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.919910   15404 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1028 05:44:41.919919   15404 cache.go:107] acquiring lock: {Name:mk595bc067274053abe9bb2796d2be8a8e8a95be Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.919929   15404 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 194.625µs
	I1028 05:44:41.919944   15404 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1028 05:44:41.919957   15404 cache.go:107] acquiring lock: {Name:mk4acaf89ffdfac6ed9422bb806792e4c6eb972c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.920022   15404 cache.go:107] acquiring lock: {Name:mk485f9e970e6b8f5a5790406d8a582079a67a99 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.920082   15404 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.31.2
	I1028 05:44:41.920090   15404 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.31.2
	I1028 05:44:41.920111   15404 cache.go:107] acquiring lock: {Name:mk7c27ec79b2ad29a079bb73e63f93ebfb6c96cd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.920173   15404 cache.go:107] acquiring lock: {Name:mkfe6deaf0cb15f9ae2cd5b60d3c11b837bcd41b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.920192   15404 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.31.2
	I1028 05:44:41.920251   15404 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.31.2
	I1028 05:44:41.920267   15404 start.go:360] acquireMachinesLock for no-preload-504000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:41.920286   15404 cache.go:107] acquiring lock: {Name:mk50f067c6b73d8abf8b70427c910c8b15377ad4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:41.920323   15404 image.go:135] retrieving image: registry.k8s.io/etcd:3.5.15-0
	I1028 05:44:41.920344   15404 image.go:135] retrieving image: registry.k8s.io/pause:3.10
	I1028 05:44:41.920389   15404 image.go:135] retrieving image: registry.k8s.io/coredns/coredns:v1.11.3
	I1028 05:44:41.920326   15404 start.go:364] duration metric: took 47.292µs to acquireMachinesLock for "no-preload-504000"
	I1028 05:44:41.920420   15404 start.go:93] Provisioning new machine with config: &{Name:no-preload-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:no-preload-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOption
s:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:41.920451   15404 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:41.924346   15404 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:44:41.931703   15404 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.31.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.31.2
	I1028 05:44:41.931866   15404 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.31.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.31.2
	I1028 05:44:41.931907   15404 image.go:178] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.3: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.3
	I1028 05:44:41.932271   15404 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.31.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.31.2
	I1028 05:44:41.932547   15404 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.31.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.31.2
	I1028 05:44:41.934874   15404 image.go:178] daemon lookup for registry.k8s.io/pause:3.10: Error response from daemon: No such image: registry.k8s.io/pause:3.10
	I1028 05:44:41.934885   15404 image.go:178] daemon lookup for registry.k8s.io/etcd:3.5.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.15-0
	I1028 05:44:41.941612   15404 start.go:159] libmachine.API.Create for "no-preload-504000" (driver="qemu2")
	I1028 05:44:41.941630   15404 client.go:168] LocalClient.Create starting
	I1028 05:44:41.941711   15404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:41.941747   15404 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:41.941758   15404 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:41.941796   15404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:41.941825   15404 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:41.941834   15404 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:41.942222   15404 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:42.109631   15404 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:42.431654   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2
	I1028 05:44:42.434172   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2
	I1028 05:44:42.445178   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3
	I1028 05:44:42.492106   15404 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:42.492120   15404 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:42.492342   15404 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:42.502625   15404 main.go:141] libmachine: STDOUT: 
	I1028 05:44:42.502645   15404 main.go:141] libmachine: STDERR: 
	I1028 05:44:42.502696   15404 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2 +20000M
	I1028 05:44:42.509973   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2
	I1028 05:44:42.511737   15404 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:42.511743   15404 main.go:141] libmachine: STDERR: 
	I1028 05:44:42.511753   15404 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:42.511759   15404 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:42.511771   15404 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:42.511798   15404 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:6f:21:ff:d7:81 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:42.513872   15404 main.go:141] libmachine: STDOUT: 
	I1028 05:44:42.513886   15404 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:42.513903   15404 client.go:171] duration metric: took 572.267875ms to LocalClient.Create
	I1028 05:44:42.566797   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2
	I1028 05:44:42.633523   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10
	I1028 05:44:42.708165   15404 cache.go:162] opening:  /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0
	I1028 05:44:42.750196   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I1028 05:44:42.750213   15404 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 830.254125ms
	I1028 05:44:42.750227   15404 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I1028 05:44:44.514107   15404 start.go:128] duration metric: took 2.5936355s to createHost
	I1028 05:44:44.514147   15404 start.go:83] releasing machines lock for "no-preload-504000", held for 2.593727875s
	W1028 05:44:44.514177   15404 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:44.530135   15404 out.go:177] * Deleting "no-preload-504000" in qemu2 ...
	W1028 05:44:44.552357   15404 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:44.552372   15404 start.go:729] Will try again in 5 seconds ...
	I1028 05:44:45.712854   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
	I1028 05:44:45.712886   15404 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 3.792590917s
	I1028 05:44:45.712900   15404 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
	I1028 05:44:46.343952   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 exists
	I1028 05:44:46.343988   15404 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2" took 4.424114667s
	I1028 05:44:46.344006   15404 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 succeeded
	I1028 05:44:46.806822   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 exists
	I1028 05:44:46.806857   15404 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2" took 4.88694525s
	I1028 05:44:46.806874   15404 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 succeeded
	I1028 05:44:47.344690   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 exists
	I1028 05:44:47.344716   15404 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2" took 5.424708417s
	I1028 05:44:47.344750   15404 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 succeeded
	I1028 05:44:47.594924   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 exists
	I1028 05:44:47.594945   15404 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2" took 5.6748205s
	I1028 05:44:47.594957   15404 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 succeeded
	I1028 05:44:49.552496   15404 start.go:360] acquireMachinesLock for no-preload-504000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:49.552688   15404 start.go:364] duration metric: took 164.625µs to acquireMachinesLock for "no-preload-504000"
	I1028 05:44:49.552725   15404 start.go:93] Provisioning new machine with config: &{Name:no-preload-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:no-preload-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOption
s:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:49.552774   15404 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:49.566102   15404 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:44:49.588401   15404 start.go:159] libmachine.API.Create for "no-preload-504000" (driver="qemu2")
	I1028 05:44:49.588436   15404 client.go:168] LocalClient.Create starting
	I1028 05:44:49.588519   15404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:49.588568   15404 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:49.588580   15404 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:49.588620   15404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:49.588657   15404 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:49.588668   15404 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:49.589012   15404 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:49.746276   15404 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:49.812890   15404 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:49.812897   15404 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:49.813069   15404 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:49.822891   15404 main.go:141] libmachine: STDOUT: 
	I1028 05:44:49.822910   15404 main.go:141] libmachine: STDERR: 
	I1028 05:44:49.822997   15404 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2 +20000M
	I1028 05:44:49.832105   15404 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:49.832127   15404 main.go:141] libmachine: STDERR: 
	I1028 05:44:49.832151   15404 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:49.832159   15404 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:49.832165   15404 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:49.832200   15404 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:0b:42:c0:33:ce -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:49.834042   15404 main.go:141] libmachine: STDOUT: 
	I1028 05:44:49.834057   15404 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:49.834071   15404 client.go:171] duration metric: took 245.631458ms to LocalClient.Create
	I1028 05:44:51.777176   15404 cache.go:157] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
	I1028 05:44:51.777230   15404 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 9.857041208s
	I1028 05:44:51.777250   15404 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
	I1028 05:44:51.777285   15404 cache.go:87] Successfully saved all images to host disk.
	I1028 05:44:51.836154   15404 start.go:128] duration metric: took 2.2833655s to createHost
	I1028 05:44:51.836182   15404 start.go:83] releasing machines lock for "no-preload-504000", held for 2.283471208s
	W1028 05:44:51.836306   15404 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-504000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-504000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:51.846372   15404 out.go:201] 
	W1028 05:44:51.853332   15404 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:51.853344   15404 out.go:270] * 
	* 
	W1028 05:44:51.854318   15404 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:44:51.866290   15404 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (47.752917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (10.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-504000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-504000 create -f testdata/busybox.yaml: exit status 1 (28.652958ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-504000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-504000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (33.500417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (33.023458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p no-preload-504000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-504000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-504000 describe deploy/metrics-server -n kube-system: exit status 1 (27.6935ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-504000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-504000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (35.147041ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (5.27s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (5.200689916s)

                                                
                                                
-- stdout --
	* [no-preload-504000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "no-preload-504000" primary control-plane node in "no-preload-504000" cluster
	* Restarting existing qemu2 VM for "no-preload-504000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "no-preload-504000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:55.685980   15489 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:55.686157   15489 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:55.686160   15489 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:55.686162   15489 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:55.686277   15489 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:55.687378   15489 out.go:352] Setting JSON to false
	I1028 05:44:55.705376   15489 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8066,"bootTime":1730111429,"procs":525,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:55.705450   15489 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:55.710532   15489 out.go:177] * [no-preload-504000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:55.717508   15489 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:55.717605   15489 notify.go:220] Checking for updates...
	I1028 05:44:55.725484   15489 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:55.728441   15489 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:55.731462   15489 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:55.734540   15489 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:55.737508   15489 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:55.740831   15489 config.go:182] Loaded profile config "no-preload-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:55.741096   15489 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:55.745545   15489 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:44:55.752470   15489 start.go:297] selected driver: qemu2
	I1028 05:44:55.752476   15489 start.go:901] validating driver "qemu2" against &{Name:no-preload-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:no-preload-504000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:55.752531   15489 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:55.754957   15489 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:55.754999   15489 cni.go:84] Creating CNI manager for ""
	I1028 05:44:55.755018   15489 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:44:55.755042   15489 start.go:340] cluster config:
	{Name:no-preload-504000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-504000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVers
ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:55.759220   15489 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.767497   15489 out.go:177] * Starting "no-preload-504000" primary control-plane node in "no-preload-504000" cluster
	I1028 05:44:55.771531   15489 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:44:55.771613   15489 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/no-preload-504000/config.json ...
	I1028 05:44:55.771633   15489 cache.go:107] acquiring lock: {Name:mk77ae2f700184c7e0ae932a9014a53b70714e9a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771633   15489 cache.go:107] acquiring lock: {Name:mk7c27ec79b2ad29a079bb73e63f93ebfb6c96cd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771725   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 exists
	I1028 05:44:55.771734   15489 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2" took 106.125µs
	I1028 05:44:55.771734   15489 cache.go:107] acquiring lock: {Name:mk4acaf89ffdfac6ed9422bb806792e4c6eb972c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771742   15489 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 succeeded
	I1028 05:44:55.771729   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1028 05:44:55.771749   15489 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 120.541µs
	I1028 05:44:55.771752   15489 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1028 05:44:55.771758   15489 cache.go:107] acquiring lock: {Name:mkfe6deaf0cb15f9ae2cd5b60d3c11b837bcd41b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771781   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I1028 05:44:55.771741   15489 cache.go:107] acquiring lock: {Name:mkdf4f5425ef2245571390a4e94284301b047254 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771807   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
	I1028 05:44:55.771811   15489 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 53.416µs
	I1028 05:44:55.771814   15489 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
	I1028 05:44:55.771817   15489 cache.go:107] acquiring lock: {Name:mk50f067c6b73d8abf8b70427c910c8b15377ad4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771785   15489 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 51.375µs
	I1028 05:44:55.771846   15489 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I1028 05:44:55.771862   15489 cache.go:107] acquiring lock: {Name:mk485f9e970e6b8f5a5790406d8a582079a67a99 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771882   15489 cache.go:107] acquiring lock: {Name:mk595bc067274053abe9bb2796d2be8a8e8a95be Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:55.771890   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 exists
	I1028 05:44:55.771894   15489 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2" took 190.208µs
	I1028 05:44:55.771899   15489 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 succeeded
	I1028 05:44:55.771890   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
	I1028 05:44:55.771904   15489 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 127.875µs
	I1028 05:44:55.771909   15489 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
	I1028 05:44:55.771950   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 exists
	I1028 05:44:55.771957   15489 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2" took 155.833µs
	I1028 05:44:55.771962   15489 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 succeeded
	I1028 05:44:55.771968   15489 cache.go:115] /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 exists
	I1028 05:44:55.771973   15489 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.2" -> "/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2" took 199.084µs
	I1028 05:44:55.771977   15489 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.2 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 succeeded
	I1028 05:44:55.771982   15489 cache.go:87] Successfully saved all images to host disk.
	I1028 05:44:55.772052   15489 start.go:360] acquireMachinesLock for no-preload-504000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:55.772079   15489 start.go:364] duration metric: took 21.75µs to acquireMachinesLock for "no-preload-504000"
	I1028 05:44:55.772087   15489 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:44:55.772090   15489 fix.go:54] fixHost starting: 
	I1028 05:44:55.772207   15489 fix.go:112] recreateIfNeeded on no-preload-504000: state=Stopped err=<nil>
	W1028 05:44:55.772215   15489 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:44:55.779488   15489 out.go:177] * Restarting existing qemu2 VM for "no-preload-504000" ...
	I1028 05:44:55.782433   15489 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:55.782467   15489 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:0b:42:c0:33:ce -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:44:55.784410   15489 main.go:141] libmachine: STDOUT: 
	I1028 05:44:55.784427   15489 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:55.784453   15489 fix.go:56] duration metric: took 12.360792ms for fixHost
	I1028 05:44:55.784457   15489 start.go:83] releasing machines lock for "no-preload-504000", held for 12.374542ms
	W1028 05:44:55.784463   15489 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:44:55.784499   15489 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:44:55.784503   15489 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:00.786796   15489 start.go:360] acquireMachinesLock for no-preload-504000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:00.787364   15489 start.go:364] duration metric: took 464.5µs to acquireMachinesLock for "no-preload-504000"
	I1028 05:45:00.787490   15489 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:00.787511   15489 fix.go:54] fixHost starting: 
	I1028 05:45:00.788303   15489 fix.go:112] recreateIfNeeded on no-preload-504000: state=Stopped err=<nil>
	W1028 05:45:00.788330   15489 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:00.803745   15489 out.go:177] * Restarting existing qemu2 VM for "no-preload-504000" ...
	I1028 05:45:00.807811   15489 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:00.808171   15489 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:0b:42:c0:33:ce -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/no-preload-504000/disk.qcow2
	I1028 05:45:00.818511   15489 main.go:141] libmachine: STDOUT: 
	I1028 05:45:00.818564   15489 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:00.818637   15489 fix.go:56] duration metric: took 31.128042ms for fixHost
	I1028 05:45:00.818660   15489 start.go:83] releasing machines lock for "no-preload-504000", held for 31.269291ms
	W1028 05:45:00.818833   15489 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-504000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-504000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:00.827765   15489 out.go:201] 
	W1028 05:45:00.830848   15489 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:00.830878   15489 out.go:270] * 
	* 
	W1028 05:45:00.833428   15489 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:00.841727   15489 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p no-preload-504000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (69.018291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (5.27s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (9.99s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (9.917860875s)

                                                
                                                
-- stdout --
	* [embed-certs-101000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "embed-certs-101000" primary control-plane node in "embed-certs-101000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "embed-certs-101000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:44:57.751905   15499 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:44:57.752067   15499 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:57.752070   15499 out.go:358] Setting ErrFile to fd 2...
	I1028 05:44:57.752073   15499 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:44:57.752190   15499 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:44:57.753313   15499 out.go:352] Setting JSON to false
	I1028 05:44:57.770914   15499 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8068,"bootTime":1730111429,"procs":524,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:44:57.770992   15499 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:44:57.775857   15499 out.go:177] * [embed-certs-101000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:44:57.781845   15499 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:44:57.781915   15499 notify.go:220] Checking for updates...
	I1028 05:44:57.788880   15499 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:44:57.791840   15499 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:44:57.794895   15499 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:44:57.797876   15499 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:44:57.800845   15499 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:44:57.804229   15499 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:57.804338   15499 config.go:182] Loaded profile config "no-preload-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:44:57.804391   15499 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:44:57.808911   15499 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:44:57.815856   15499 start.go:297] selected driver: qemu2
	I1028 05:44:57.815862   15499 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:44:57.815872   15499 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:44:57.818436   15499 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:44:57.821891   15499 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:44:57.823399   15499 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:44:57.823423   15499 cni.go:84] Creating CNI manager for ""
	I1028 05:44:57.823452   15499 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:44:57.823461   15499 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:44:57.823495   15499 start.go:340] cluster config:
	{Name:embed-certs-101000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-101000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socke
t_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:44:57.828189   15499 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:44:57.835872   15499 out.go:177] * Starting "embed-certs-101000" primary control-plane node in "embed-certs-101000" cluster
	I1028 05:44:57.839859   15499 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:44:57.839876   15499 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:44:57.839885   15499 cache.go:56] Caching tarball of preloaded images
	I1028 05:44:57.839974   15499 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:44:57.839979   15499 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:44:57.840046   15499 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/embed-certs-101000/config.json ...
	I1028 05:44:57.840057   15499 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/embed-certs-101000/config.json: {Name:mk78b243030ee383e4dc73758790be665665e08f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:44:57.840446   15499 start.go:360] acquireMachinesLock for embed-certs-101000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:44:57.840501   15499 start.go:364] duration metric: took 46.125µs to acquireMachinesLock for "embed-certs-101000"
	I1028 05:44:57.840514   15499 start.go:93] Provisioning new machine with config: &{Name:embed-certs-101000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:embed-certs-101000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:44:57.840545   15499 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:44:57.848854   15499 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:44:57.866095   15499 start.go:159] libmachine.API.Create for "embed-certs-101000" (driver="qemu2")
	I1028 05:44:57.866127   15499 client.go:168] LocalClient.Create starting
	I1028 05:44:57.866204   15499 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:44:57.866242   15499 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:57.866252   15499 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:57.866290   15499 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:44:57.866322   15499 main.go:141] libmachine: Decoding PEM data...
	I1028 05:44:57.866331   15499 main.go:141] libmachine: Parsing certificate...
	I1028 05:44:57.866771   15499 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:44:58.023906   15499 main.go:141] libmachine: Creating SSH key...
	I1028 05:44:58.160125   15499 main.go:141] libmachine: Creating Disk image...
	I1028 05:44:58.160131   15499 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:44:58.160324   15499 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:44:58.170266   15499 main.go:141] libmachine: STDOUT: 
	I1028 05:44:58.170289   15499 main.go:141] libmachine: STDERR: 
	I1028 05:44:58.170343   15499 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2 +20000M
	I1028 05:44:58.178760   15499 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:44:58.178783   15499 main.go:141] libmachine: STDERR: 
	I1028 05:44:58.178794   15499 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:44:58.178799   15499 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:44:58.178809   15499 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:44:58.178845   15499 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:a7:a3:09:e3:c7 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:44:58.180595   15499 main.go:141] libmachine: STDOUT: 
	I1028 05:44:58.180614   15499 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:44:58.180633   15499 client.go:171] duration metric: took 314.500166ms to LocalClient.Create
	I1028 05:45:00.182850   15499 start.go:128] duration metric: took 2.342272458s to createHost
	I1028 05:45:00.182942   15499 start.go:83] releasing machines lock for "embed-certs-101000", held for 2.34242625s
	W1028 05:45:00.182991   15499 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:00.198121   15499 out.go:177] * Deleting "embed-certs-101000" in qemu2 ...
	W1028 05:45:00.222510   15499 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:00.222542   15499 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:05.224729   15499 start.go:360] acquireMachinesLock for embed-certs-101000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:05.225282   15499 start.go:364] duration metric: took 464.25µs to acquireMachinesLock for "embed-certs-101000"
	I1028 05:45:05.225405   15499 start.go:93] Provisioning new machine with config: &{Name:embed-certs-101000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:embed-certs-101000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:45:05.225676   15499 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:45:05.235256   15499 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:45:05.286556   15499 start.go:159] libmachine.API.Create for "embed-certs-101000" (driver="qemu2")
	I1028 05:45:05.286625   15499 client.go:168] LocalClient.Create starting
	I1028 05:45:05.286786   15499 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:45:05.286899   15499 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:05.286919   15499 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:05.287004   15499 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:45:05.287071   15499 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:05.287088   15499 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:05.287813   15499 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:45:05.465543   15499 main.go:141] libmachine: Creating SSH key...
	I1028 05:45:05.569746   15499 main.go:141] libmachine: Creating Disk image...
	I1028 05:45:05.569752   15499 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:45:05.569935   15499 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:45:05.579703   15499 main.go:141] libmachine: STDOUT: 
	I1028 05:45:05.579726   15499 main.go:141] libmachine: STDERR: 
	I1028 05:45:05.579778   15499 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2 +20000M
	I1028 05:45:05.588139   15499 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:45:05.588154   15499 main.go:141] libmachine: STDERR: 
	I1028 05:45:05.588178   15499 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:45:05.588184   15499 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:45:05.588195   15499 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:05.588243   15499 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:5f:3c:d1:1b:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:45:05.590031   15499 main.go:141] libmachine: STDOUT: 
	I1028 05:45:05.590046   15499 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:05.590059   15499 client.go:171] duration metric: took 303.4275ms to LocalClient.Create
	I1028 05:45:07.592245   15499 start.go:128] duration metric: took 2.366533417s to createHost
	I1028 05:45:07.592324   15499 start.go:83] releasing machines lock for "embed-certs-101000", held for 2.367008875s
	W1028 05:45:07.592774   15499 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-101000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-101000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:07.603446   15499 out.go:201] 
	W1028 05:45:07.609497   15499 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:07.609525   15499 out.go:270] * 
	* 
	W1028 05:45:07.612189   15499 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:07.623401   15499 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (73.603ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (9.99s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-504000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (34.767083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-504000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-504000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-504000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (27.190209ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-504000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-504000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (32.701792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p no-preload-504000 image list --format=json
start_stop_delete_test.go:304: v1.31.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.3",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.2",
- 	"registry.k8s.io/kube-controller-manager:v1.31.2",
- 	"registry.k8s.io/kube-proxy:v1.31.2",
- 	"registry.k8s.io/kube-scheduler:v1.31.2",
- 	"registry.k8s.io/pause:3.10",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (32.79525ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p no-preload-504000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p no-preload-504000 --alsologtostderr -v=1: exit status 83 (44.843042ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-504000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-504000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:01.128052   15525 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:01.128246   15525 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:01.128249   15525 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:01.128252   15525 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:01.128393   15525 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:01.128623   15525 out.go:352] Setting JSON to false
	I1028 05:45:01.128631   15525 mustload.go:65] Loading cluster: no-preload-504000
	I1028 05:45:01.128859   15525 config.go:182] Loaded profile config "no-preload-504000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:01.133496   15525 out.go:177] * The control-plane node no-preload-504000 host is not running: state=Stopped
	I1028 05:45:01.136433   15525 out.go:177]   To start a cluster, run: "minikube start -p no-preload-504000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p no-preload-504000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (32.011625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (32.75325ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-504000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (10.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (9.985911625s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-434000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "default-k8s-diff-port-434000" primary control-plane node in "default-k8s-diff-port-434000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "default-k8s-diff-port-434000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:01.580353   15549 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:01.580507   15549 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:01.580510   15549 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:01.580513   15549 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:01.580639   15549 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:01.581820   15549 out.go:352] Setting JSON to false
	I1028 05:45:01.599597   15549 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8072,"bootTime":1730111429,"procs":526,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:45:01.599669   15549 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:45:01.604490   15549 out.go:177] * [default-k8s-diff-port-434000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:45:01.611447   15549 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:45:01.611520   15549 notify.go:220] Checking for updates...
	I1028 05:45:01.618410   15549 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:45:01.621372   15549 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:45:01.624439   15549 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:45:01.627347   15549 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:45:01.630427   15549 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:45:01.633832   15549 config.go:182] Loaded profile config "embed-certs-101000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:01.633905   15549 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:01.633950   15549 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:45:01.638384   15549 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:45:01.645452   15549 start.go:297] selected driver: qemu2
	I1028 05:45:01.645458   15549 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:45:01.645466   15549 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:45:01.647956   15549 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:45:01.651386   15549 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:45:01.654433   15549 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:45:01.654451   15549 cni.go:84] Creating CNI manager for ""
	I1028 05:45:01.654475   15549 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:45:01.654481   15549 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:45:01.654516   15549 start.go:340] cluster config:
	{Name:default-k8s-diff-port-434000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:default-k8s-diff-port-434000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:c
luster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/s
ocket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:01.659297   15549 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:45:01.667419   15549 out.go:177] * Starting "default-k8s-diff-port-434000" primary control-plane node in "default-k8s-diff-port-434000" cluster
	I1028 05:45:01.671428   15549 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:45:01.671450   15549 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:45:01.671462   15549 cache.go:56] Caching tarball of preloaded images
	I1028 05:45:01.671557   15549 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:45:01.671563   15549 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:45:01.671641   15549 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/default-k8s-diff-port-434000/config.json ...
	I1028 05:45:01.671654   15549 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/default-k8s-diff-port-434000/config.json: {Name:mk45d8376a9171b9dbe31aaab2d533f05f51940f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:45:01.671928   15549 start.go:360] acquireMachinesLock for default-k8s-diff-port-434000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:01.671982   15549 start.go:364] duration metric: took 45.5µs to acquireMachinesLock for "default-k8s-diff-port-434000"
	I1028 05:45:01.671995   15549 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-434000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.31.2 ClusterName:default-k8s-diff-port-434000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:45:01.672031   15549 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:45:01.679456   15549 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:45:01.697005   15549 start.go:159] libmachine.API.Create for "default-k8s-diff-port-434000" (driver="qemu2")
	I1028 05:45:01.697085   15549 client.go:168] LocalClient.Create starting
	I1028 05:45:01.697148   15549 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:45:01.697189   15549 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:01.697203   15549 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:01.697246   15549 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:45:01.697277   15549 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:01.697284   15549 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:01.697712   15549 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:45:01.854713   15549 main.go:141] libmachine: Creating SSH key...
	I1028 05:45:01.948287   15549 main.go:141] libmachine: Creating Disk image...
	I1028 05:45:01.948293   15549 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:45:01.948483   15549 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:01.958252   15549 main.go:141] libmachine: STDOUT: 
	I1028 05:45:01.958274   15549 main.go:141] libmachine: STDERR: 
	I1028 05:45:01.958330   15549 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2 +20000M
	I1028 05:45:01.966672   15549 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:45:01.966686   15549 main.go:141] libmachine: STDERR: 
	I1028 05:45:01.966704   15549 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:01.966716   15549 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:45:01.966733   15549 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:01.966755   15549 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/qemu.pid -device virtio-net-pci,netdev=net0,mac=66:6e:57:ea:88:7d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:01.968521   15549 main.go:141] libmachine: STDOUT: 
	I1028 05:45:01.968536   15549 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:01.968558   15549 client.go:171] duration metric: took 271.467625ms to LocalClient.Create
	I1028 05:45:03.970755   15549 start.go:128] duration metric: took 2.298701375s to createHost
	I1028 05:45:03.970803   15549 start.go:83] releasing machines lock for "default-k8s-diff-port-434000", held for 2.298806208s
	W1028 05:45:03.970863   15549 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:03.984930   15549 out.go:177] * Deleting "default-k8s-diff-port-434000" in qemu2 ...
	W1028 05:45:04.014113   15549 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:04.014135   15549 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:09.016414   15549 start.go:360] acquireMachinesLock for default-k8s-diff-port-434000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:09.016917   15549 start.go:364] duration metric: took 400.375µs to acquireMachinesLock for "default-k8s-diff-port-434000"
	I1028 05:45:09.017110   15549 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-434000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.31.2 ClusterName:default-k8s-diff-port-434000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:45:09.017381   15549 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:45:09.026126   15549 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:45:09.074194   15549 start.go:159] libmachine.API.Create for "default-k8s-diff-port-434000" (driver="qemu2")
	I1028 05:45:09.074253   15549 client.go:168] LocalClient.Create starting
	I1028 05:45:09.074371   15549 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:45:09.074456   15549 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:09.074484   15549 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:09.074546   15549 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:45:09.074583   15549 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:09.074602   15549 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:09.075188   15549 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:45:09.243426   15549 main.go:141] libmachine: Creating SSH key...
	I1028 05:45:09.457195   15549 main.go:141] libmachine: Creating Disk image...
	I1028 05:45:09.457204   15549 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:45:09.457418   15549 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:09.467616   15549 main.go:141] libmachine: STDOUT: 
	I1028 05:45:09.467652   15549 main.go:141] libmachine: STDERR: 
	I1028 05:45:09.467712   15549 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2 +20000M
	I1028 05:45:09.476285   15549 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:45:09.476309   15549 main.go:141] libmachine: STDERR: 
	I1028 05:45:09.476322   15549 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:09.476334   15549 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:45:09.476343   15549 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:09.476366   15549 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:91:db:8d:39:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:09.478199   15549 main.go:141] libmachine: STDOUT: 
	I1028 05:45:09.478215   15549 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:09.478226   15549 client.go:171] duration metric: took 403.964083ms to LocalClient.Create
	I1028 05:45:11.480435   15549 start.go:128] duration metric: took 2.462993125s to createHost
	I1028 05:45:11.480504   15549 start.go:83] releasing machines lock for "default-k8s-diff-port-434000", held for 2.463557166s
	W1028 05:45:11.480853   15549 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-434000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-434000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:11.490472   15549 out.go:201] 
	W1028 05:45:11.500559   15549 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:11.500590   15549 out.go:270] * 
	* 
	W1028 05:45:11.503188   15549 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:11.516379   15549 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (69.350084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (10.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-101000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-101000 create -f testdata/busybox.yaml: exit status 1 (29.430708ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-101000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-101000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (32.890375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (33.567416ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p embed-certs-101000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-101000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-101000 describe deploy/metrics-server -n kube-system: exit status 1 (27.902625ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-101000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-101000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (33.575709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (5.93s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (5.8602745s)

                                                
                                                
-- stdout --
	* [embed-certs-101000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "embed-certs-101000" primary control-plane node in "embed-certs-101000" cluster
	* Restarting existing qemu2 VM for "embed-certs-101000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "embed-certs-101000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:10.751149   15601 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:10.751303   15601 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:10.751307   15601 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:10.751317   15601 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:10.751430   15601 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:10.752697   15601 out.go:352] Setting JSON to false
	I1028 05:45:10.770422   15601 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8081,"bootTime":1730111429,"procs":519,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:45:10.770485   15601 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:45:10.775286   15601 out.go:177] * [embed-certs-101000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:45:10.782231   15601 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:45:10.782277   15601 notify.go:220] Checking for updates...
	I1028 05:45:10.790142   15601 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:45:10.794220   15601 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:45:10.797278   15601 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:45:10.800228   15601 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:45:10.803235   15601 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:45:10.806481   15601 config.go:182] Loaded profile config "embed-certs-101000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:10.806762   15601 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:45:10.811202   15601 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:45:10.818248   15601 start.go:297] selected driver: qemu2
	I1028 05:45:10.818260   15601 start.go:901] validating driver "qemu2" against &{Name:embed-certs-101000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:embed-certs-101000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 Cer
tExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:10.818326   15601 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:45:10.820973   15601 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:45:10.821002   15601 cni.go:84] Creating CNI manager for ""
	I1028 05:45:10.821026   15601 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:45:10.821057   15601 start.go:340] cluster config:
	{Name:embed-certs-101000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-101000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:10.825801   15601 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:45:10.834242   15601 out.go:177] * Starting "embed-certs-101000" primary control-plane node in "embed-certs-101000" cluster
	I1028 05:45:10.838189   15601 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:45:10.838206   15601 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:45:10.838214   15601 cache.go:56] Caching tarball of preloaded images
	I1028 05:45:10.838299   15601 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:45:10.838311   15601 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:45:10.838401   15601 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/embed-certs-101000/config.json ...
	I1028 05:45:10.839055   15601 start.go:360] acquireMachinesLock for embed-certs-101000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:11.480735   15601 start.go:364] duration metric: took 641.601542ms to acquireMachinesLock for "embed-certs-101000"
	I1028 05:45:11.480885   15601 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:11.480917   15601 fix.go:54] fixHost starting: 
	I1028 05:45:11.481593   15601 fix.go:112] recreateIfNeeded on embed-certs-101000: state=Stopped err=<nil>
	W1028 05:45:11.481639   15601 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:11.497471   15601 out.go:177] * Restarting existing qemu2 VM for "embed-certs-101000" ...
	I1028 05:45:11.504360   15601 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:11.504563   15601 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:5f:3c:d1:1b:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:45:11.515697   15601 main.go:141] libmachine: STDOUT: 
	I1028 05:45:11.515773   15601 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:11.515921   15601 fix.go:56] duration metric: took 35.006625ms for fixHost
	I1028 05:45:11.515948   15601 start.go:83] releasing machines lock for "embed-certs-101000", held for 35.181417ms
	W1028 05:45:11.515983   15601 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:11.516230   15601 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:11.516249   15601 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:16.518494   15601 start.go:360] acquireMachinesLock for embed-certs-101000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:16.518950   15601 start.go:364] duration metric: took 350.083µs to acquireMachinesLock for "embed-certs-101000"
	I1028 05:45:16.519073   15601 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:16.519100   15601 fix.go:54] fixHost starting: 
	I1028 05:45:16.519885   15601 fix.go:112] recreateIfNeeded on embed-certs-101000: state=Stopped err=<nil>
	W1028 05:45:16.519911   15601 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:16.529319   15601 out.go:177] * Restarting existing qemu2 VM for "embed-certs-101000" ...
	I1028 05:45:16.533281   15601 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:16.533468   15601 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:5f:3c:d1:1b:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/embed-certs-101000/disk.qcow2
	I1028 05:45:16.543331   15601 main.go:141] libmachine: STDOUT: 
	I1028 05:45:16.543394   15601 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:16.543492   15601 fix.go:56] duration metric: took 24.397375ms for fixHost
	I1028 05:45:16.543550   15601 start.go:83] releasing machines lock for "embed-certs-101000", held for 24.533208ms
	W1028 05:45:16.543728   15601 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-101000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-101000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:16.551292   15601 out.go:201] 
	W1028 05:45:16.555370   15601 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:16.555406   15601 out.go:270] * 
	* 
	W1028 05:45:16.558045   15601 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:16.566267   15601 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p embed-certs-101000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (72.28125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (5.93s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-434000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-434000 create -f testdata/busybox.yaml: exit status 1 (29.235917ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-434000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-434000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (33.449125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (33.419083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p default-k8s-diff-port-434000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-434000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-434000 describe deploy/metrics-server -n kube-system: exit status 1 (27.797625ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-434000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-434000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (33.045959ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (5.28s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (5.202226625s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-434000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "default-k8s-diff-port-434000" primary control-plane node in "default-k8s-diff-port-434000" cluster
	* Restarting existing qemu2 VM for "default-k8s-diff-port-434000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "default-k8s-diff-port-434000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:15.381792   15642 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:15.381933   15642 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:15.381936   15642 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:15.381939   15642 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:15.382070   15642 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:15.383175   15642 out.go:352] Setting JSON to false
	I1028 05:45:15.400788   15642 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8086,"bootTime":1730111429,"procs":518,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:45:15.400863   15642 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:45:15.405394   15642 out.go:177] * [default-k8s-diff-port-434000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:45:15.412380   15642 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:45:15.412454   15642 notify.go:220] Checking for updates...
	I1028 05:45:15.419393   15642 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:45:15.422337   15642 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:45:15.425346   15642 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:45:15.428398   15642 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:45:15.431375   15642 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:45:15.434723   15642 config.go:182] Loaded profile config "default-k8s-diff-port-434000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:15.435001   15642 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:45:15.439359   15642 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:45:15.446363   15642 start.go:297] selected driver: qemu2
	I1028 05:45:15.446369   15642 start.go:901] validating driver "qemu2" against &{Name:default-k8s-diff-port-434000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.31.2 ClusterName:default-k8s-diff-port-434000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:f
alse ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:15.446414   15642 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:45:15.448943   15642 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 05:45:15.448969   15642 cni.go:84] Creating CNI manager for ""
	I1028 05:45:15.449004   15642 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:45:15.449023   15642 start.go:340] cluster config:
	{Name:default-k8s-diff-port-434000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:default-k8s-diff-port-434000 Name
space:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/min
ikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:15.453439   15642 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:45:15.461319   15642 out.go:177] * Starting "default-k8s-diff-port-434000" primary control-plane node in "default-k8s-diff-port-434000" cluster
	I1028 05:45:15.465366   15642 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:45:15.465384   15642 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:45:15.465395   15642 cache.go:56] Caching tarball of preloaded images
	I1028 05:45:15.465451   15642 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:45:15.465457   15642 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:45:15.465529   15642 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/default-k8s-diff-port-434000/config.json ...
	I1028 05:45:15.466023   15642 start.go:360] acquireMachinesLock for default-k8s-diff-port-434000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:15.466054   15642 start.go:364] duration metric: took 24.625µs to acquireMachinesLock for "default-k8s-diff-port-434000"
	I1028 05:45:15.466062   15642 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:15.466068   15642 fix.go:54] fixHost starting: 
	I1028 05:45:15.466191   15642 fix.go:112] recreateIfNeeded on default-k8s-diff-port-434000: state=Stopped err=<nil>
	W1028 05:45:15.466198   15642 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:15.470362   15642 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-434000" ...
	I1028 05:45:15.478324   15642 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:15.478355   15642 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:91:db:8d:39:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:15.480591   15642 main.go:141] libmachine: STDOUT: 
	I1028 05:45:15.480610   15642 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:15.480640   15642 fix.go:56] duration metric: took 14.571625ms for fixHost
	I1028 05:45:15.480646   15642 start.go:83] releasing machines lock for "default-k8s-diff-port-434000", held for 14.587709ms
	W1028 05:45:15.480652   15642 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:15.480684   15642 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:15.480689   15642 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:20.482821   15642 start.go:360] acquireMachinesLock for default-k8s-diff-port-434000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:20.483456   15642 start.go:364] duration metric: took 528.375µs to acquireMachinesLock for "default-k8s-diff-port-434000"
	I1028 05:45:20.483711   15642 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:20.483734   15642 fix.go:54] fixHost starting: 
	I1028 05:45:20.484653   15642 fix.go:112] recreateIfNeeded on default-k8s-diff-port-434000: state=Stopped err=<nil>
	W1028 05:45:20.484682   15642 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:20.499530   15642 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-434000" ...
	I1028 05:45:20.503445   15642 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:20.503784   15642 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:91:db:8d:39:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/default-k8s-diff-port-434000/disk.qcow2
	I1028 05:45:20.514804   15642 main.go:141] libmachine: STDOUT: 
	I1028 05:45:20.514873   15642 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:20.514959   15642 fix.go:56] duration metric: took 31.228ms for fixHost
	I1028 05:45:20.514981   15642 start.go:83] releasing machines lock for "default-k8s-diff-port-434000", held for 31.473041ms
	W1028 05:45:20.515159   15642 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-434000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-434000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:20.524477   15642 out.go:201] 
	W1028 05:45:20.527509   15642 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:20.527545   15642 out.go:270] * 
	* 
	W1028 05:45:20.530158   15642 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:20.539456   15642 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-434000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (73.643375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (5.28s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-101000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (34.531833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-101000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-101000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-101000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (27.431542ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-101000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-101000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (32.7075ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p embed-certs-101000 image list --format=json
start_stop_delete_test.go:304: v1.31.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.3",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.2",
- 	"registry.k8s.io/kube-controller-manager:v1.31.2",
- 	"registry.k8s.io/kube-proxy:v1.31.2",
- 	"registry.k8s.io/kube-scheduler:v1.31.2",
- 	"registry.k8s.io/pause:3.10",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (32.792541ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p embed-certs-101000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p embed-certs-101000 --alsologtostderr -v=1: exit status 83 (44.744125ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-101000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-101000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:16.856474   15661 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:16.856661   15661 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:16.856664   15661 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:16.856666   15661 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:16.856806   15661 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:16.857041   15661 out.go:352] Setting JSON to false
	I1028 05:45:16.857048   15661 mustload.go:65] Loading cluster: embed-certs-101000
	I1028 05:45:16.857291   15661 config.go:182] Loaded profile config "embed-certs-101000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:16.862166   15661 out.go:177] * The control-plane node embed-certs-101000 host is not running: state=Stopped
	I1028 05:45:16.865069   15661 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-101000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p embed-certs-101000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (33.215208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (33.447542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-101000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (10.32s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (10.241237709s)

                                                
                                                
-- stdout --
	* [newest-cni-189000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting "newest-cni-189000" primary control-plane node in "newest-cni-189000" cluster
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "newest-cni-189000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:17.196107   15678 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:17.196262   15678 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:17.196265   15678 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:17.196267   15678 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:17.196386   15678 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:17.197567   15678 out.go:352] Setting JSON to false
	I1028 05:45:17.215302   15678 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8088,"bootTime":1730111429,"procs":518,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:45:17.215379   15678 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:45:17.220127   15678 out.go:177] * [newest-cni-189000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:45:17.227155   15678 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:45:17.227227   15678 notify.go:220] Checking for updates...
	I1028 05:45:17.234109   15678 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:45:17.235574   15678 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:45:17.239098   15678 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:45:17.242108   15678 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:45:17.245135   15678 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:45:17.248465   15678 config.go:182] Loaded profile config "default-k8s-diff-port-434000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:17.248525   15678 config.go:182] Loaded profile config "multinode-379000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:17.248566   15678 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:45:17.253066   15678 out.go:177] * Using the qemu2 driver based on user configuration
	I1028 05:45:17.260081   15678 start.go:297] selected driver: qemu2
	I1028 05:45:17.260087   15678 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:45:17.260092   15678 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:45:17.262473   15678 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W1028 05:45:17.262518   15678 out.go:270] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I1028 05:45:17.267089   15678 out.go:177] * Automatically selected the socket_vmnet network
	I1028 05:45:17.270170   15678 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1028 05:45:17.270189   15678 cni.go:84] Creating CNI manager for ""
	I1028 05:45:17.270209   15678 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:45:17.270213   15678 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:45:17.270241   15678 start.go:340] cluster config:
	{Name:newest-cni-189000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-189000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:17.274913   15678 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:45:17.283122   15678 out.go:177] * Starting "newest-cni-189000" primary control-plane node in "newest-cni-189000" cluster
	I1028 05:45:17.286998   15678 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:45:17.287011   15678 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:45:17.287020   15678 cache.go:56] Caching tarball of preloaded images
	I1028 05:45:17.287091   15678 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:45:17.287097   15678 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:45:17.287149   15678 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/newest-cni-189000/config.json ...
	I1028 05:45:17.287160   15678 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/newest-cni-189000/config.json: {Name:mkbfb760889bb13cffb6a9caa7bcd94558739f96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:45:17.287560   15678 start.go:360] acquireMachinesLock for newest-cni-189000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:17.287611   15678 start.go:364] duration metric: took 45.166µs to acquireMachinesLock for "newest-cni-189000"
	I1028 05:45:17.287624   15678 start.go:93] Provisioning new machine with config: &{Name:newest-cni-189000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:newest-cni-189000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:45:17.287656   15678 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:45:17.291245   15678 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:45:17.308613   15678 start.go:159] libmachine.API.Create for "newest-cni-189000" (driver="qemu2")
	I1028 05:45:17.308643   15678 client.go:168] LocalClient.Create starting
	I1028 05:45:17.308719   15678 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:45:17.308758   15678 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:17.308774   15678 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:17.308809   15678 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:45:17.308842   15678 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:17.308849   15678 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:17.309286   15678 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:45:17.469398   15678 main.go:141] libmachine: Creating SSH key...
	I1028 05:45:17.756168   15678 main.go:141] libmachine: Creating Disk image...
	I1028 05:45:17.756182   15678 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:45:17.756448   15678 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:17.766766   15678 main.go:141] libmachine: STDOUT: 
	I1028 05:45:17.766797   15678 main.go:141] libmachine: STDERR: 
	I1028 05:45:17.766849   15678 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2 +20000M
	I1028 05:45:17.775294   15678 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:45:17.775308   15678 main.go:141] libmachine: STDERR: 
	I1028 05:45:17.775321   15678 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:17.775326   15678 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:45:17.775336   15678 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:17.775368   15678 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/qemu.pid -device virtio-net-pci,netdev=net0,mac=aa:6f:9c:d5:f6:ce -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:17.777162   15678 main.go:141] libmachine: STDOUT: 
	I1028 05:45:17.777179   15678 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:17.777200   15678 client.go:171] duration metric: took 468.548625ms to LocalClient.Create
	I1028 05:45:19.779427   15678 start.go:128] duration metric: took 2.491734917s to createHost
	I1028 05:45:19.779527   15678 start.go:83] releasing machines lock for "newest-cni-189000", held for 2.491899542s
	W1028 05:45:19.779698   15678 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:19.792938   15678 out.go:177] * Deleting "newest-cni-189000" in qemu2 ...
	W1028 05:45:19.823869   15678 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:19.823903   15678 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:24.826107   15678 start.go:360] acquireMachinesLock for newest-cni-189000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:24.826773   15678 start.go:364] duration metric: took 537µs to acquireMachinesLock for "newest-cni-189000"
	I1028 05:45:24.826941   15678 start.go:93] Provisioning new machine with config: &{Name:newest-cni-189000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.31.2 ClusterName:newest-cni-189000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-
host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1028 05:45:24.827251   15678 start.go:125] createHost starting for "" (driver="qemu2")
	I1028 05:45:24.832813   15678 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1028 05:45:24.883558   15678 start.go:159] libmachine.API.Create for "newest-cni-189000" (driver="qemu2")
	I1028 05:45:24.883616   15678 client.go:168] LocalClient.Create starting
	I1028 05:45:24.883756   15678 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/ca.pem
	I1028 05:45:24.883845   15678 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:24.883864   15678 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:24.883940   15678 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19865-11397/.minikube/certs/cert.pem
	I1028 05:45:24.883997   15678 main.go:141] libmachine: Decoding PEM data...
	I1028 05:45:24.884010   15678 main.go:141] libmachine: Parsing certificate...
	I1028 05:45:24.884647   15678 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso...
	I1028 05:45:25.052123   15678 main.go:141] libmachine: Creating SSH key...
	I1028 05:45:25.339889   15678 main.go:141] libmachine: Creating Disk image...
	I1028 05:45:25.339910   15678 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1028 05:45:25.340165   15678 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2.raw /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:25.351033   15678 main.go:141] libmachine: STDOUT: 
	I1028 05:45:25.351071   15678 main.go:141] libmachine: STDERR: 
	I1028 05:45:25.351150   15678 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2 +20000M
	I1028 05:45:25.359829   15678 main.go:141] libmachine: STDOUT: Image resized.
	
	I1028 05:45:25.359842   15678 main.go:141] libmachine: STDERR: 
	I1028 05:45:25.359859   15678 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:25.359864   15678 main.go:141] libmachine: Starting QEMU VM...
	I1028 05:45:25.359871   15678 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:25.359912   15678 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:64:b3:1f:51:58 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:25.361708   15678 main.go:141] libmachine: STDOUT: 
	I1028 05:45:25.361724   15678 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:25.361739   15678 client.go:171] duration metric: took 478.116875ms to LocalClient.Create
	I1028 05:45:27.364065   15678 start.go:128] duration metric: took 2.53675875s to createHost
	I1028 05:45:27.364183   15678 start.go:83] releasing machines lock for "newest-cni-189000", held for 2.53735925s
	W1028 05:45:27.364564   15678 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-189000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-189000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:27.373058   15678 out.go:201] 
	W1028 05:45:27.381086   15678 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:27.381121   15678 out.go:270] * 
	* 
	W1028 05:45:27.383781   15678 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:27.396011   15678 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (74.852792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (10.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-434000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (35.093625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-434000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-434000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-434000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (27.239625ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-434000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-434000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (32.723625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p default-k8s-diff-port-434000 image list --format=json
start_stop_delete_test.go:304: v1.31.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.3",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.2",
- 	"registry.k8s.io/kube-controller-manager:v1.31.2",
- 	"registry.k8s.io/kube-proxy:v1.31.2",
- 	"registry.k8s.io/kube-scheduler:v1.31.2",
- 	"registry.k8s.io/pause:3.10",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (33.213542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p default-k8s-diff-port-434000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-434000 --alsologtostderr -v=1: exit status 83 (43.248417ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-434000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-434000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:20.831006   15700 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:20.831188   15700 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:20.831192   15700 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:20.831194   15700 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:20.831321   15700 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:20.831526   15700 out.go:352] Setting JSON to false
	I1028 05:45:20.831534   15700 mustload.go:65] Loading cluster: default-k8s-diff-port-434000
	I1028 05:45:20.831748   15700 config.go:182] Loaded profile config "default-k8s-diff-port-434000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:20.835773   15700 out.go:177] * The control-plane node default-k8s-diff-port-434000 host is not running: state=Stopped
	I1028 05:45:20.838795   15700 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-434000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-434000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (32.521917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (33.294625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-434000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2: exit status 80 (5.191204167s)

                                                
                                                
-- stdout --
	* [newest-cni-189000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting "newest-cni-189000" primary control-plane node in "newest-cni-189000" cluster
	* Restarting existing qemu2 VM for "newest-cni-189000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "newest-cni-189000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:31.451360   15749 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:31.451509   15749 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:31.451512   15749 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:31.451515   15749 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:31.451654   15749 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:31.452702   15749 out.go:352] Setting JSON to false
	I1028 05:45:31.470339   15749 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":8102,"bootTime":1730111429,"procs":517,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:45:31.470415   15749 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:45:31.474865   15749 out.go:177] * [newest-cni-189000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:45:31.477910   15749 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:45:31.477944   15749 notify.go:220] Checking for updates...
	I1028 05:45:31.485778   15749 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:45:31.488836   15749 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:45:31.491871   15749 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:45:31.494813   15749 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:45:31.497956   15749 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:45:31.501242   15749 config.go:182] Loaded profile config "newest-cni-189000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:31.501506   15749 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:45:31.504760   15749 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:45:31.511868   15749 start.go:297] selected driver: qemu2
	I1028 05:45:31.511875   15749 start.go:901] validating driver "qemu2" against &{Name:newest-cni-189000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:newest-cni-189000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] Lis
tenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:31.511943   15749 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:45:31.514534   15749 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1028 05:45:31.514562   15749 cni.go:84] Creating CNI manager for ""
	I1028 05:45:31.514583   15749 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:45:31.514613   15749 start.go:340] cluster config:
	{Name:newest-cni-189000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-189000 Namespace:default APIServe
rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:45:31.519226   15749 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:45:31.527800   15749 out.go:177] * Starting "newest-cni-189000" primary control-plane node in "newest-cni-189000" cluster
	I1028 05:45:31.531789   15749 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:45:31.531804   15749 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:45:31.531814   15749 cache.go:56] Caching tarball of preloaded images
	I1028 05:45:31.531882   15749 preload.go:172] Found /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 05:45:31.531887   15749 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
	I1028 05:45:31.531940   15749 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/newest-cni-189000/config.json ...
	I1028 05:45:31.532417   15749 start.go:360] acquireMachinesLock for newest-cni-189000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:31.532446   15749 start.go:364] duration metric: took 23.375µs to acquireMachinesLock for "newest-cni-189000"
	I1028 05:45:31.532455   15749 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:31.532460   15749 fix.go:54] fixHost starting: 
	I1028 05:45:31.532576   15749 fix.go:112] recreateIfNeeded on newest-cni-189000: state=Stopped err=<nil>
	W1028 05:45:31.532591   15749 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:31.536873   15749 out.go:177] * Restarting existing qemu2 VM for "newest-cni-189000" ...
	I1028 05:45:31.543856   15749 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:31.543909   15749 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:64:b3:1f:51:58 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:31.546044   15749 main.go:141] libmachine: STDOUT: 
	I1028 05:45:31.546062   15749 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:31.546098   15749 fix.go:56] duration metric: took 13.637375ms for fixHost
	I1028 05:45:31.546103   15749 start.go:83] releasing machines lock for "newest-cni-189000", held for 13.652041ms
	W1028 05:45:31.546109   15749 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:31.546157   15749 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:31.546161   15749 start.go:729] Will try again in 5 seconds ...
	I1028 05:45:36.548330   15749 start.go:360] acquireMachinesLock for newest-cni-189000: {Name:mk1a59e83445267582ad8d7b1a29888435d45b13 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1028 05:45:36.548938   15749 start.go:364] duration metric: took 502.5µs to acquireMachinesLock for "newest-cni-189000"
	I1028 05:45:36.549136   15749 start.go:96] Skipping create...Using existing machine configuration
	I1028 05:45:36.549160   15749 fix.go:54] fixHost starting: 
	I1028 05:45:36.550054   15749 fix.go:112] recreateIfNeeded on newest-cni-189000: state=Stopped err=<nil>
	W1028 05:45:36.550081   15749 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 05:45:36.559682   15749 out.go:177] * Restarting existing qemu2 VM for "newest-cni-189000" ...
	I1028 05:45:36.563749   15749 qemu.go:418] Using hvf for hardware acceleration
	I1028 05:45:36.563996   15749 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:64:b3:1f:51:58 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19865-11397/.minikube/machines/newest-cni-189000/disk.qcow2
	I1028 05:45:36.574234   15749 main.go:141] libmachine: STDOUT: 
	I1028 05:45:36.574288   15749 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1028 05:45:36.574372   15749 fix.go:56] duration metric: took 25.215333ms for fixHost
	I1028 05:45:36.574386   15749 start.go:83] releasing machines lock for "newest-cni-189000", held for 25.386875ms
	W1028 05:45:36.574600   15749 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-189000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-189000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1028 05:45:36.581609   15749 out.go:201] 
	W1028 05:45:36.585767   15749 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1028 05:45:36.585801   15749 out.go:270] * 
	* 
	W1028 05:45:36.588598   15749 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:45:36.596626   15749 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p newest-cni-189000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.31.2": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (74.638291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 -p newest-cni-189000 image list --format=json
start_stop_delete_test.go:304: v1.31.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.3",
- 	"registry.k8s.io/etcd:3.5.15-0",
- 	"registry.k8s.io/kube-apiserver:v1.31.2",
- 	"registry.k8s.io/kube-controller-manager:v1.31.2",
- 	"registry.k8s.io/kube-proxy:v1.31.2",
- 	"registry.k8s.io/kube-scheduler:v1.31.2",
- 	"registry.k8s.io/pause:3.10",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (35.048083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p newest-cni-189000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p newest-cni-189000 --alsologtostderr -v=1: exit status 83 (45.430917ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-189000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-189000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:45:36.800794   15765 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:45:36.801007   15765 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:36.801010   15765 out.go:358] Setting ErrFile to fd 2...
	I1028 05:45:36.801013   15765 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:45:36.801146   15765 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:45:36.801387   15765 out.go:352] Setting JSON to false
	I1028 05:45:36.801394   15765 mustload.go:65] Loading cluster: newest-cni-189000
	I1028 05:45:36.801647   15765 config.go:182] Loaded profile config "newest-cni-189000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:45:36.805159   15765 out.go:177] * The control-plane node newest-cni-189000 host is not running: state=Stopped
	I1028 05:45:36.809161   15765 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-189000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p newest-cni-189000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (34.702042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-189000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (35.536875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.12s)

                                                
                                    

Test pass (80/258)

Order passed test Duration
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.11
9 TestDownloadOnly/v1.20.0/DeleteAll 0.12
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.11
12 TestDownloadOnly/v1.31.2/json-events 6.88
13 TestDownloadOnly/v1.31.2/preload-exists 0
16 TestDownloadOnly/v1.31.2/kubectl 0
17 TestDownloadOnly/v1.31.2/LogsDuration 0.08
18 TestDownloadOnly/v1.31.2/DeleteAll 0.12
19 TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds 0.11
21 TestBinaryMirror 0.34
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.06
35 TestHyperKitDriverInstallOrUpdate 10.82
39 TestErrorSpam/start 0.41
40 TestErrorSpam/status 0.11
41 TestErrorSpam/pause 0.14
42 TestErrorSpam/unpause 0.13
43 TestErrorSpam/stop 9.08
46 TestFunctional/serial/CopySyncFile 0
48 TestFunctional/serial/AuditLog 0
54 TestFunctional/serial/CacheCmd/cache/add_remote 2.03
55 TestFunctional/serial/CacheCmd/cache/add_local 0.99
56 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.04
57 TestFunctional/serial/CacheCmd/cache/list 0.04
60 TestFunctional/serial/CacheCmd/cache/delete 0.08
69 TestFunctional/parallel/ConfigCmd 0.24
71 TestFunctional/parallel/DryRun 0.29
72 TestFunctional/parallel/InternationalLanguage 0.12
78 TestFunctional/parallel/AddonsCmd 0.1
93 TestFunctional/parallel/License 0.23
94 TestFunctional/parallel/Version/short 0.04
101 TestFunctional/parallel/ImageCommands/Setup 1.92
114 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
122 TestFunctional/parallel/ImageCommands/ImageRemove 0.08
124 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.08
125 TestFunctional/parallel/ProfileCmd/profile_not_create 0.1
126 TestFunctional/parallel/ProfileCmd/profile_list 0.09
127 TestFunctional/parallel/ProfileCmd/profile_json_output 0.09
132 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.04
134 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.17
135 TestFunctional/delete_echo-server_images 0.07
136 TestFunctional/delete_my-image_image 0.02
137 TestFunctional/delete_minikube_cached_images 0.02
166 TestJSONOutput/start/Audit 0
168 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
169 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
172 TestJSONOutput/pause/Audit 0
174 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
175 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
178 TestJSONOutput/unpause/Audit 0
180 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
181 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
183 TestJSONOutput/stop/Command 2.09
184 TestJSONOutput/stop/Audit 0
186 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
188 TestErrorJSONOutput 0.22
193 TestMainNoArgs 0.04
240 TestStoppedBinaryUpgrade/Setup 1
252 TestNoKubernetes/serial/StartNoK8sWithVersion 0.1
256 TestNoKubernetes/serial/VerifyK8sNotRunning 0.05
257 TestNoKubernetes/serial/ProfileList 31.4
258 TestNoKubernetes/serial/Stop 3.34
260 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.05
272 TestStoppedBinaryUpgrade/MinikubeLogs 0.72
275 TestStartStop/group/old-k8s-version/serial/Stop 1.89
276 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.13
286 TestStartStop/group/no-preload/serial/Stop 3.41
287 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.1
299 TestStartStop/group/embed-certs/serial/Stop 2.65
300 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.13
304 TestStartStop/group/default-k8s-diff-port/serial/Stop 3.39
305 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.13
317 TestStartStop/group/newest-cni/serial/DeployApp 0
318 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.06
319 TestStartStop/group/newest-cni/serial/Stop 3.74
320 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.13
322 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
323 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
I1028 05:20:28.313600   11909 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
I1028 05:20:28.314024   11909 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.11s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-116000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-116000: exit status 85 (106.25ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |          |
	|         | -p download-only-116000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=qemu2                 |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 05:20:15
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.23.2 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 05:20:15.729272   11910 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:20:15.729479   11910 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:15.729482   11910 out.go:358] Setting ErrFile to fd 2...
	I1028 05:20:15.729484   11910 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:15.729598   11910 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	W1028 05:20:15.729680   11910 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19865-11397/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19865-11397/.minikube/config/config.json: no such file or directory
	I1028 05:20:15.731080   11910 out.go:352] Setting JSON to true
	I1028 05:20:15.749192   11910 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6586,"bootTime":1730111429,"procs":528,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:20:15.749286   11910 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:20:15.754997   11910 out.go:97] [download-only-116000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:20:15.755123   11910 notify.go:220] Checking for updates...
	W1028 05:20:15.755141   11910 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball: no such file or directory
	I1028 05:20:15.758992   11910 out.go:169] MINIKUBE_LOCATION=19865
	I1028 05:20:15.762077   11910 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:20:15.766962   11910 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:20:15.769991   11910 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:20:15.773053   11910 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	W1028 05:20:15.778986   11910 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1028 05:20:15.779218   11910 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:20:15.781912   11910 out.go:97] Using the qemu2 driver based on user configuration
	I1028 05:20:15.781933   11910 start.go:297] selected driver: qemu2
	I1028 05:20:15.781947   11910 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:20:15.782011   11910 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:20:15.784929   11910 out.go:169] Automatically selected the socket_vmnet network
	I1028 05:20:15.790489   11910 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I1028 05:20:15.790590   11910 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:20:15.790648   11910 cni.go:84] Creating CNI manager for ""
	I1028 05:20:15.790690   11910 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1028 05:20:15.790744   11910 start.go:340] cluster config:
	{Name:download-only-116000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-116000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo
ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:20:15.795737   11910 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:20:15.800033   11910 out.go:97] Downloading VM boot image ...
	I1028 05:20:15.800052   11910 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/iso/arm64/minikube-v1.34.0-1729002252-19806-arm64.iso
	I1028 05:20:21.113425   11910 out.go:97] Starting "download-only-116000" primary control-plane node in "download-only-116000" cluster
	I1028 05:20:21.113462   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:21.175184   11910 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:20:21.175204   11910 cache.go:56] Caching tarball of preloaded images
	I1028 05:20:21.175420   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:21.179522   11910 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I1028 05:20:21.179529   11910 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:21.258738   11910 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4
	I1028 05:20:27.082179   11910 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:27.082372   11910 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:27.776647   11910 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I1028 05:20:27.776874   11910 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/download-only-116000/config.json ...
	I1028 05:20:27.776893   11910 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19865-11397/.minikube/profiles/download-only-116000/config.json: {Name:mkcfbe7d897a4adee526ee4de110626984ca579f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 05:20:27.778071   11910 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I1028 05:20:27.778319   11910 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl
	I1028 05:20:28.261421   11910 out.go:193] 
	W1028 05:20:28.268361   11910 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19865-11397/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320 0x109501320] Decompressors:map[bz2:0x14000121810 gz:0x14000121818 tar:0x14000121790 tar.bz2:0x140001217a0 tar.gz:0x140001217c0 tar.xz:0x140001217d0 tar.zst:0x14000121800 tbz2:0x140001217a0 tgz:0x140001217c0 txz:0x140001217d0 tzst:0x14000121800 xz:0x14000121820 zip:0x14000121830 zst:0x14000121828] Getters:map[file:0x14000086df0 http:0x1400065c780 https:0x1400065c7d0] Dir:false ProgressLis
tener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W1028 05:20:28.268392   11910 out_reason.go:110] 
	W1028 05:20:28.274476   11910 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 05:20:28.279380   11910 out.go:193] 
	
	
	* The control-plane node download-only-116000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-116000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.11s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.12s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.12s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.11s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-arm64 delete -p download-only-116000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.11s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/json-events (6.88s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-575000 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-575000 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=docker --driver=qemu2 : (6.878849833s)
--- PASS: TestDownloadOnly/v1.31.2/json-events (6.88s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/preload-exists
I1028 05:20:35.572701   11909 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1028 05:20:35.572749   11909 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.31.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/kubectl
--- PASS: TestDownloadOnly/v1.31.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-575000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-575000: exit status 85 (84.167958ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | -p download-only-116000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=qemu2                 |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| delete  | -p download-only-116000        | download-only-116000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT | 28 Oct 24 05:20 PDT |
	| start   | -o=json --download-only        | download-only-575000 | jenkins | v1.34.0 | 28 Oct 24 05:20 PDT |                     |
	|         | -p download-only-575000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=qemu2                 |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 05:20:28
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.23.2 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 05:20:28.725165   11934 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:20:28.725324   11934 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:28.725327   11934 out.go:358] Setting ErrFile to fd 2...
	I1028 05:20:28.725330   11934 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:20:28.725459   11934 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:20:28.726629   11934 out.go:352] Setting JSON to true
	I1028 05:20:28.744182   11934 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6599,"bootTime":1730111429,"procs":528,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:20:28.744262   11934 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:20:28.748743   11934 out.go:97] [download-only-575000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:20:28.748865   11934 notify.go:220] Checking for updates...
	I1028 05:20:28.752664   11934 out.go:169] MINIKUBE_LOCATION=19865
	I1028 05:20:28.755803   11934 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:20:28.758626   11934 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:20:28.761697   11934 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:20:28.764720   11934 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	W1028 05:20:28.768653   11934 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1028 05:20:28.768828   11934 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:20:28.771652   11934 out.go:97] Using the qemu2 driver based on user configuration
	I1028 05:20:28.771665   11934 start.go:297] selected driver: qemu2
	I1028 05:20:28.771669   11934 start.go:901] validating driver "qemu2" against <nil>
	I1028 05:20:28.771714   11934 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 05:20:28.774654   11934 out.go:169] Automatically selected the socket_vmnet network
	I1028 05:20:28.780112   11934 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I1028 05:20:28.780241   11934 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 05:20:28.780265   11934 cni.go:84] Creating CNI manager for ""
	I1028 05:20:28.780293   11934 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1028 05:20:28.780300   11934 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1028 05:20:28.780349   11934 start.go:340] cluster config:
	{Name:download-only-575000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:download-only-575000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con
tainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAut
hSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:20:28.784719   11934 iso.go:125] acquiring lock: {Name:mk3045d35abd4ee457d94acff2daaed15e7acfa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 05:20:28.787690   11934 out.go:97] Starting "download-only-575000" primary control-plane node in "download-only-575000" cluster
	I1028 05:20:28.787696   11934 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:20:28.846996   11934 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:20:28.847037   11934 cache.go:56] Caching tarball of preloaded images
	I1028 05:20:28.847271   11934 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
	I1028 05:20:28.853302   11934 out.go:97] Downloading Kubernetes v1.31.2 preload ...
	I1028 05:20:28.853311   11934 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:28.934775   11934 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4?checksum=md5:5f3d7369b12f47138aa2863bb7bda916 -> /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4
	I1028 05:20:33.597541   11934 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 ...
	I1028 05:20:33.597726   11934 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19865-11397/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-575000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-575000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.2/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/DeleteAll (0.12s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.2/DeleteAll (0.12s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.11s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-arm64 delete -p download-only-575000
--- PASS: TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.11s)

                                                
                                    
x
+
TestBinaryMirror (0.34s)

                                                
                                                
=== RUN   TestBinaryMirror
I1028 05:20:36.106943   11909 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/darwin/arm64/kubectl.sha256
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 start --download-only -p binary-mirror-410000 --alsologtostderr --binary-mirror http://127.0.0.1:58797 --driver=qemu2 
helpers_test.go:175: Cleaning up "binary-mirror-410000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p binary-mirror-410000
--- PASS: TestBinaryMirror (0.34s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p addons-782000
addons_test.go:939: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons enable dashboard -p addons-782000: exit status 85 (67.173209ms)

                                                
                                                
-- stdout --
	* Profile "addons-782000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-782000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:950: (dbg) Run:  out/minikube-darwin-arm64 addons disable dashboard -p addons-782000
addons_test.go:950: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons disable dashboard -p addons-782000: exit status 85 (63.498ms)

                                                
                                                
-- stdout --
	* Profile "addons-782000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-782000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (10.82s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
I1028 05:30:56.099364   11909 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1028 05:30:56.099528   11909 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin:/opt/homebrew/bin
W1028 05:30:58.033075   11909 install.go:62] docker-machine-driver-hyperkit: exit status 1
W1028 05:30:58.033301   11909 out.go:174] [unset outFile]: * Downloading driver docker-machine-driver-hyperkit:
I1028 05:30:58.033351   11909 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64.sha256 -> /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit
I1028 05:30:58.627497   11909 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit-arm64.sha256 Dst:/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0 0x10718a6e0] Decompressors:map[bz2:0x140005cce10 gz:0x140005cce18 tar:0x140005ccdc0 tar.bz2:0x140005ccdd0 tar.gz:0x140005ccde0 tar.xz:0x140005ccdf0 tar.zst:0x140005cce00 tbz2:0x140005ccdd0 tgz:0x140005ccde0 txz:0x140005ccdf0 tzst:0x140005cce00 xz:0x140005cce20 zip:0x140005cce30 zst:0x140005cce28] Getters:map[file:0x1400157ef70 http:0x140009106e0 https:0x14000910730] Dir:false ProgressListener:<nil> Insecure:false DisableSy
mlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404. trying to get the common version
I1028 05:30:58.627640   11909 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.3.0/docker-machine-driver-hyperkit.sha256 -> /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate1351174822/001/docker-machine-driver-hyperkit
--- PASS: TestHyperKitDriverInstallOrUpdate (10.82s)

                                                
                                    
x
+
TestErrorSpam/start (0.41s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 start --dry-run
--- PASS: TestErrorSpam/start (0.41s)

                                                
                                    
x
+
TestErrorSpam/status (0.11s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status: exit status 7 (35.196292ms)

                                                
                                                
-- stdout --
	nospam-784000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status: exit status 7 (35.091708ms)

                                                
                                                
-- stdout --
	nospam-784000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status: exit status 7 (34.659958ms)

                                                
                                                
-- stdout --
	nospam-784000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.11s)

                                                
                                    
x
+
TestErrorSpam/pause (0.14s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause: exit status 83 (44.21025ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause: exit status 83 (44.941459ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause: exit status 83 (45.777667ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 pause" failed: exit status 83
--- PASS: TestErrorSpam/pause (0.14s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.13s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause: exit status 83 (43.57575ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause: exit status 83 (44.063792ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause: exit status 83 (44.792209ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-784000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-784000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 unpause" failed: exit status 83
--- PASS: TestErrorSpam/unpause (0.13s)

                                                
                                    
x
+
TestErrorSpam/stop (9.08s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop: (3.293309458s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop: (2.848985166s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-arm64 -p nospam-784000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-784000 stop: (2.939230375s)
--- PASS: TestErrorSpam/stop (9.08s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1855: local sync path: /Users/jenkins/minikube-integration/19865-11397/.minikube/files/etc/test/nested/copy/11909/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (2.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache add registry.k8s.io/pause:3.1
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache add registry.k8s.io/pause:3.3
functional_test.go:1049: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (0.99s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalserialCacheCmdcacheadd_local432086350/001
functional_test.go:1089: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache add minikube-local-cache-test:functional-382000
functional_test.go:1094: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 cache delete minikube-local-cache-test:functional-382000
functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-382000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (0.99s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1102: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1110: (dbg) Run:  out/minikube-darwin-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1172: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1172: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 config get cpus: exit status 14 (36.372167ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config set cpus 2
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config get cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 config get cpus: exit status 14 (36.387667ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:974: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:974: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-382000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (166.567083ms)

                                                
                                                
-- stdout --
	* [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:22:12.990846   12500 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:22:12.991038   12500 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:12.991042   12500 out.go:358] Setting ErrFile to fd 2...
	I1028 05:22:12.991045   12500 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:12.991199   12500 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:22:12.992496   12500 out.go:352] Setting JSON to false
	I1028 05:22:13.012470   12500 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6703,"bootTime":1730111429,"procs":533,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:22:13.012547   12500 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:22:13.017550   12500 out.go:177] * [functional-382000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	I1028 05:22:13.024456   12500 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:22:13.024481   12500 notify.go:220] Checking for updates...
	I1028 05:22:13.032366   12500 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:22:13.035419   12500 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:22:13.038445   12500 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:22:13.041360   12500 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:22:13.044416   12500 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:22:13.047797   12500 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:22:13.048111   12500 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:22:13.052417   12500 out.go:177] * Using the qemu2 driver based on existing profile
	I1028 05:22:13.059450   12500 start.go:297] selected driver: qemu2
	I1028 05:22:13.059457   12500 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mo
unt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:22:13.059517   12500 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:22:13.065488   12500 out.go:201] 
	W1028 05:22:13.069506   12500 out.go:270] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1028 05:22:13.073230   12500 out.go:201] 

                                                
                                                
** /stderr **
functional_test.go:991: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --dry-run --alsologtostderr -v=1 --driver=qemu2 
--- PASS: TestFunctional/parallel/DryRun (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1020: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-382000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:1020: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-382000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (116.7005ms)

                                                
                                                
-- stdout --
	* [functional-382000] minikube v1.34.0 sur Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote qemu2 basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 05:22:13.230467   12511 out.go:345] Setting OutFile to fd 1 ...
	I1028 05:22:13.230609   12511 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.230613   12511 out.go:358] Setting ErrFile to fd 2...
	I1028 05:22:13.230615   12511 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 05:22:13.230742   12511 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19865-11397/.minikube/bin
	I1028 05:22:13.232137   12511 out.go:352] Setting JSON to false
	I1028 05:22:13.250445   12511 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":6704,"bootTime":1730111429,"procs":533,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1028 05:22:13.250523   12511 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I1028 05:22:13.254456   12511 out.go:177] * [functional-382000] minikube v1.34.0 sur Darwin 15.0.1 (arm64)
	I1028 05:22:13.261457   12511 out.go:177]   - MINIKUBE_LOCATION=19865
	I1028 05:22:13.261534   12511 notify.go:220] Checking for updates...
	I1028 05:22:13.269419   12511 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	I1028 05:22:13.272475   12511 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1028 05:22:13.275415   12511 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 05:22:13.278444   12511 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	I1028 05:22:13.281436   12511 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 05:22:13.284577   12511 config.go:182] Loaded profile config "functional-382000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.2
	I1028 05:22:13.284833   12511 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 05:22:13.289369   12511 out.go:177] * Utilisation du pilote qemu2 basé sur le profil existant
	I1028 05:22:13.295429   12511 start.go:297] selected driver: qemu2
	I1028 05:22:13.295436   12511 start.go:901] validating driver "qemu2" against &{Name:functional-382000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.31.2 ClusterName:functional-382000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mo
unt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 05:22:13.295495   12511 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 05:22:13.302413   12511 out.go:201] 
	W1028 05:22:13.306382   12511 out.go:270] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1028 05:22:13.310380   12511 out.go:201] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1690: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 addons list
functional_test.go:1702: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2288: (dbg) Run:  out/minikube-darwin-arm64 license
--- PASS: TestFunctional/parallel/License (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2256: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.92s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:342: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:342: (dbg) Done: docker pull kicbase/echo-server:1.0: (1.886365416s)
functional_test.go:347: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-382000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.92s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image rm kicbase/echo-server:functional-382000 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Run:  docker rmi kicbase/echo-server:functional-382000
functional_test.go:424: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 image save --daemon kicbase/echo-server:functional-382000 --alsologtostderr
functional_test.go:432: (dbg) Run:  docker image inspect kicbase/echo-server:functional-382000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-darwin-arm64 profile lis
functional_test.go:1275: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: (dbg) Run:  out/minikube-darwin-arm64 profile list
functional_test.go:1315: Took "53.786125ms" to run "out/minikube-darwin-arm64 profile list"
functional_test.go:1324: (dbg) Run:  out/minikube-darwin-arm64 profile list -l
functional_test.go:1329: Took "37.889167ms" to run "out/minikube-darwin-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json
functional_test.go:1366: Took "53.804875ms" to run "out/minikube-darwin-arm64 profile list -o json"
functional_test.go:1374: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json --light
functional_test.go:1379: Took "35.340084ms" to run "out/minikube-darwin-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.012700709s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.04s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-arm64 -p functional-382000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.17s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.07s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-382000
--- PASS: TestFunctional/delete_echo-server_images (0.07s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-382000
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-382000
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (2.09s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 stop -p json-output-060000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-arm64 stop -p json-output-060000 --output=json --user=testUser: (2.08904625s)
--- PASS: TestJSONOutput/stop/Command (2.09s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-error-511000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-error-511000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (102.817625ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"96f05dba-8260-4c6b-af06-214c630c12b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-511000] minikube v1.34.0 on Darwin 15.0.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"fc241af9-2847-4d24-b37b-f7f513aacddf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19865"}}
	{"specversion":"1.0","id":"3db4100a-ca10-4e77-a1dc-d849db6a9a5f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig"}}
	{"specversion":"1.0","id":"3bd39bb8-ccd1-48bd-9860-1980759b2df5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"6e2d1b18-37c9-433c-9d65-ccbdfab7c333","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"aa0bb457-8540-4d80-8996-fa6694ae6fc3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube"}}
	{"specversion":"1.0","id":"72dda3b8-d357-409f-8be0-5e18b41ebbe8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"cba5d2e4-6796-41ff-a780-9221ca40a73d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-511000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p json-output-error-511000
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestMainNoArgs (0.04s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-arm64
--- PASS: TestMainNoArgs (0.04s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.00s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-663000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 : exit status 14 (103.588834ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-663000] minikube v1.34.0 on Darwin 15.0.1 (arm64)
	  - MINIKUBE_LOCATION=19865
	  - KUBECONFIG=/Users/jenkins/minikube-integration/19865-11397/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19865-11397/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.05s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-663000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-663000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (47.632042ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-663000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-663000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.05s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (31.4s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-arm64 profile list
no_kubernetes_test.go:169: (dbg) Done: out/minikube-darwin-arm64 profile list: (15.725564333s)
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 profile list --output=json
no_kubernetes_test.go:179: (dbg) Done: out/minikube-darwin-arm64 profile list --output=json: (15.669026209s)
--- PASS: TestNoKubernetes/serial/ProfileList (31.40s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.34s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-arm64 stop -p NoKubernetes-663000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-arm64 stop -p NoKubernetes-663000: (3.342105375s)
--- PASS: TestNoKubernetes/serial/Stop (3.34s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.05s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-663000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-663000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (44.947708ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-663000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-663000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.05s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.72s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-arm64 logs -p stopped-upgrade-871000
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (0.72s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (1.89s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p old-k8s-version-813000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p old-k8s-version-813000 --alsologtostderr -v=3: (1.885888084s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (1.89s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-813000 -n old-k8s-version-813000: exit status 7 (59.0145ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p old-k8s-version-813000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (3.41s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p no-preload-504000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p no-preload-504000 --alsologtostderr -v=3: (3.404948792s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (3.41s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-504000 -n no-preload-504000: exit status 7 (37.763125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p no-preload-504000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (2.65s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p embed-certs-101000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p embed-certs-101000 --alsologtostderr -v=3: (2.65369225s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (2.65s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-101000 -n embed-certs-101000: exit status 7 (62.504458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p embed-certs-101000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (3.39s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p default-k8s-diff-port-434000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p default-k8s-diff-port-434000 --alsologtostderr -v=3: (3.390653208s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (3.39s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-434000 -n default-k8s-diff-port-434000: exit status 7 (60.596709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p default-k8s-diff-port-434000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p newest-cni-189000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.06s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (3.74s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p newest-cni-189000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-arm64 stop -p newest-cni-189000 --alsologtostderr -v=3: (3.736873667s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (3.74s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-189000 -n newest-cni-189000: exit status 7 (64.818375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p newest-cni-189000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (22/258)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1787: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:550: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (13.66s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port2175560842/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1730118097961955000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port2175560842/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1730118097961955000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port2175560842/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1730118097961955000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port2175560842/001/test-1730118097961955000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (62.2265ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:38.024723   11909 retry.go:31] will retry after 616.422974ms: exit status 83
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (91.777208ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:38.735413   11909 retry.go:31] will retry after 568.69428ms: exit status 83
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (92.00825ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:39.398760   11909 retry.go:31] will retry after 1.369439094s: exit status 83
I1028 05:21:39.793877   11909 retry.go:31] will retry after 7.6706753s: Temporary Error: Get "http:": http: no Host in request URL
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (90.678917ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:40.861263   11909 retry.go:31] will retry after 2.437570265s: exit status 83
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (89.570375ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:43.390716   11909 retry.go:31] will retry after 3.424494305s: exit status 83
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (91.340334ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:46.909179   11909 retry.go:31] will retry after 4.443919386s: exit status 83
I1028 05:21:47.467077   11909 retry.go:31] will retry after 5.734059548s: Temporary Error: Get "http:": http: no Host in request URL
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (92.136708ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo umount -f /mount-9p": exit status 83 (50.778958ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port2175560842/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (13.66s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (10.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port1505825298/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (67.459625ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:51.687450   11909 retry.go:31] will retry after 723.26833ms: exit status 83
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (92.929334ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:52.505976   11909 retry.go:31] will retry after 451.512181ms: exit status 83
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (90.9045ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:53.051315   11909 retry.go:31] will retry after 769.865192ms: exit status 83
I1028 05:21:53.203377   11909 retry.go:31] will retry after 17.625361632s: Temporary Error: Get "http:": http: no Host in request URL
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (94.055709ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:53.917577   11909 retry.go:31] will retry after 1.934150851s: exit status 83
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (93.345041ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:55.947519   11909 retry.go:31] will retry after 1.421068418s: exit status 83
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (92.207667ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:21:57.463222   11909 retry.go:31] will retry after 4.318099332s: exit status 83
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (93.094167ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "sudo umount -f /mount-9p": exit status 83 (48.734917ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-arm64 -p functional-382000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port1505825298/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (10.43s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (10.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (88.611667ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:02.138630   11909 retry.go:31] will retry after 310.649525ms: exit status 83
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (90.470833ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:02.542234   11909 retry.go:31] will retry after 1.066859247s: exit status 83
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (96.218083ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:03.707787   11909 retry.go:31] will retry after 1.592589728s: exit status 83
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (91.875917ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:05.394706   11909 retry.go:31] will retry after 1.564475181s: exit status 83
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (91.680291ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:07.053262   11909 retry.go:31] will retry after 2.641824979s: exit status 83
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (89.067666ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
I1028 05:22:09.786432   11909 retry.go:31] will retry after 2.65130009s: exit status 83
I1028 05:22:10.830730   11909 retry.go:31] will retry after 19.278084021s: Temporary Error: Get "http:": http: no Host in request URL
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-382000 ssh "findmnt -T" /mount1: exit status 83 (88.707834ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-382000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-382000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-382000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1066620618/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (10.87s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (2.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:629: 
----------------------- debugLogs start: cilium-615000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-615000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-615000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-615000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-615000"

                                                
                                                
----------------------- debugLogs end: cilium-615000 [took: 2.376258375s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-615000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cilium-615000
--- SKIP: TestNetworkPlugins/group/cilium (2.50s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-371000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p disable-driver-mounts-371000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.12s)

                                                
                                    
Copied to clipboard