Test Report: QEMU_macOS 17658

                    
                      a85213167140187d07015e09808128c343e69408:2023-11-22:31986
                    
                

Test fail (92/254)

Order failed test Duration
3 TestDownloadOnly/v1.16.0/json-events 18.51
7 TestDownloadOnly/v1.16.0/kubectl 0
20 TestOffline 10.21
28 TestAddons/parallel/Ingress 33.36
42 TestCertOptions 10.21
43 TestCertExpiration 195.49
44 TestDockerFlags 10.24
45 TestForceSystemdFlag 11.86
46 TestForceSystemdEnv 9.93
91 TestFunctional/parallel/ServiceCmdConnect 29.98
156 TestImageBuild/serial/Setup 9.8
158 TestIngressAddonLegacy/StartLegacyK8sCluster 19.24
160 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 0.12
162 TestIngressAddonLegacy/serial/ValidateIngressAddons 0.03
165 TestJSONOutput/start/Command 9.84
171 TestJSONOutput/pause/Command 0.08
177 TestJSONOutput/unpause/Command 0.05
194 TestMinikubeProfile 10.16
197 TestMountStart/serial/StartWithMountFirst 9.95
200 TestMultiNode/serial/FreshStart2Nodes 9.87
201 TestMultiNode/serial/DeployApp2Nodes 91.41
202 TestMultiNode/serial/PingHostFrom2Pods 0.09
203 TestMultiNode/serial/AddNode 0.08
204 TestMultiNode/serial/ProfileList 0.1
205 TestMultiNode/serial/CopyFile 0.06
206 TestMultiNode/serial/StopNode 0.14
207 TestMultiNode/serial/StartAfterStop 0.11
208 TestMultiNode/serial/RestartKeepsNodes 5.39
209 TestMultiNode/serial/DeleteNode 0.1
210 TestMultiNode/serial/StopMultiNode 0.16
211 TestMultiNode/serial/RestartMultiNode 5.26
212 TestMultiNode/serial/ValidateNameConflict 20.18
216 TestPreload 9.95
218 TestScheduledStopUnix 9.98
219 TestSkaffold 12.98
222 TestRunningBinaryUpgrade 121.75
224 TestKubernetesUpgrade 15.37
237 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 1.45
238 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 1.22
239 TestStoppedBinaryUpgrade/Setup 150.46
241 TestPause/serial/Start 9.82
251 TestNoKubernetes/serial/StartWithK8s 9.93
252 TestNoKubernetes/serial/StartWithStopK8s 5.33
253 TestNoKubernetes/serial/Start 5.31
257 TestNoKubernetes/serial/StartNoArgs 5.32
259 TestNetworkPlugins/group/auto/Start 9.94
260 TestNetworkPlugins/group/flannel/Start 9.89
261 TestNetworkPlugins/group/enable-default-cni/Start 9.81
262 TestNetworkPlugins/group/kindnet/Start 9.94
263 TestNetworkPlugins/group/bridge/Start 9.9
264 TestNetworkPlugins/group/kubenet/Start 10.04
265 TestStoppedBinaryUpgrade/Upgrade 1.64
266 TestStoppedBinaryUpgrade/MinikubeLogs 0.1
267 TestNetworkPlugins/group/custom-flannel/Start 9.77
268 TestNetworkPlugins/group/calico/Start 12.21
269 TestNetworkPlugins/group/false/Start 9.84
271 TestStartStop/group/old-k8s-version/serial/FirstStart 9.91
272 TestStartStop/group/old-k8s-version/serial/DeployApp 0.1
274 TestStartStop/group/no-preload/serial/FirstStart 9.94
275 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.15
278 TestStartStop/group/old-k8s-version/serial/SecondStart 7.2
279 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.04
280 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.07
281 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.09
282 TestStartStop/group/old-k8s-version/serial/Pause 0.1
284 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 11.41
285 TestStartStop/group/no-preload/serial/DeployApp 0.1
286 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.12
289 TestStartStop/group/no-preload/serial/SecondStart 6.94
290 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.04
291 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.07
292 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.08
293 TestStartStop/group/no-preload/serial/Pause 0.11
295 TestStartStop/group/newest-cni/serial/FirstStart 11.61
296 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.1
297 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.12
300 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 6.96
301 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.04
302 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.07
303 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.08
304 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.11
306 TestStartStop/group/embed-certs/serial/FirstStart 11.68
311 TestStartStop/group/newest-cni/serial/SecondStart 7.21
314 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.1
315 TestStartStop/group/newest-cni/serial/Pause 0.13
316 TestStartStop/group/embed-certs/serial/DeployApp 0.09
317 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.12
320 TestStartStop/group/embed-certs/serial/SecondStart 5.26
321 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.03
322 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.06
323 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.08
324 TestStartStop/group/embed-certs/serial/Pause 0.11
x
+
TestDownloadOnly/v1.16.0/json-events (18.51s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-183000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-183000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 : exit status 40 (18.503719583s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"cbb15662-ba6d-4af7-8bfe-5e13f274e553","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-183000] minikube v1.32.0 on Darwin 14.1.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"8b2c798a-0c61-46c0-b7ae-2dd5c1e3c201","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17658"}}
	{"specversion":"1.0","id":"d7947fd9-7ccd-4fde-a23a-5b75462824da","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig"}}
	{"specversion":"1.0","id":"e2fcdb78-570d-4856-8808-ac275fc37dcb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"c40363bc-97df-41e0-90ba-9f575a188acd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"de1f0ef3-055b-4bd9-889e-00d1591d25a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube"}}
	{"specversion":"1.0","id":"26f9876c-141b-490b-99ed-2b83197d79f2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}
	{"specversion":"1.0","id":"6237349a-83bd-44d0-8214-5f115332c125","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"d821c223-61ed-44a1-8d35-7eb033d9e7fc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"0dcb4273-21ed-452c-9bc5-43b83c8245b4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"a48e4be0-7772-4241-9641-281958174b22","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node download-only-183000 in cluster download-only-183000","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"862a5418-0193-40f7-9241-cd328f6e2de0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.16.0 preload ...","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"32c103d7-2459-4381-bba1-782b9b4cd383","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80] Decompressors:map[bz2:0x14000918ea0 gz:0x14000918ea8 tar:0x14000918e50 tar.bz2:0x14000918e60 tar.gz:0x14000918e70 tar.xz:0x14000918e80 tar.zst:0x14000918e90 tbz2:0x14000918e60 tgz:0x1400091
8e70 txz:0x14000918e80 tzst:0x14000918e90 xz:0x14000918ed0 zip:0x14000918ee0 zst:0x14000918ed8] Getters:map[file:0x1400080c8a0 http:0x1400017e550 https:0x1400017e5a0] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}
	{"specversion":"1.0","id":"7eadf921-107a-415d-8df2-073fa0b46409","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:35:51.424526    1440 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:35:51.424722    1440 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:35:51.424726    1440 out.go:309] Setting ErrFile to fd 2...
	I1122 10:35:51.424728    1440 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:35:51.424864    1440 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	W1122 10:35:51.424949    1440 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: no such file or directory
	I1122 10:35:51.426147    1440 out.go:303] Setting JSON to true
	I1122 10:35:51.443060    1440 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":321,"bootTime":1700677830,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:35:51.443136    1440 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:35:51.452134    1440 out.go:97] [download-only-183000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:35:51.456049    1440 out.go:169] MINIKUBE_LOCATION=17658
	I1122 10:35:51.452276    1440 notify.go:220] Checking for updates...
	W1122 10:35:51.452320    1440 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball: no such file or directory
	I1122 10:35:51.466054    1440 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:35:51.470120    1440 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:35:51.474074    1440 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:35:51.478066    1440 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	W1122 10:35:51.484064    1440 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1122 10:35:51.484292    1440 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:35:51.489968    1440 out.go:97] Using the qemu2 driver based on user configuration
	I1122 10:35:51.489977    1440 start.go:298] selected driver: qemu2
	I1122 10:35:51.489980    1440 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:35:51.490064    1440 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:35:51.494022    1440 out.go:169] Automatically selected the socket_vmnet network
	I1122 10:35:51.500936    1440 start_flags.go:394] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I1122 10:35:51.501020    1440 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1122 10:35:51.501128    1440 cni.go:84] Creating CNI manager for ""
	I1122 10:35:51.501145    1440 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:35:51.501152    1440 start_flags.go:323] config:
	{Name:download-only-183000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-183000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:35:51.506782    1440 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:35:51.511014    1440 out.go:97] Downloading VM boot image ...
	I1122 10:35:51.511032    1440 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso
	I1122 10:35:59.315555    1440 out.go:97] Starting control plane node download-only-183000 in cluster download-only-183000
	I1122 10:35:59.315573    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:35:59.373387    1440 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:35:59.373396    1440 cache.go:56] Caching tarball of preloaded images
	I1122 10:35:59.373532    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:35:59.378680    1440 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I1122 10:35:59.378687    1440 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:35:59.454201    1440 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:36:08.360678    1440 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:08.360822    1440 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:09.001849    1440 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1122 10:36:09.002049    1440 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/download-only-183000/config.json ...
	I1122 10:36:09.002065    1440 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/download-only-183000/config.json: {Name:mk51ce9bef7aa2af158da6d000f5447dbbce4d81 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:36:09.002275    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:36:09.002439    1440 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl
	I1122 10:36:09.860132    1440 out.go:169] 
	W1122 10:36:09.864257    1440 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80] Decompressors:map[bz2:0x14000918ea0 gz:0x14000918ea8 tar:0x14000918e50 tar.bz2:0x14000918e60 tar.gz:0x14000918e70 tar.xz:0x14000918e80 tar.zst:0x14000918e90 tbz2:0x14000918e60 tgz:0x14000918e70 txz:0x14000918e80 tzst:0x14000918e90 xz:0x14000918ed0 zip:0x14000918ee0 zst:0x14000918ed8] Getters:map[file:0x1400080c8a0 http:0x1400017e550 https:0x1400017e5a0] Dir:false ProgressListener:
<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W1122 10:36:09.864284    1440 out_reason.go:110] 
	W1122 10:36:09.872211    1440 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:36:09.876209    1440 out.go:169] 

                                                
                                                
** /stderr **
aaa_download_only_test.go:71: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-183000" "--force" "--alsologtostderr" "--kubernetes-version=v1.16.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40
--- FAIL: TestDownloadOnly/v1.16.0/json-events (18.51s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:163: expected the file for binary exist at "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl" but got error stat /Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl: no such file or directory
--- FAIL: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestOffline (10.21s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-904000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-904000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (10.066955917s)

                                                
                                                
-- stdout --
	* [offline-docker-904000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node offline-docker-904000 in cluster offline-docker-904000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "offline-docker-904000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:48:39.843604    2811 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:48:39.843779    2811 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:39.843783    2811 out.go:309] Setting ErrFile to fd 2...
	I1122 10:48:39.843785    2811 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:39.843910    2811 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:48:39.845068    2811 out.go:303] Setting JSON to false
	I1122 10:48:39.862905    2811 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1089,"bootTime":1700677830,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:48:39.862979    2811 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:48:39.867043    2811 out.go:177] * [offline-docker-904000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:48:39.874063    2811 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:48:39.877982    2811 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:48:39.874073    2811 notify.go:220] Checking for updates...
	I1122 10:48:39.883062    2811 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:48:39.885987    2811 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:48:39.889057    2811 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:48:39.892032    2811 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:48:39.895346    2811 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:48:39.895415    2811 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:48:39.898986    2811 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:48:39.905933    2811 start.go:298] selected driver: qemu2
	I1122 10:48:39.905940    2811 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:48:39.905946    2811 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:48:39.908013    2811 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:48:39.910987    2811 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:48:39.915083    2811 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:48:39.915109    2811 cni.go:84] Creating CNI manager for ""
	I1122 10:48:39.915116    2811 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:48:39.915119    2811 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:48:39.915125    2811 start_flags.go:323] config:
	{Name:offline-docker-904000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-904000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthS
ock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:48:39.919656    2811 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:39.926982    2811 out.go:177] * Starting control plane node offline-docker-904000 in cluster offline-docker-904000
	I1122 10:48:39.930878    2811 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:48:39.930911    2811 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:48:39.930922    2811 cache.go:56] Caching tarball of preloaded images
	I1122 10:48:39.931004    2811 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:48:39.931011    2811 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:48:39.931081    2811 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/offline-docker-904000/config.json ...
	I1122 10:48:39.931091    2811 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/offline-docker-904000/config.json: {Name:mk75f9f2e51da9d4b77a05b8099eacd48ad69f3c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:48:39.931310    2811 start.go:365] acquiring machines lock for offline-docker-904000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:39.931339    2811 start.go:369] acquired machines lock for "offline-docker-904000" in 22.541µs
	I1122 10:48:39.931350    2811 start.go:93] Provisioning new machine with config: &{Name:offline-docker-904000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-904000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:39.931389    2811 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:39.937021    2811 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:48:39.952519    2811 start.go:159] libmachine.API.Create for "offline-docker-904000" (driver="qemu2")
	I1122 10:48:39.952556    2811 client.go:168] LocalClient.Create starting
	I1122 10:48:39.952621    2811 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:39.952655    2811 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:39.952665    2811 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:39.952716    2811 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:39.952737    2811 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:39.952745    2811 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:39.953120    2811 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:40.077818    2811 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:40.390284    2811 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:40.390296    2811 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:40.390594    2811 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:40.403394    2811 main.go:141] libmachine: STDOUT: 
	I1122 10:48:40.403424    2811 main.go:141] libmachine: STDERR: 
	I1122 10:48:40.403500    2811 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2 +20000M
	I1122 10:48:40.415138    2811 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:40.415162    2811 main.go:141] libmachine: STDERR: 
	I1122 10:48:40.415208    2811 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:40.415213    2811 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:40.415262    2811 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:6d:ba:a5:f5:ca -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:40.417284    2811 main.go:141] libmachine: STDOUT: 
	I1122 10:48:40.417304    2811 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:40.417325    2811 client.go:171] LocalClient.Create took 464.771166ms
	I1122 10:48:42.419390    2811 start.go:128] duration metric: createHost completed in 2.488038125s
	I1122 10:48:42.419408    2811 start.go:83] releasing machines lock for "offline-docker-904000", held for 2.488108125s
	W1122 10:48:42.419424    2811 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:42.427988    2811 out.go:177] * Deleting "offline-docker-904000" in qemu2 ...
	W1122 10:48:42.436498    2811 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:42.436507    2811 start.go:706] Will try again in 5 seconds ...
	I1122 10:48:47.438653    2811 start.go:365] acquiring machines lock for offline-docker-904000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:47.439145    2811 start.go:369] acquired machines lock for "offline-docker-904000" in 401.041µs
	I1122 10:48:47.439301    2811 start.go:93] Provisioning new machine with config: &{Name:offline-docker-904000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-904000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:47.439601    2811 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:47.451246    2811 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:48:47.501375    2811 start.go:159] libmachine.API.Create for "offline-docker-904000" (driver="qemu2")
	I1122 10:48:47.501421    2811 client.go:168] LocalClient.Create starting
	I1122 10:48:47.501612    2811 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:47.501699    2811 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:47.501721    2811 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:47.501799    2811 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:47.501850    2811 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:47.501866    2811 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:47.502567    2811 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:47.641278    2811 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:47.815186    2811 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:47.815194    2811 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:47.815378    2811 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:47.827705    2811 main.go:141] libmachine: STDOUT: 
	I1122 10:48:47.827733    2811 main.go:141] libmachine: STDERR: 
	I1122 10:48:47.827798    2811 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2 +20000M
	I1122 10:48:47.838201    2811 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:47.838225    2811 main.go:141] libmachine: STDERR: 
	I1122 10:48:47.838239    2811 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:47.838243    2811 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:47.838294    2811 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:0a:1a:01:34:e7 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/offline-docker-904000/disk.qcow2
	I1122 10:48:47.840024    2811 main.go:141] libmachine: STDOUT: 
	I1122 10:48:47.840049    2811 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:47.840064    2811 client.go:171] LocalClient.Create took 338.642625ms
	I1122 10:48:49.842129    2811 start.go:128] duration metric: createHost completed in 2.402549042s
	I1122 10:48:49.842149    2811 start.go:83] releasing machines lock for "offline-docker-904000", held for 2.403003375s
	W1122 10:48:49.842277    2811 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-904000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-904000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:49.850525    2811 out.go:177] 
	W1122 10:48:49.854546    2811 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:48:49.854551    2811 out.go:239] * 
	* 
	W1122 10:48:49.855039    2811 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:48:49.867529    2811 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-904000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80
panic.go:523: *** TestOffline FAILED at 2023-11-22 10:48:49.877318 -0800 PST m=+778.683996126
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-904000 -n offline-docker-904000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-904000 -n offline-docker-904000: exit status 7 (36.29575ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-904000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-904000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-904000
--- FAIL: TestOffline (10.21s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (33.36s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:206: (dbg) Run:  kubectl --context addons-024000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:231: (dbg) Run:  kubectl --context addons-024000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:244: (dbg) Run:  kubectl --context addons-024000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [9e23fb7a-5833-418a-a634-722cd694a06f] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [9e23fb7a-5833-418a-a634-722cd694a06f] Running
addons_test.go:249: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.008169042s
addons_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:285: (dbg) Run:  kubectl --context addons-024000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 ip
addons_test.go:296: (dbg) Run:  nslookup hello-john.test 192.168.105.2
addons_test.go:296: (dbg) Non-zero exit: nslookup hello-john.test 192.168.105.2: exit status 1 (15.030375833s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	

                                                
                                                
-- /stdout --
addons_test.go:298: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.105.2" : exit status 1
addons_test.go:302: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:305: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:310: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable ingress --alsologtostderr -v=1
addons_test.go:310: (dbg) Done: out/minikube-darwin-arm64 -p addons-024000 addons disable ingress --alsologtostderr -v=1: (7.201753667s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-024000 -n addons-024000
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 logs -n 25
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only                                                                     | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:35 PST |                     |
	|         | -p download-only-183000                                                                     |                      |         |         |                     |                     |
	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0                                                                |                      |         |         |                     |                     |
	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |
	| start   | -o=json --download-only                                                                     | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST |                     |
	|         | -p download-only-183000                                                                     |                      |         |         |                     |                     |
	|         | --force --alsologtostderr                                                                   |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4                                                                |                      |         |         |                     |                     |
	|         | --container-runtime=docker                                                                  |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |
	| delete  | --all                                                                                       | minikube             | jenkins | v1.32.0 | 22 Nov 23 10:36 PST | 22 Nov 23 10:36 PST |
	| delete  | -p download-only-183000                                                                     | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST | 22 Nov 23 10:36 PST |
	| delete  | -p download-only-183000                                                                     | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST | 22 Nov 23 10:36 PST |
	| start   | --download-only -p                                                                          | binary-mirror-708000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST |                     |
	|         | binary-mirror-708000                                                                        |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
	|         | http://127.0.0.1:49313                                                                      |                      |         |         |                     |                     |
	|         | --driver=qemu2                                                                              |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-708000                                                                     | binary-mirror-708000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST | 22 Nov 23 10:36 PST |
	| addons  | disable dashboard -p                                                                        | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:36 PST |                     |
	|         | addons-024000                                                                               |                      |         |         |                     |                     |
	| addons  | enable dashboard -p                                                                         | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:36 PST |                     |
	|         | addons-024000                                                                               |                      |         |         |                     |                     |
	| start   | -p addons-024000 --wait=true                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:36 PST | 22 Nov 23 10:38 PST |
	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
	|         | --addons=registry                                                                           |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
	|         | --driver=qemu2  --addons=ingress                                                            |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
	| ip      | addons-024000 ip                                                                            | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	| addons  | addons-024000 addons disable                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | -p addons-024000                                                                            |                      |         |         |                     |                     |
	| ssh     | addons-024000 ssh cat                                                                       | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | /opt/local-path-provisioner/pvc-ab0c1180-d1bc-4ef7-abe0-4bb5895a3607_default_test-pvc/file1 |                      |         |         |                     |                     |
	| addons  | addons-024000 addons disable                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-024000 addons                                                                        | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-024000 addons                                                                        | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | addons-024000                                                                               |                      |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:39 PST | 22 Nov 23 10:39 PST |
	|         | -p addons-024000                                                                            |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-024000 addons                                                                        | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	|         | addons-024000                                                                               |                      |         |         |                     |                     |
	| ssh     | addons-024000 ssh curl -s                                                                   | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
	| ip      | addons-024000 ip                                                                            | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	| addons  | addons-024000 addons disable                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-024000 addons disable                                                                | addons-024000        | jenkins | v1.32.0 | 22 Nov 23 10:40 PST | 22 Nov 23 10:40 PST |
	|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/22 10:36:52
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.21.4 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1122 10:36:52.934936    1546 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:36:52.935089    1546 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:36:52.935092    1546 out.go:309] Setting ErrFile to fd 2...
	I1122 10:36:52.935095    1546 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:36:52.935228    1546 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:36:52.936364    1546 out.go:303] Setting JSON to false
	I1122 10:36:52.952296    1546 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":382,"bootTime":1700677830,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:36:52.952386    1546 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:36:52.957447    1546 out.go:177] * [addons-024000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:36:52.960481    1546 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:36:52.963487    1546 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:36:52.960566    1546 notify.go:220] Checking for updates...
	I1122 10:36:52.967454    1546 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:36:52.970510    1546 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:36:52.973445    1546 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:36:52.976422    1546 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:36:52.979630    1546 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:36:52.983497    1546 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:36:52.990452    1546 start.go:298] selected driver: qemu2
	I1122 10:36:52.990459    1546 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:36:52.990467    1546 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:36:52.992758    1546 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:36:52.995417    1546 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:36:52.996941    1546 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:36:52.996974    1546 cni.go:84] Creating CNI manager for ""
	I1122 10:36:52.996980    1546 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:36:52.996984    1546 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:36:52.996993    1546 start_flags.go:323] config:
	{Name:addons-024000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-024000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR
ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID
:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:36:53.001272    1546 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:36:53.009440    1546 out.go:177] * Starting control plane node addons-024000 in cluster addons-024000
	I1122 10:36:53.013392    1546 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:36:53.013405    1546 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:36:53.013411    1546 cache.go:56] Caching tarball of preloaded images
	I1122 10:36:53.013474    1546 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:36:53.013479    1546 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:36:53.013668    1546 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/config.json ...
	I1122 10:36:53.013679    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/config.json: {Name:mk9261f6dbc7c0841795338b4cf42696735888b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:36:53.013889    1546 start.go:365] acquiring machines lock for addons-024000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:36:53.014092    1546 start.go:369] acquired machines lock for "addons-024000" in 197.292µs
	I1122 10:36:53.014101    1546 start.go:93] Provisioning new machine with config: &{Name:addons-024000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:addons-024000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:36:53.014135    1546 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:36:53.022387    1546 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	I1122 10:36:53.246001    1546 start.go:159] libmachine.API.Create for "addons-024000" (driver="qemu2")
	I1122 10:36:53.246054    1546 client.go:168] LocalClient.Create starting
	I1122 10:36:53.246218    1546 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:36:53.401332    1546 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:36:53.491303    1546 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:36:53.754922    1546 main.go:141] libmachine: Creating SSH key...
	I1122 10:36:53.834809    1546 main.go:141] libmachine: Creating Disk image...
	I1122 10:36:53.834814    1546 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:36:53.835042    1546 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2
	I1122 10:36:53.899849    1546 main.go:141] libmachine: STDOUT: 
	I1122 10:36:53.899884    1546 main.go:141] libmachine: STDERR: 
	I1122 10:36:53.899944    1546 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2 +20000M
	I1122 10:36:53.910615    1546 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:36:53.910631    1546 main.go:141] libmachine: STDERR: 
	I1122 10:36:53.910649    1546 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2
	I1122 10:36:53.910654    1546 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:36:53.910691    1546 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:2c:86:2f:1d:19 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/disk.qcow2
	I1122 10:36:54.039040    1546 main.go:141] libmachine: STDOUT: 
	I1122 10:36:54.039084    1546 main.go:141] libmachine: STDERR: 
	I1122 10:36:54.039089    1546 main.go:141] libmachine: Attempt 0
	I1122 10:36:54.039105    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:36:54.039155    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:36:54.039175    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:36:56.041312    1546 main.go:141] libmachine: Attempt 1
	I1122 10:36:56.041395    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:36:56.041632    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:36:56.041724    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:36:58.044092    1546 main.go:141] libmachine: Attempt 2
	I1122 10:36:58.044250    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:36:58.044474    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:36:58.044536    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:37:00.046550    1546 main.go:141] libmachine: Attempt 3
	I1122 10:37:00.046577    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:37:00.046640    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:37:00.046671    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:37:02.048739    1546 main.go:141] libmachine: Attempt 4
	I1122 10:37:02.048752    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:37:02.048802    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:37:02.048813    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:37:04.050844    1546 main.go:141] libmachine: Attempt 5
	I1122 10:37:04.050857    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:37:04.050895    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:37:04.050903    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:37:06.052068    1546 main.go:141] libmachine: Attempt 6
	I1122 10:37:06.052091    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:37:06.052154    1546 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!
	I1122 10:37:06.052166    1546 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x655f9b76}
	I1122 10:37:08.054208    1546 main.go:141] libmachine: Attempt 7
	I1122 10:37:08.054228    1546 main.go:141] libmachine: Searching for fa:2c:86:2f:1d:19 in /var/db/dhcpd_leases ...
	I1122 10:37:08.054334    1546 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!
	I1122 10:37:08.054347    1546 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:2c:86:2f:1d:19 ID:1,fa:2c:86:2f:1d:19 Lease:0x655f9bd2}
	I1122 10:37:08.054353    1546 main.go:141] libmachine: Found match: fa:2c:86:2f:1d:19
	I1122 10:37:08.054364    1546 main.go:141] libmachine: IP: 192.168.105.2
	I1122 10:37:08.054369    1546 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...
	I1122 10:37:10.072671    1546 machine.go:88] provisioning docker machine ...
	I1122 10:37:10.072738    1546 buildroot.go:166] provisioning hostname "addons-024000"
	I1122 10:37:10.074308    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.074987    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.075010    1546 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-024000 && echo "addons-024000" | sudo tee /etc/hostname
	I1122 10:37:10.155697    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-024000
	
	I1122 10:37:10.155805    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.156242    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.156256    1546 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-024000' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-024000/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-024000' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1122 10:37:10.218898    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1122 10:37:10.218915    1546 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17658-941/.minikube CaCertPath:/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17658-941/.minikube}
	I1122 10:37:10.218928    1546 buildroot.go:174] setting up certificates
	I1122 10:37:10.218935    1546 provision.go:83] configureAuth start
	I1122 10:37:10.218940    1546 provision.go:138] copyHostCerts
	I1122 10:37:10.219044    1546 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17658-941/.minikube/ca.pem (1078 bytes)
	I1122 10:37:10.219336    1546 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17658-941/.minikube/cert.pem (1123 bytes)
	I1122 10:37:10.219489    1546 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17658-941/.minikube/key.pem (1675 bytes)
	I1122 10:37:10.219596    1546 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17658-941/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca-key.pem org=jenkins.addons-024000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-024000]
	I1122 10:37:10.305031    1546 provision.go:172] copyRemoteCerts
	I1122 10:37:10.305078    1546 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1122 10:37:10.305100    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:10.332921    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I1122 10:37:10.340245    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I1122 10:37:10.347259    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I1122 10:37:10.353753    1546 provision.go:86] duration metric: configureAuth took 134.811792ms
	I1122 10:37:10.353761    1546 buildroot.go:189] setting minikube options for container-runtime
	I1122 10:37:10.353847    1546 config.go:182] Loaded profile config "addons-024000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:37:10.353878    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.354088    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.354096    1546 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I1122 10:37:10.407211    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
	
	I1122 10:37:10.407231    1546 buildroot.go:70] root file system type: tmpfs
	I1122 10:37:10.407297    1546 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I1122 10:37:10.407343    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.407577    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.407609    1546 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I1122 10:37:10.462727    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	After=network.target  minikube-automount.service docker.socket
	Requires= minikube-automount.service docker.socket 
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I1122 10:37:10.462770    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.462986    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.462997    1546 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I1122 10:37:10.774396    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
	
	I1122 10:37:10.774409    1546 machine.go:91] provisioned docker machine in 701.715625ms
	I1122 10:37:10.774415    1546 client.go:171] LocalClient.Create took 17.528483208s
	I1122 10:37:10.774426    1546 start.go:167] duration metric: libmachine.API.Create for "addons-024000" took 17.528557917s
	I1122 10:37:10.774430    1546 start.go:300] post-start starting for "addons-024000" (driver="qemu2")
	I1122 10:37:10.774435    1546 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1122 10:37:10.774495    1546 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1122 10:37:10.774505    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:10.804224    1546 ssh_runner.go:195] Run: cat /etc/os-release
	I1122 10:37:10.805468    1546 info.go:137] Remote host: Buildroot 2021.02.12
	I1122 10:37:10.805479    1546 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17658-941/.minikube/addons for local assets ...
	I1122 10:37:10.805562    1546 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17658-941/.minikube/files for local assets ...
	I1122 10:37:10.805591    1546 start.go:303] post-start completed in 31.158125ms
	I1122 10:37:10.805932    1546 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/config.json ...
	I1122 10:37:10.806109    1546 start.go:128] duration metric: createHost completed in 17.792098667s
	I1122 10:37:10.806129    1546 main.go:141] libmachine: Using SSH client type: native
	I1122 10:37:10.806340    1546 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100646260] 0x1006489d0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}
	I1122 10:37:10.806344    1546 main.go:141] libmachine: About to run SSH command:
	date +%!s(MISSING).%!N(MISSING)
	I1122 10:37:10.854514    1546 main.go:141] libmachine: SSH cmd err, output: <nil>: 1700678230.494622752
	
	I1122 10:37:10.854521    1546 fix.go:206] guest clock: 1700678230.494622752
	I1122 10:37:10.854524    1546 fix.go:219] Guest: 2023-11-22 10:37:10.494622752 -0800 PST Remote: 2023-11-22 10:37:10.806111 -0800 PST m=+17.893065917 (delta=-311.488248ms)
	I1122 10:37:10.854534    1546 fix.go:190] guest clock delta is within tolerance: -311.488248ms
	I1122 10:37:10.854536    1546 start.go:83] releasing machines lock for "addons-024000", held for 17.840569291s
	I1122 10:37:10.854809    1546 ssh_runner.go:195] Run: cat /version.json
	I1122 10:37:10.854822    1546 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1122 10:37:10.854822    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:10.854867    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:10.881226    1546 ssh_runner.go:195] Run: systemctl --version
	I1122 10:37:10.969114    1546 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	W1122 10:37:10.971574    1546 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
	I1122 10:37:10.971612    1546 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I1122 10:37:10.977715    1546 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I1122 10:37:10.977724    1546 start.go:472] detecting cgroup driver to use...
	I1122 10:37:10.977849    1546 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1122 10:37:10.984578    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I1122 10:37:10.988181    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1122 10:37:10.991378    1546 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1122 10:37:10.991402    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1122 10:37:10.994419    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1122 10:37:10.997564    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1122 10:37:11.000953    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1122 10:37:11.004263    1546 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1122 10:37:11.007166    1546 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1122 10:37:11.010072    1546 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1122 10:37:11.013327    1546 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1122 10:37:11.016677    1546 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1122 10:37:11.079519    1546 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1122 10:37:11.085367    1546 start.go:472] detecting cgroup driver to use...
	I1122 10:37:11.085407    1546 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I1122 10:37:11.092794    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1122 10:37:11.097622    1546 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I1122 10:37:11.103576    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I1122 10:37:11.108196    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1122 10:37:11.112671    1546 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I1122 10:37:11.144997    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1122 10:37:11.149732    1546 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1122 10:37:11.155087    1546 ssh_runner.go:195] Run: which cri-dockerd
	I1122 10:37:11.156324    1546 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I1122 10:37:11.158854    1546 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I1122 10:37:11.163886    1546 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I1122 10:37:11.226994    1546 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I1122 10:37:11.286355    1546 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
	I1122 10:37:11.286417    1546 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
	I1122 10:37:11.291823    1546 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1122 10:37:11.350709    1546 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1122 10:37:12.515276    1546 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.16456s)
	I1122 10:37:12.515330    1546 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1122 10:37:12.575113    1546 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I1122 10:37:12.642875    1546 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I1122 10:37:12.710049    1546 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1122 10:37:12.775472    1546 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I1122 10:37:12.782325    1546 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1122 10:37:12.855262    1546 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I1122 10:37:12.879283    1546 start.go:519] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I1122 10:37:12.879369    1546 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I1122 10:37:12.881524    1546 start.go:540] Will wait 60s for crictl version
	I1122 10:37:12.881558    1546 ssh_runner.go:195] Run: which crictl
	I1122 10:37:12.883095    1546 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1122 10:37:12.903965    1546 start.go:556] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.7
	RuntimeApiVersion:  v1
	I1122 10:37:12.904026    1546 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1122 10:37:12.913907    1546 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I1122 10:37:12.930148    1546 out.go:204] * Preparing Kubernetes v1.28.4 on Docker 24.0.7 ...
	I1122 10:37:12.930208    1546 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts
	I1122 10:37:12.931841    1546 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1122 10:37:12.935615    1546 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:37:12.940334    1546 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1122 10:37:12.948823    1546 docker.go:671] Got preloaded images: 
	I1122 10:37:12.948830    1546 docker.go:677] registry.k8s.io/kube-apiserver:v1.28.4 wasn't preloaded
	I1122 10:37:12.948863    1546 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1122 10:37:12.952352    1546 ssh_runner.go:195] Run: which lz4
	I1122 10:37:12.953786    1546 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I1122 10:37:12.955215    1546 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I1122 10:37:12.955227    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (357941720 bytes)
	I1122 10:37:14.270006    1546 docker.go:635] Took 1.316240 seconds to copy over tarball
	I1122 10:37:14.270062    1546 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I1122 10:37:15.342571    1546 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.072503791s)
	I1122 10:37:15.342593    1546 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I1122 10:37:15.358065    1546 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I1122 10:37:15.361585    1546 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)
	I1122 10:37:15.366852    1546 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1122 10:37:15.430898    1546 ssh_runner.go:195] Run: sudo systemctl restart docker
	I1122 10:37:18.073161    1546 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.642265375s)
	I1122 10:37:18.073249    1546 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I1122 10:37:18.085596    1546 docker.go:671] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.28.4
	registry.k8s.io/kube-scheduler:v1.28.4
	registry.k8s.io/kube-controller-manager:v1.28.4
	registry.k8s.io/kube-proxy:v1.28.4
	registry.k8s.io/etcd:3.5.9-0
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I1122 10:37:18.085624    1546 cache_images.go:84] Images are preloaded, skipping loading
	I1122 10:37:18.085691    1546 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I1122 10:37:18.093741    1546 cni.go:84] Creating CNI manager for ""
	I1122 10:37:18.093751    1546 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:37:18.093771    1546 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I1122 10:37:18.093782    1546 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-024000 NodeName:addons-024000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku
bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1122 10:37:18.093857    1546 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.105.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-024000"
	  kubeletExtraArgs:
	    node-ip: 192.168.105.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.4
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1122 10:37:18.093909    1546 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-024000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.4 ClusterName:addons-024000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I1122 10:37:18.093955    1546 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
	I1122 10:37:18.097488    1546 binaries.go:44] Found k8s binaries, skipping transfer
	I1122 10:37:18.097517    1546 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1122 10:37:18.100530    1546 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)
	I1122 10:37:18.105610    1546 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1122 10:37:18.110459    1546 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)
	I1122 10:37:18.115506    1546 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts
	I1122 10:37:18.116668    1546 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1122 10:37:18.120295    1546 certs.go:56] Setting up /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000 for IP: 192.168.105.2
	I1122 10:37:18.120305    1546 certs.go:190] acquiring lock for shared ca certs: {Name:mk82a2e4b158bb0a7f0e8f5fc3783de0785e78ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.120454    1546 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/17658-941/.minikube/ca.key
	I1122 10:37:18.188560    1546 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17658-941/.minikube/ca.crt ...
	I1122 10:37:18.188565    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/ca.crt: {Name:mkf9042c9b7530c48b2a8af8f70e90e0c9d4cd62 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.188790    1546 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17658-941/.minikube/ca.key ...
	I1122 10:37:18.188795    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/ca.key: {Name:mk7b55ceca8b7dcb4db8c27fce3734c7a4d18665 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.188923    1546 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.key
	I1122 10:37:18.306084    1546 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.crt ...
	I1122 10:37:18.306088    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.crt: {Name:mk7e5c6b8936ecb568ca40a686a033ffc636fd82 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.306236    1546 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.key ...
	I1122 10:37:18.306239    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.key: {Name:mkefe81c5170140ed07905f4062323da47bf7318 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.306373    1546 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.key
	I1122 10:37:18.306380    1546 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt with IP's: []
	I1122 10:37:18.449190    1546 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt ...
	I1122 10:37:18.449194    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: {Name:mk9b8c1dc6fb3505f1d53e86cdb31f1746fa5cdb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.449370    1546 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.key ...
	I1122 10:37:18.449373    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.key: {Name:mkdd214b3184d5dcc02cb7dc4b7f94492b39f61b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.449485    1546 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key.96055969
	I1122 10:37:18.449494    1546 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I1122 10:37:18.718473    1546 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt.96055969 ...
	I1122 10:37:18.718489    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt.96055969: {Name:mk9a7a7fc2d3400e27a41350c3c1f99024546ccd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.718728    1546 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key.96055969 ...
	I1122 10:37:18.718733    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key.96055969: {Name:mkacbcee0bf50eb53750227da0f89a7f652cd25a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.718845    1546 certs.go:337] copying /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt
	I1122 10:37:18.719116    1546 certs.go:341] copying /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key
	I1122 10:37:18.719234    1546 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.key
	I1122 10:37:18.719244    1546 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.crt with IP's: []
	I1122 10:37:18.788437    1546 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.crt ...
	I1122 10:37:18.788440    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.crt: {Name:mk23ff182a8b1dce6529608357361df974843425 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.788587    1546 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.key ...
	I1122 10:37:18.788589    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.key: {Name:mka14e21bdfe41a1d1ec4aaf80cb6c97c363c5c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:18.788825    1546 certs.go:437] found cert: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca-key.pem (1675 bytes)
	I1122 10:37:18.788847    1546 certs.go:437] found cert: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem (1078 bytes)
	I1122 10:37:18.788866    1546 certs.go:437] found cert: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem (1123 bytes)
	I1122 10:37:18.788885    1546 certs.go:437] found cert: /Users/jenkins/minikube-integration/17658-941/.minikube/certs/Users/jenkins/minikube-integration/17658-941/.minikube/certs/key.pem (1675 bytes)
	I1122 10:37:18.789221    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I1122 10:37:18.797273    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I1122 10:37:18.804505    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1122 10:37:18.811239    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I1122 10:37:18.817809    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1122 10:37:18.824896    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I1122 10:37:18.831792    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1122 10:37:18.838409    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I1122 10:37:18.845373    1546 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17658-941/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1122 10:37:18.852630    1546 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1122 10:37:18.858607    1546 ssh_runner.go:195] Run: openssl version
	I1122 10:37:18.860495    1546 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1122 10:37:18.863443    1546 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1122 10:37:18.864881    1546 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Nov 22 18:37 /usr/share/ca-certificates/minikubeCA.pem
	I1122 10:37:18.864909    1546 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1122 10:37:18.866748    1546 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1122 10:37:18.869989    1546 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I1122 10:37:18.871228    1546 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I1122 10:37:18.871267    1546 kubeadm.go:404] StartCluster: {Name:addons-024000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.28.4 ClusterName:addons-024000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:37:18.871332    1546 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I1122 10:37:18.883544    1546 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1122 10:37:18.886375    1546 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I1122 10:37:18.889501    1546 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I1122 10:37:18.892734    1546 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I1122 10:37:18.892746    1546 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
	I1122 10:37:18.917290    1546 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4
	I1122 10:37:18.917317    1546 kubeadm.go:322] [preflight] Running pre-flight checks
	I1122 10:37:18.980308    1546 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I1122 10:37:18.980367    1546 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I1122 10:37:18.980431    1546 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I1122 10:37:19.078362    1546 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I1122 10:37:19.088601    1546 out.go:204]   - Generating certificates and keys ...
	I1122 10:37:19.088645    1546 kubeadm.go:322] [certs] Using existing ca certificate authority
	I1122 10:37:19.088688    1546 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I1122 10:37:19.144965    1546 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I1122 10:37:19.230806    1546 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I1122 10:37:19.507449    1546 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I1122 10:37:19.576684    1546 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I1122 10:37:19.652508    1546 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I1122 10:37:19.652576    1546 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-024000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]
	I1122 10:37:19.761017    1546 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I1122 10:37:19.761083    1546 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-024000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]
	I1122 10:37:19.805688    1546 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I1122 10:37:19.896148    1546 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I1122 10:37:19.984776    1546 kubeadm.go:322] [certs] Generating "sa" key and public key
	I1122 10:37:19.984808    1546 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I1122 10:37:20.085768    1546 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I1122 10:37:20.187975    1546 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I1122 10:37:20.406300    1546 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I1122 10:37:20.523995    1546 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I1122 10:37:20.524384    1546 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I1122 10:37:20.525877    1546 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I1122 10:37:20.534113    1546 out.go:204]   - Booting up control plane ...
	I1122 10:37:20.534174    1546 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I1122 10:37:20.534228    1546 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I1122 10:37:20.534277    1546 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I1122 10:37:20.534364    1546 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I1122 10:37:20.534413    1546 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I1122 10:37:20.534437    1546 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I1122 10:37:20.602815    1546 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I1122 10:37:24.105722    1546 kubeadm.go:322] [apiclient] All control plane components are healthy after 3.502965 seconds
	I1122 10:37:24.105807    1546 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I1122 10:37:24.117039    1546 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I1122 10:37:24.628264    1546 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I1122 10:37:24.628387    1546 kubeadm.go:322] [mark-control-plane] Marking the node addons-024000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I1122 10:37:25.132661    1546 kubeadm.go:322] [bootstrap-token] Using token: 8mec9w.plzz2bmez15nxd1n
	I1122 10:37:25.137735    1546 out.go:204]   - Configuring RBAC rules ...
	I1122 10:37:25.137803    1546 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I1122 10:37:25.139257    1546 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I1122 10:37:25.146875    1546 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I1122 10:37:25.147991    1546 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I1122 10:37:25.149044    1546 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I1122 10:37:25.150188    1546 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I1122 10:37:25.154715    1546 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I1122 10:37:25.317360    1546 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I1122 10:37:25.541552    1546 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I1122 10:37:25.541907    1546 kubeadm.go:322] 
	I1122 10:37:25.541949    1546 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I1122 10:37:25.541953    1546 kubeadm.go:322] 
	I1122 10:37:25.541990    1546 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I1122 10:37:25.541995    1546 kubeadm.go:322] 
	I1122 10:37:25.542007    1546 kubeadm.go:322]   mkdir -p $HOME/.kube
	I1122 10:37:25.542042    1546 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I1122 10:37:25.542069    1546 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I1122 10:37:25.542073    1546 kubeadm.go:322] 
	I1122 10:37:25.542097    1546 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I1122 10:37:25.542100    1546 kubeadm.go:322] 
	I1122 10:37:25.542127    1546 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I1122 10:37:25.542130    1546 kubeadm.go:322] 
	I1122 10:37:25.542187    1546 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I1122 10:37:25.542224    1546 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I1122 10:37:25.542260    1546 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I1122 10:37:25.542264    1546 kubeadm.go:322] 
	I1122 10:37:25.542316    1546 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I1122 10:37:25.542356    1546 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I1122 10:37:25.542360    1546 kubeadm.go:322] 
	I1122 10:37:25.542420    1546 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 8mec9w.plzz2bmez15nxd1n \
	I1122 10:37:25.542487    1546 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:65b22b4b6eeea8a069a1099e0cc68220d84c7fd6e15f117bffbc68d01fa2a721 \
	I1122 10:37:25.542499    1546 kubeadm.go:322] 	--control-plane 
	I1122 10:37:25.542502    1546 kubeadm.go:322] 
	I1122 10:37:25.542545    1546 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I1122 10:37:25.542548    1546 kubeadm.go:322] 
	I1122 10:37:25.542619    1546 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 8mec9w.plzz2bmez15nxd1n \
	I1122 10:37:25.542688    1546 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:65b22b4b6eeea8a069a1099e0cc68220d84c7fd6e15f117bffbc68d01fa2a721 
	I1122 10:37:25.542752    1546 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I1122 10:37:25.542759    1546 cni.go:84] Creating CNI manager for ""
	I1122 10:37:25.542768    1546 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:37:25.550604    1546 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I1122 10:37:25.553636    1546 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I1122 10:37:25.556874    1546 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I1122 10:37:25.561400    1546 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I1122 10:37:25.561455    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:25.561456    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=0a36d8b085cf00cc3f9aa9781dc3c3ed45b198bf minikube.k8s.io/name=addons-024000 minikube.k8s.io/updated_at=2023_11_22T10_37_25_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:25.566290    1546 ops.go:34] apiserver oom_adj: -16
	I1122 10:37:25.629436    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:25.661408    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:26.200638    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:26.699965    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:27.200675    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:27.700656    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:28.200632    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:28.700625    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:29.200614    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:29.700635    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:30.200613    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:30.700658    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:31.199502    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:31.700633    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:32.200640    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:32.700615    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:33.200573    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:33.700590    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:34.200604    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:34.698981    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:35.200613    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:35.700611    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:36.200554    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:36.700571    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:37.200551    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:37.700538    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:38.200537    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:38.700534    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:39.200576    1546 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I1122 10:37:39.233766    1546 kubeadm.go:1081] duration metric: took 13.672436125s to wait for elevateKubeSystemPrivileges.
	I1122 10:37:39.233784    1546 kubeadm.go:406] StartCluster complete in 20.362666542s
	I1122 10:37:39.233794    1546 settings.go:142] acquiring lock: {Name:mkbcad4bd133e43ff9e3c7681dd119b90570f01e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:39.233942    1546 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:37:39.234147    1546 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/kubeconfig: {Name:mk570a18424464d4edf63fd34c266eedd21d9ffc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:37:39.234349    1546 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I1122 10:37:39.234416    1546 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true]
	I1122 10:37:39.234477    1546 addons.go:69] Setting volumesnapshots=true in profile "addons-024000"
	I1122 10:37:39.234485    1546 addons.go:231] Setting addon volumesnapshots=true in "addons-024000"
	I1122 10:37:39.234490    1546 addons.go:69] Setting ingress-dns=true in profile "addons-024000"
	I1122 10:37:39.234498    1546 addons.go:231] Setting addon ingress-dns=true in "addons-024000"
	I1122 10:37:39.234513    1546 config.go:182] Loaded profile config "addons-024000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:37:39.234517    1546 addons.go:69] Setting registry=true in profile "addons-024000"
	I1122 10:37:39.234521    1546 addons.go:231] Setting addon registry=true in "addons-024000"
	I1122 10:37:39.234524    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234533    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234515    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234568    1546 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-024000"
	I1122 10:37:39.234582    1546 addons.go:69] Setting cloud-spanner=true in profile "addons-024000"
	I1122 10:37:39.234608    1546 addons.go:231] Setting addon nvidia-device-plugin=true in "addons-024000"
	I1122 10:37:39.234614    1546 addons.go:69] Setting storage-provisioner=true in profile "addons-024000"
	I1122 10:37:39.234598    1546 addons.go:69] Setting gcp-auth=true in profile "addons-024000"
	I1122 10:37:39.234642    1546 mustload.go:65] Loading cluster: addons-024000
	I1122 10:37:39.234660    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234601    1546 addons.go:69] Setting ingress=true in profile "addons-024000"
	I1122 10:37:39.234706    1546 addons.go:231] Setting addon ingress=true in "addons-024000"
	I1122 10:37:39.234731    1546 config.go:182] Loaded profile config "addons-024000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:37:39.234791    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234829    1546 retry.go:31] will retry after 1.063298776s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.234865    1546 retry.go:31] will retry after 1.24021211s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.234618    1546 addons.go:231] Setting addon cloud-spanner=true in "addons-024000"
	I1122 10:37:39.234623    1546 addons.go:231] Setting addon storage-provisioner=true in "addons-024000"
	I1122 10:37:39.234883    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234623    1546 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-024000"
	I1122 10:37:39.234920    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234928    1546 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-024000"
	I1122 10:37:39.234964    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.235049    1546 retry.go:31] will retry after 819.243018ms: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235084    1546 retry.go:31] will retry after 1.385113573s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235093    1546 retry.go:31] will retry after 927.556784ms: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.234629    1546 addons.go:69] Setting inspektor-gadget=true in profile "addons-024000"
	I1122 10:37:39.235106    1546 addons.go:231] Setting addon inspektor-gadget=true in "addons-024000"
	I1122 10:37:39.234627    1546 addons.go:69] Setting metrics-server=true in profile "addons-024000"
	I1122 10:37:39.235119    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.235128    1546 addons.go:231] Setting addon metrics-server=true in "addons-024000"
	I1122 10:37:39.235163    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.234629    1546 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-024000"
	I1122 10:37:39.235190    1546 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-024000"
	I1122 10:37:39.234554    1546 addons.go:69] Setting default-storageclass=true in profile "addons-024000"
	I1122 10:37:39.235209    1546 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-024000"
	I1122 10:37:39.235290    1546 retry.go:31] will retry after 573.886268ms: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235311    1546 retry.go:31] will retry after 657.223552ms: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235388    1546 retry.go:31] will retry after 1.329930201s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235409    1546 retry.go:31] will retry after 1.240443776s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235480    1546 retry.go:31] will retry after 998.002221ms: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.235671    1546 retry.go:31] will retry after 1.447916634s: connect: dial unix /Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/monitor: connect: connection refused
	I1122 10:37:39.240142    1546 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I1122 10:37:39.248334    1546 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3
	I1122 10:37:39.244442    1546 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1122 10:37:39.254445    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I1122 10:37:39.254523    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:39.254631    1546 addons.go:423] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1122 10:37:39.254638    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I1122 10:37:39.254646    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:39.258046    1546 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-024000" context rescaled to 1 replicas
	I1122 10:37:39.258063    1546 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:37:39.262345    1546 out.go:177] * Verifying Kubernetes components...
	I1122 10:37:39.271251    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1122 10:37:39.312020    1546 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I1122 10:37:39.312357    1546 node_ready.go:35] waiting up to 6m0s for node "addons-024000" to be "Ready" ...
	I1122 10:37:39.314100    1546 node_ready.go:49] node "addons-024000" has status "Ready":"True"
	I1122 10:37:39.314107    1546 node_ready.go:38] duration metric: took 1.740417ms waiting for node "addons-024000" to be "Ready" ...
	I1122 10:37:39.314110    1546 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1122 10:37:39.317426    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I1122 10:37:39.317740    1546 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-mlpvm" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:39.375151    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I1122 10:37:39.815420    1546 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1122 10:37:39.819337    1546 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1122 10:37:39.819346    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1122 10:37:39.819357    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:39.894508    1546 addons.go:231] Setting addon storage-provisioner-rancher=true in "addons-024000"
	I1122 10:37:39.894530    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:39.898376    1546 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I1122 10:37:39.902358    1546 out.go:177]   - Using image docker.io/busybox:stable
	I1122 10:37:39.906336    1546 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1122 10:37:39.906345    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I1122 10:37:39.906355    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:39.997381    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1122 10:37:40.001772    1546 start.go:926] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap
	I1122 10:37:40.005670    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I1122 10:37:40.060429    1546 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.9.4
	I1122 10:37:40.064152    1546 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1122 10:37:40.068362    1546 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1122 10:37:40.072467    1546 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I1122 10:37:40.072479    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)
	I1122 10:37:40.072490    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.168400    1546 out.go:177]   - Using image docker.io/registry:2.8.3
	I1122 10:37:40.172322    1546 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I1122 10:37:40.176337    1546 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I1122 10:37:40.176344    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I1122 10:37:40.176355    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.176767    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I1122 10:37:40.237530    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I1122 10:37:40.244513    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I1122 10:37:40.251538    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I1122 10:37:40.252091    1546 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I1122 10:37:40.258568    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I1122 10:37:40.258568    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I1122 10:37:40.265573    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I1122 10:37:40.273565    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I1122 10:37:40.282665    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I1122 10:37:40.291523    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I1122 10:37:40.294619    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I1122 10:37:40.294629    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I1122 10:37:40.294641    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.302510    1546 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I1122 10:37:40.305589    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I1122 10:37:40.305603    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I1122 10:37:40.305614    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.318194    1546 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I1122 10:37:40.318204    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I1122 10:37:40.350606    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I1122 10:37:40.422669    1546 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I1122 10:37:40.422682    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I1122 10:37:40.476176    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:40.477636    1546 addons.go:231] Setting addon default-storageclass=true in "addons-024000"
	I1122 10:37:40.477651    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:40.478342    1546 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I1122 10:37:40.478348    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1122 10:37:40.478354    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.490114    1546 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I1122 10:37:40.490126    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I1122 10:37:40.550604    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I1122 10:37:40.550618    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I1122 10:37:40.554114    1546 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I1122 10:37:40.554124    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I1122 10:37:40.559769    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I1122 10:37:40.559781    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I1122 10:37:40.572527    1546 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.22.0
	I1122 10:37:40.576512    1546 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I1122 10:37:40.576524    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I1122 10:37:40.576536    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.576990    1546 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1122 10:37:40.576995    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I1122 10:37:40.625561    1546 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.12
	I1122 10:37:40.629526    1546 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I1122 10:37:40.629535    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I1122 10:37:40.629546    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.629988    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I1122 10:37:40.629997    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I1122 10:37:40.630106    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1122 10:37:40.649066    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I1122 10:37:40.649077    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I1122 10:37:40.671112    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1122 10:37:40.687599    1546 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
	I1122 10:37:40.691526    1546 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I1122 10:37:40.691534    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I1122 10:37:40.691545    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:40.704653    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I1122 10:37:40.704664    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I1122 10:37:40.736353    1546 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I1122 10:37:40.736365    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I1122 10:37:40.788542    1546 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I1122 10:37:40.788554    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I1122 10:37:40.848419    1546 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I1122 10:37:40.848431    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I1122 10:37:40.898070    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I1122 10:37:40.898081    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I1122 10:37:40.925802    1546 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I1122 10:37:40.925812    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I1122 10:37:40.936431    1546 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I1122 10:37:40.936442    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I1122 10:37:40.936550    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I1122 10:37:40.992178    1546 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I1122 10:37:40.992193    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I1122 10:37:41.000780    1546 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I1122 10:37:41.000791    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I1122 10:37:41.084491    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I1122 10:37:41.084505    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I1122 10:37:41.147485    1546 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I1122 10:37:41.147499    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I1122 10:37:41.179697    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I1122 10:37:41.182988    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I1122 10:37:41.182994    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I1122 10:37:41.201346    1546 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I1122 10:37:41.201357    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I1122 10:37:41.226235    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I1122 10:37:41.226249    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I1122 10:37:41.232401    1546 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1122 10:37:41.232410    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I1122 10:37:41.237981    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I1122 10:37:41.326407    1546 pod_ready.go:92] pod "coredns-5dd5756b68-mlpvm" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:41.326418    1546 pod_ready.go:81] duration metric: took 2.008679959s waiting for pod "coredns-5dd5756b68-mlpvm" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.326424    1546 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-zw9p8" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.327394    1546 pod_ready.go:97] error getting pod "coredns-5dd5756b68-zw9p8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-zw9p8" not found
	I1122 10:37:41.327403    1546 pod_ready.go:81] duration metric: took 975.792µs waiting for pod "coredns-5dd5756b68-zw9p8" in "kube-system" namespace to be "Ready" ...
	E1122 10:37:41.327407    1546 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-5dd5756b68-zw9p8" in "kube-system" namespace (skipping!): pods "coredns-5dd5756b68-zw9p8" not found
	I1122 10:37:41.327412    1546 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.329776    1546 pod_ready.go:92] pod "etcd-addons-024000" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:41.329782    1546 pod_ready.go:81] duration metric: took 2.360542ms waiting for pod "etcd-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.329787    1546 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.332494    1546 pod_ready.go:92] pod "kube-apiserver-addons-024000" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:41.332500    1546 pod_ready.go:81] duration metric: took 2.709709ms waiting for pod "kube-apiserver-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.332504    1546 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.335950    1546 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I1122 10:37:41.335960    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I1122 10:37:41.400578    1546 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I1122 10:37:41.400589    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I1122 10:37:41.407471    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I1122 10:37:41.516150    1546 pod_ready.go:92] pod "kube-controller-manager-addons-024000" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:41.516162    1546 pod_ready.go:81] duration metric: took 183.65525ms waiting for pod "kube-controller-manager-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.516167    1546 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-f6k7h" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.916844    1546 pod_ready.go:92] pod "kube-proxy-f6k7h" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:41.916854    1546 pod_ready.go:81] duration metric: took 400.686917ms waiting for pod "kube-proxy-f6k7h" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:41.916859    1546 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:42.316010    1546 pod_ready.go:92] pod "kube-scheduler-addons-024000" in "kube-system" namespace has status "Ready":"True"
	I1122 10:37:42.316020    1546 pod_ready.go:81] duration metric: took 399.160541ms waiting for pod "kube-scheduler-addons-024000" in "kube-system" namespace to be "Ready" ...
	I1122 10:37:42.316024    1546 pod_ready.go:38] duration metric: took 3.001930208s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1122 10:37:42.316032    1546 api_server.go:52] waiting for apiserver process to appear ...
	I1122 10:37:42.316088    1546 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1122 10:37:43.083476    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (2.732871541s)
	I1122 10:37:43.083491    1546 addons.go:467] Verifying addon registry=true in "addons-024000"
	I1122 10:37:43.087683    1546 out.go:177] * Verifying registry addon...
	I1122 10:37:43.083847    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.453709208s)
	I1122 10:37:43.083870    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (2.907108667s)
	I1122 10:37:43.083958    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.412795125s)
	I1122 10:37:43.083989    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.147445833s)
	I1122 10:37:43.084033    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.904337916s)
	I1122 10:37:43.095957    1546 addons.go:467] Verifying addon metrics-server=true in "addons-024000"
	I1122 10:37:43.095986    1546 addons.go:467] Verifying addon ingress=true in "addons-024000"
	W1122 10:37:43.095998    1546 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1122 10:37:43.096031    1546 retry.go:31] will retry after 199.303503ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I1122 10:37:43.098685    1546 out.go:177] * Verifying ingress addon...
	I1122 10:37:43.096464    1546 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I1122 10:37:43.109089    1546 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I1122 10:37:43.111185    1546 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I1122 10:37:43.111191    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:43.112725    1546 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I1122 10:37:43.112731    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:43.113540    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:43.114420    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:43.295521    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I1122 10:37:43.531727    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (2.293739291s)
	I1122 10:37:43.531748    1546 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-024000"
	I1122 10:37:43.535702    1546 out.go:177] * Verifying csi-hostpath-driver addon...
	I1122 10:37:43.531861    1546 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (2.124351333s)
	I1122 10:37:43.531895    1546 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.215809417s)
	I1122 10:37:43.542786    1546 api_server.go:72] duration metric: took 4.284732042s to wait for apiserver process to appear ...
	I1122 10:37:43.542801    1546 api_server.go:88] waiting for apiserver healthz status ...
	I1122 10:37:43.542871    1546 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...
	I1122 10:37:43.543155    1546 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I1122 10:37:43.570471    1546 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:
	ok
	I1122 10:37:43.589221    1546 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I1122 10:37:43.589231    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:43.597402    1546 api_server.go:141] control plane version: v1.28.4
	I1122 10:37:43.597417    1546 api_server.go:131] duration metric: took 54.588834ms to wait for apiserver health ...
	I1122 10:37:43.597421    1546 system_pods.go:43] waiting for kube-system pods to appear ...
	I1122 10:37:43.614438    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:43.618281    1546 system_pods.go:59] 17 kube-system pods found
	I1122 10:37:43.618291    1546 system_pods.go:61] "coredns-5dd5756b68-mlpvm" [b49a5243-1aa2-4920-a5e9-b609a4a0cbe8] Running
	I1122 10:37:43.618295    1546 system_pods.go:61] "csi-hostpath-attacher-0" [55565d4d-2927-454a-a380-e7b20689cd3c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1122 10:37:43.618300    1546 system_pods.go:61] "csi-hostpath-resizer-0" [437d5e31-098b-4dff-883c-61ced09f4be8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1122 10:37:43.618303    1546 system_pods.go:61] "csi-hostpathplugin-dqbzv" [d194843e-c30e-4bd7-9ceb-c0728504cce4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1122 10:37:43.618306    1546 system_pods.go:61] "etcd-addons-024000" [855fe5f2-90b8-4cf4-9b6b-6e2f59f84547] Running
	I1122 10:37:43.618309    1546 system_pods.go:61] "kube-apiserver-addons-024000" [8d0293a2-f051-45f1-9012-58f15408aece] Running
	I1122 10:37:43.618311    1546 system_pods.go:61] "kube-controller-manager-addons-024000" [7e9e8782-c719-47f7-a66d-249a987c9ce5] Running
	I1122 10:37:43.618314    1546 system_pods.go:61] "kube-ingress-dns-minikube" [690c9c59-db52-4d8c-bbc6-2351e5f316de] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1122 10:37:43.618322    1546 system_pods.go:61] "kube-proxy-f6k7h" [91d4d61b-067b-4df8-b83f-abe8936463d0] Running
	I1122 10:37:43.618325    1546 system_pods.go:61] "kube-scheduler-addons-024000" [369018f9-ec92-4305-b0f7-635f03c3e4aa] Running
	I1122 10:37:43.618327    1546 system_pods.go:61] "metrics-server-7c66d45ddc-89rpj" [8416ab4d-98f1-4bc6-a944-a26a2f22a4e6] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1122 10:37:43.618331    1546 system_pods.go:61] "nvidia-device-plugin-daemonset-ckwws" [f778363d-23ff-4a02-ae33-ff69c57e17db] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I1122 10:37:43.618335    1546 system_pods.go:61] "registry-cgcwp" [3cf4bb31-30c7-487a-ac73-f369cfd3dd18] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I1122 10:37:43.618338    1546 system_pods.go:61] "registry-proxy-d46zm" [ffcad2ec-3d5f-4431-b99f-fd620adb6eea] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I1122 10:37:43.618342    1546 system_pods.go:61] "snapshot-controller-58dbcc7b99-6ssm2" [c75630fb-0237-4650-8b01-98c38a6db90b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1122 10:37:43.618345    1546 system_pods.go:61] "snapshot-controller-58dbcc7b99-sr7jh" [9ceb8f1b-e43d-4f19-ad9d-7638c4633ecf] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1122 10:37:43.618347    1546 system_pods.go:61] "storage-provisioner" [3d602265-3cfc-4c37-9f8d-3d5c2996978e] Running
	I1122 10:37:43.618351    1546 system_pods.go:74] duration metric: took 20.927167ms to wait for pod list to return data ...
	I1122 10:37:43.618354    1546 default_sa.go:34] waiting for default service account to be created ...
	I1122 10:37:43.621054    1546 default_sa.go:45] found service account: "default"
	I1122 10:37:43.621063    1546 default_sa.go:55] duration metric: took 2.705958ms for default service account to be created ...
	I1122 10:37:43.621067    1546 system_pods.go:116] waiting for k8s-apps to be running ...
	I1122 10:37:43.621377    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:43.626097    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:43.640804    1546 system_pods.go:86] 17 kube-system pods found
	I1122 10:37:43.640817    1546 system_pods.go:89] "coredns-5dd5756b68-mlpvm" [b49a5243-1aa2-4920-a5e9-b609a4a0cbe8] Running
	I1122 10:37:43.640822    1546 system_pods.go:89] "csi-hostpath-attacher-0" [55565d4d-2927-454a-a380-e7b20689cd3c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I1122 10:37:43.640825    1546 system_pods.go:89] "csi-hostpath-resizer-0" [437d5e31-098b-4dff-883c-61ced09f4be8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I1122 10:37:43.640829    1546 system_pods.go:89] "csi-hostpathplugin-dqbzv" [d194843e-c30e-4bd7-9ceb-c0728504cce4] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I1122 10:37:43.640832    1546 system_pods.go:89] "etcd-addons-024000" [855fe5f2-90b8-4cf4-9b6b-6e2f59f84547] Running
	I1122 10:37:43.640834    1546 system_pods.go:89] "kube-apiserver-addons-024000" [8d0293a2-f051-45f1-9012-58f15408aece] Running
	I1122 10:37:43.640836    1546 system_pods.go:89] "kube-controller-manager-addons-024000" [7e9e8782-c719-47f7-a66d-249a987c9ce5] Running
	I1122 10:37:43.640843    1546 system_pods.go:89] "kube-ingress-dns-minikube" [690c9c59-db52-4d8c-bbc6-2351e5f316de] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I1122 10:37:43.640845    1546 system_pods.go:89] "kube-proxy-f6k7h" [91d4d61b-067b-4df8-b83f-abe8936463d0] Running
	I1122 10:37:43.640848    1546 system_pods.go:89] "kube-scheduler-addons-024000" [369018f9-ec92-4305-b0f7-635f03c3e4aa] Running
	I1122 10:37:43.640850    1546 system_pods.go:89] "metrics-server-7c66d45ddc-89rpj" [8416ab4d-98f1-4bc6-a944-a26a2f22a4e6] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1122 10:37:43.640854    1546 system_pods.go:89] "nvidia-device-plugin-daemonset-ckwws" [f778363d-23ff-4a02-ae33-ff69c57e17db] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I1122 10:37:43.640865    1546 system_pods.go:89] "registry-cgcwp" [3cf4bb31-30c7-487a-ac73-f369cfd3dd18] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I1122 10:37:43.640871    1546 system_pods.go:89] "registry-proxy-d46zm" [ffcad2ec-3d5f-4431-b99f-fd620adb6eea] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I1122 10:37:43.640875    1546 system_pods.go:89] "snapshot-controller-58dbcc7b99-6ssm2" [c75630fb-0237-4650-8b01-98c38a6db90b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1122 10:37:43.640878    1546 system_pods.go:89] "snapshot-controller-58dbcc7b99-sr7jh" [9ceb8f1b-e43d-4f19-ad9d-7638c4633ecf] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I1122 10:37:43.640880    1546 system_pods.go:89] "storage-provisioner" [3d602265-3cfc-4c37-9f8d-3d5c2996978e] Running
	I1122 10:37:43.640889    1546 system_pods.go:126] duration metric: took 19.81875ms to wait for k8s-apps to be running ...
	I1122 10:37:43.640893    1546 system_svc.go:44] waiting for kubelet service to be running ....
	I1122 10:37:43.640940    1546 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1122 10:37:44.118940    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:44.119395    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:44.119985    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:44.264274    1546 system_svc.go:56] duration metric: took 623.379708ms WaitForService to wait for kubelet.
	I1122 10:37:44.264291    1546 kubeadm.go:581] duration metric: took 5.006250792s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I1122 10:37:44.264301    1546 node_conditions.go:102] verifying NodePressure condition ...
	I1122 10:37:44.266987    1546 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki
	I1122 10:37:44.267016    1546 node_conditions.go:123] node cpu capacity is 2
	I1122 10:37:44.267043    1546 node_conditions.go:105] duration metric: took 2.739959ms to run NodePressure ...
	I1122 10:37:44.267050    1546 start.go:228] waiting for startup goroutines ...
	I1122 10:37:44.618430    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:44.619211    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:44.620020    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:45.118368    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:45.119612    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:45.119901    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:45.618415    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:45.619290    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:45.619341    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:46.116613    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:46.118215    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:46.118309    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:46.619404    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:46.619492    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:46.620077    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:47.119473    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:47.119491    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:47.119549    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:47.482262    1546 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I1122 10:37:47.482279    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:47.511234    1546 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I1122 10:37:47.517559    1546 addons.go:231] Setting addon gcp-auth=true in "addons-024000"
	I1122 10:37:47.517581    1546 host.go:66] Checking if "addons-024000" exists ...
	I1122 10:37:47.518402    1546 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I1122 10:37:47.518411    1546 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/addons-024000/id_rsa Username:docker}
	I1122 10:37:47.548263    1546 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0
	I1122 10:37:47.552287    1546 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I1122 10:37:47.555218    1546 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I1122 10:37:47.555224    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I1122 10:37:47.560876    1546 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I1122 10:37:47.560884    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I1122 10:37:47.565888    1546 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1122 10:37:47.565893    1546 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)
	I1122 10:37:47.572675    1546 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I1122 10:37:47.620121    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:47.620183    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:47.620265    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:47.951878    1546 addons.go:467] Verifying addon gcp-auth=true in "addons-024000"
	I1122 10:37:47.955595    1546 out.go:177] * Verifying gcp-auth addon...
	I1122 10:37:47.963950    1546 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I1122 10:37:47.965559    1546 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I1122 10:37:47.965565    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:47.966835    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:48.117946    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:48.118581    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:48.118829    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:48.470748    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:48.618654    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:48.619400    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:48.619513    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:48.970916    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:49.119182    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:49.119221    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:49.119275    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:49.470967    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:49.618209    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:49.618993    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:49.619191    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:49.970847    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:50.117896    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:50.117926    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:50.118629    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:50.470799    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:50.617432    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:50.617585    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:50.618329    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:50.969872    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:51.118957    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:51.119067    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:51.119157    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:51.471114    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:51.617798    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:51.618874    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:51.618991    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:51.971201    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:52.116268    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:52.117401    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:52.118178    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:52.470898    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:52.618166    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:52.618259    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:52.618634    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:52.970636    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:53.118604    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:53.119708    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:53.119806    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:53.470629    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:53.618745    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:53.618927    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:53.619322    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:53.970545    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:54.118520    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:54.118584    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:54.119124    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:54.470510    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:54.617880    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:54.618509    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:54.618602    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:54.970822    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:55.118206    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:55.118522    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:55.118606    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:55.468864    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:55.618056    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:55.618626    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:55.618793    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:55.970709    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:56.117961    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:56.118035    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:56.118974    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:56.471233    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:56.619883    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:56.620570    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:56.620821    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:56.970733    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:57.118202    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:57.118883    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:57.118918    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:57.470676    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:57.618601    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:57.618788    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:57.619058    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:57.970812    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:58.118341    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:58.118486    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:58.119417    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:58.470709    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:58.621362    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:58.622842    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:58.623034    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:58.970659    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:59.118206    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I1122 10:37:59.118259    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:59.119506    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:59.470983    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:37:59.619143    1546 kapi.go:107] duration metric: took 16.522798s to wait for kubernetes.io/minikube-addons=registry ...
	I1122 10:37:59.619297    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:37:59.619439    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:37:59.970809    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:00.118523    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:00.119610    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:00.470372    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:00.619899    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:00.619999    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:00.970300    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:01.121169    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:01.121589    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:01.470555    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:01.618856    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:01.619281    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:01.970720    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:02.118921    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:02.119288    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:02.470588    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:02.618986    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:02.619357    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:02.970565    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:03.118410    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:03.119582    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:03.470328    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:03.618640    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:03.619189    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:03.968490    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:04.118177    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:04.118709    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:04.470607    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:04.618666    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:04.618923    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:04.970847    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:05.118491    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:05.118862    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:05.470708    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:05.618880    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:05.619489    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:05.970476    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:06.119098    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:06.119683    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:06.690903    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:06.690990    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:06.691160    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:06.970512    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:07.119271    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:07.119321    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:07.470456    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:07.623421    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:07.623448    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:07.970696    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:08.118183    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:08.119183    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:08.469754    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:08.617142    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:08.617445    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:08.970799    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:09.119176    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:09.119298    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:09.470549    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:09.618877    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:09.619842    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:09.968486    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:10.119064    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:10.119919    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:10.470383    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:10.619739    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:10.619821    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:10.970485    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:11.119182    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:11.123602    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:11.470996    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:11.619197    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:11.619272    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:11.970566    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:12.119847    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:12.119945    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:12.470569    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:12.618962    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:12.619018    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:12.970455    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:13.119548    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:13.119653    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:13.470485    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:13.618699    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:13.619530    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:13.970934    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:14.119494    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:14.119679    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:14.470449    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:14.619012    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:14.619615    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:14.988387    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:15.119130    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:15.119422    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:15.470569    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:15.619414    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:15.619681    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:15.995514    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:16.119064    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:16.119661    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:16.470525    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:16.619438    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:16.620966    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:16.969725    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:17.118496    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:17.119512    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:17.470252    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:17.619552    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:17.619856    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:17.970386    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:18.117679    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:18.118629    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:18.468923    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:18.619457    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:18.619570    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:18.970600    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:19.118518    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:19.118646    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:19.470736    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:19.618146    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:19.618772    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:19.971238    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:20.120463    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:20.120494    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:20.470359    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:20.618289    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:20.618628    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:20.970640    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:21.118500    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:21.119911    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:21.470663    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:21.619675    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:21.619787    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:21.969449    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:22.119002    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:22.119125    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:22.470327    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:22.619473    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:22.619511    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:22.969530    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:23.119538    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:23.119973    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:23.470757    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:23.618386    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:23.619191    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:23.970475    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:24.119313    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:24.119414    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:24.468748    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:24.618864    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:24.618906    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:24.970466    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:25.119327    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:25.119429    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:25.470480    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:25.618748    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:25.619116    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:25.970150    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:26.118012    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:26.118624    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:26.470765    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:26.620540    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:26.620575    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:26.970673    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:27.119057    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:27.119515    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:27.470500    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:27.618479    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:27.619102    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:27.970314    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:28.119055    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:28.119232    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:28.470259    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:28.620417    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:28.622513    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:28.969790    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:29.118459    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:29.118707    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:29.470393    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:29.617856    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:29.617918    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:29.970697    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:30.119159    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:30.119402    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:30.504509    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:30.618024    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:30.618732    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:30.970260    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:31.118016    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:31.118649    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:31.470390    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:31.618971    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:31.619029    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:31.970812    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:32.118335    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:32.118837    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:32.468683    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:32.618919    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:32.618990    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:32.969509    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:33.118549    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:33.118837    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:33.470212    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:33.618315    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:33.618698    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:33.968906    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:34.118308    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:34.118352    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:34.470304    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:34.618930    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:34.619288    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:34.970359    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:35.119283    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:35.119380    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:35.470516    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:35.619763    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:35.619779    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:35.970415    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:36.119825    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:36.119893    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:36.469489    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:36.618709    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:36.618756    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:36.970496    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:37.118374    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:37.119807    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:37.470444    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:37.619810    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:37.619848    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:37.970459    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:38.118561    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:38.118980    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:38.470358    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:38.630538    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:38.630734    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I1122 10:38:38.969346    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:39.118703    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:39.119154    1546 kapi.go:107] duration metric: took 55.576401041s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I1122 10:38:39.470584    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:39.618707    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:39.970496    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:40.118176    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:40.470269    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:40.618161    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:40.970518    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:41.118330    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:41.470594    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:41.617283    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:41.970749    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:42.118502    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:42.470401    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:42.618221    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:42.970406    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:43.118667    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:43.470655    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:43.618557    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:43.970174    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:44.118192    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:44.470307    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:44.618275    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:44.970491    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:45.118418    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:45.470788    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:45.616733    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:45.970464    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:46.118398    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:46.470632    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:46.618212    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:46.970422    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:47.118912    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:47.470521    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:47.618201    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:47.970314    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:48.118350    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:48.470336    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:48.618050    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:48.970574    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:49.118356    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:49.470862    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:49.618448    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:49.970341    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:50.118454    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:50.470033    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:50.618309    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:50.970152    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:51.118152    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:51.469395    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:51.618530    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:51.970347    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:52.118131    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:52.470194    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:52.617650    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:52.970408    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:53.118366    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:53.470424    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:53.616764    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:53.970332    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:54.118420    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:54.471400    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:54.618159    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:54.970355    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:55.118408    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:55.470272    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:55.618526    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:55.969256    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:56.118243    1546 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I1122 10:38:56.470325    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:56.618198    1546 kapi.go:107] duration metric: took 1m13.509637917s to wait for app.kubernetes.io/name=ingress-nginx ...
	I1122 10:38:56.970107    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:57.470301    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:57.970007    1546 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I1122 10:38:58.470249    1546 kapi.go:107] duration metric: took 1m10.506804708s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I1122 10:38:58.473587    1546 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-024000 cluster.
	I1122 10:38:58.478425    1546 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I1122 10:38:58.484436    1546 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I1122 10:38:58.488301    1546 out.go:177] * Enabled addons: ingress-dns, nvidia-device-plugin, storage-provisioner, storage-provisioner-rancher, metrics-server, cloud-spanner, default-storageclass, inspektor-gadget, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I1122 10:38:58.492438    1546 addons.go:502] enable addons completed in 1m19.258604625s: enabled=[ingress-dns nvidia-device-plugin storage-provisioner storage-provisioner-rancher metrics-server cloud-spanner default-storageclass inspektor-gadget volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I1122 10:38:58.492454    1546 start.go:233] waiting for cluster config update ...
	I1122 10:38:58.492463    1546 start.go:242] writing updated cluster config ...
	I1122 10:38:58.492847    1546 ssh_runner.go:195] Run: rm -f paused
	I1122 10:38:58.626746    1546 start.go:600] kubectl: 1.28.2, cluster: 1.28.4 (minor skew: 0)
	I1122 10:38:58.630410    1546 out.go:177] * Done! kubectl is now configured to use "addons-024000" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* -- Journal begins at Wed 2023-11-22 18:37:06 UTC, ends at Wed 2023-11-22 18:40:41 UTC. --
	Nov 22 18:40:21 addons-024000 dockerd[1101]: time="2023-11-22T18:40:21.080719825Z" level=info msg="shim disconnected" id=21794b78443c70935af694cf50cf914d14109e442b67a031e92a6f9e13d85439 namespace=moby
	Nov 22 18:40:21 addons-024000 dockerd[1095]: time="2023-11-22T18:40:21.080861160Z" level=info msg="ignoring event" container=21794b78443c70935af694cf50cf914d14109e442b67a031e92a6f9e13d85439 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:40:21 addons-024000 dockerd[1101]: time="2023-11-22T18:40:21.080982871Z" level=warning msg="cleaning up after shim disconnected" id=21794b78443c70935af694cf50cf914d14109e442b67a031e92a6f9e13d85439 namespace=moby
	Nov 22 18:40:21 addons-024000 dockerd[1101]: time="2023-11-22T18:40:21.080991746Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:40:33 addons-024000 dockerd[1095]: time="2023-11-22T18:40:33.959382611Z" level=info msg="ignoring event" container=e2309b71222b573233e974831f136d5413aa7fd3416957d9beb4791a5b7105e1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:40:33 addons-024000 dockerd[1101]: time="2023-11-22T18:40:33.959776162Z" level=info msg="shim disconnected" id=e2309b71222b573233e974831f136d5413aa7fd3416957d9beb4791a5b7105e1 namespace=moby
	Nov 22 18:40:33 addons-024000 dockerd[1101]: time="2023-11-22T18:40:33.959806079Z" level=warning msg="cleaning up after shim disconnected" id=e2309b71222b573233e974831f136d5413aa7fd3416957d9beb4791a5b7105e1 namespace=moby
	Nov 22 18:40:33 addons-024000 dockerd[1101]: time="2023-11-22T18:40:33.959810162Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.079349395Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.079384688Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.079402438Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.079407188Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:40:36 addons-024000 dockerd[1095]: time="2023-11-22T18:40:36.124338386Z" level=info msg="ignoring event" container=2e179095073ef568cd891f91572355b72e958b07b12326cbb37473bb629fda25 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.124590892Z" level=info msg="shim disconnected" id=2e179095073ef568cd891f91572355b72e958b07b12326cbb37473bb629fda25 namespace=moby
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.124621101Z" level=warning msg="cleaning up after shim disconnected" id=2e179095073ef568cd891f91572355b72e958b07b12326cbb37473bb629fda25 namespace=moby
	Nov 22 18:40:36 addons-024000 dockerd[1101]: time="2023-11-22T18:40:36.124625226Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1095]: time="2023-11-22T18:40:37.595036441Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932
	Nov 22 18:40:37 addons-024000 dockerd[1095]: time="2023-11-22T18:40:37.674966210Z" level=info msg="ignoring event" container=6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.675125839Z" level=info msg="shim disconnected" id=6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932 namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.675226383Z" level=warning msg="cleaning up after shim disconnected" id=6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932 namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.675231466Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1095]: time="2023-11-22T18:40:37.748397030Z" level=info msg="ignoring event" container=4c3014f7e62052e32fded3eeacce65e4668e439512292e54e1b8d79cd38274e8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.748459948Z" level=info msg="shim disconnected" id=4c3014f7e62052e32fded3eeacce65e4668e439512292e54e1b8d79cd38274e8 namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.748485949Z" level=warning msg="cleaning up after shim disconnected" id=4c3014f7e62052e32fded3eeacce65e4668e439512292e54e1b8d79cd38274e8 namespace=moby
	Nov 22 18:40:37 addons-024000 dockerd[1101]: time="2023-11-22T18:40:37.748491407Z" level=info msg="cleaning up dead shim" namespace=moby
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	2e179095073ef       dd1b12fcb6097                                                                                                                5 seconds ago        Exited              hello-world-app           2                   bd5c6eefdcdf2       hello-world-app-5d77478584-kqd4h
	bf41d681b847d       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                                                29 seconds ago       Running             nginx                     0                   402189dbdd76a       nginx
	e55951c7746d2       ghcr.io/headlamp-k8s/headlamp@sha256:7a9587036bd29304f8f1387a7245556a3c479434670b2ca58e3624d44d2a68c9                        39 seconds ago       Running             headlamp                  0                   7dd466e252b5f       headlamp-777fd4b855-llj7s
	1a012b0988d3e       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                  0                   a3c144b620c24       gcp-auth-d4c87556c-2z7zk
	e307a8cd2f948       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a7943503b45d552785aa3b5e457f169a5661fb94d82b8a3373bcd9ebaf9aac80   2 minutes ago        Exited              patch                     0                   0fb5e52a51cab       ingress-nginx-admission-patch-f4hf4
	c2b54125debd4       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a7943503b45d552785aa3b5e457f169a5661fb94d82b8a3373bcd9ebaf9aac80   2 minutes ago        Exited              create                    0                   473141e75c528       ingress-nginx-admission-create-728sk
	1c564c842f20a       ba04bb24b9575                                                                                                                3 minutes ago        Running             storage-provisioner       0                   8711cd8193565       storage-provisioner
	70299ad796dfb       97e04611ad434                                                                                                                3 minutes ago        Running             coredns                   0                   734a32d5a92a0       coredns-5dd5756b68-mlpvm
	e7f0e783d991a       3ca3ca488cf13                                                                                                                3 minutes ago        Running             kube-proxy                0                   d76b8acb966ef       kube-proxy-f6k7h
	fd18408ced2ce       05c284c929889                                                                                                                3 minutes ago        Running             kube-scheduler            0                   16e2750ed619c       kube-scheduler-addons-024000
	ddf4ff8547de8       9cdd6470f48c8                                                                                                                3 minutes ago        Running             etcd                      0                   5ec33cb890ff6       etcd-addons-024000
	59e338a3d7bc6       9961cbceaf234                                                                                                                3 minutes ago        Running             kube-controller-manager   0                   bc0ec9fd5a7bc       kube-controller-manager-addons-024000
	f1b3c3425d21b       04b4c447bb9d4                                                                                                                3 minutes ago        Running             kube-apiserver            0                   9eb0707f03bb8       kube-apiserver-addons-024000
	
	* 
	* ==> coredns [70299ad796df] <==
	* [INFO] 10.244.0.18:48634 - 5314 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000012375s
	[INFO] 10.244.0.18:44098 - 15425 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000040709s
	[INFO] 10.244.0.18:48634 - 4183 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000010834s
	[INFO] 10.244.0.18:44098 - 28322 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000043834s
	[INFO] 10.244.0.18:48634 - 33614 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000010458s
	[INFO] 10.244.0.18:44098 - 55888 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00004s
	[INFO] 10.244.0.18:48634 - 44314 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.0000115s
	[INFO] 10.244.0.18:44098 - 19072 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000025667s
	[INFO] 10.244.0.18:48634 - 21836 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000009541s
	[INFO] 10.244.0.18:44098 - 11631 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000035125s
	[INFO] 10.244.0.18:48634 - 12869 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00000975s
	[INFO] 10.244.0.18:36023 - 49562 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000057417s
	[INFO] 10.244.0.18:58076 - 57856 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.0000155s
	[INFO] 10.244.0.18:58076 - 10390 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000012875s
	[INFO] 10.244.0.18:36023 - 25663 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000019251s
	[INFO] 10.244.0.18:58076 - 38462 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000045292s
	[INFO] 10.244.0.18:36023 - 1998 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.0000345s
	[INFO] 10.244.0.18:58076 - 12761 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000018459s
	[INFO] 10.244.0.18:36023 - 57006 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000011875s
	[INFO] 10.244.0.18:58076 - 20210 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000014709s
	[INFO] 10.244.0.18:58076 - 41682 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000010792s
	[INFO] 10.244.0.18:58076 - 6820 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000016001s
	[INFO] 10.244.0.18:36023 - 8095 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000009791s
	[INFO] 10.244.0.18:36023 - 48690 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000016583s
	[INFO] 10.244.0.18:36023 - 30199 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000016209s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-024000
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-024000
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=0a36d8b085cf00cc3f9aa9781dc3c3ed45b198bf
	                    minikube.k8s.io/name=addons-024000
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_11_22T10_37_25_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-024000
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 22 Nov 2023 18:37:22 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-024000
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 22 Nov 2023 18:40:38 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 22 Nov 2023 18:40:29 +0000   Wed, 22 Nov 2023 18:37:22 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 22 Nov 2023 18:40:29 +0000   Wed, 22 Nov 2023 18:37:22 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 22 Nov 2023 18:40:29 +0000   Wed, 22 Nov 2023 18:37:22 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 22 Nov 2023 18:40:29 +0000   Wed, 22 Nov 2023 18:37:27 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.105.2
	  Hostname:    addons-024000
	Capacity:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3905016Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3905016Ki
	  pods:               110
	System Info:
	  Machine ID:                 376112c381c242979c91029c92028bc3
	  System UUID:                376112c381c242979c91029c92028bc3
	  Boot ID:                    1ce2322c-7f32-4f2a-89e2-20cf75af131a
	  Kernel Version:             5.10.57
	  OS Image:                   Buildroot 2021.02.12
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.28.4
	  Kube-Proxy Version:         v1.28.4
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5d77478584-kqd4h         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         24s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         33s
	  gcp-auth                    gcp-auth-d4c87556c-2z7zk                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m55s
	  headlamp                    headlamp-777fd4b855-llj7s                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         45s
	  kube-system                 coredns-5dd5756b68-mlpvm                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     3m4s
	  kube-system                 etcd-addons-024000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         3m17s
	  kube-system                 kube-apiserver-addons-024000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m17s
	  kube-system                 kube-controller-manager-addons-024000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m17s
	  kube-system                 kube-proxy-f6k7h                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m5s
	  kube-system                 kube-scheduler-addons-024000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m17s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m3s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 3m2s   kube-proxy       
	  Normal  Starting                 3m18s  kubelet          Starting kubelet.
	  Normal  NodeAllocatableEnforced  3m17s  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  3m17s  kubelet          Node addons-024000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m17s  kubelet          Node addons-024000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m17s  kubelet          Node addons-024000 status is now: NodeHasSufficientPID
	  Normal  NodeReady                3m15s  kubelet          Node addons-024000 status is now: NodeReady
	  Normal  RegisteredNode           3m5s   node-controller  Node addons-024000 event: Registered Node addons-024000 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.063942] systemd-fstab-generator[721]: Ignoring "noauto" for root device
	[  +1.222399] systemd-fstab-generator[907]: Ignoring "noauto" for root device
	[  +0.070331] systemd-fstab-generator[918]: Ignoring "noauto" for root device
	[  +0.067685] systemd-fstab-generator[929]: Ignoring "noauto" for root device
	[  +0.065533] systemd-fstab-generator[940]: Ignoring "noauto" for root device
	[  +0.077989] systemd-fstab-generator[983]: Ignoring "noauto" for root device
	[  +2.575705] systemd-fstab-generator[1088]: Ignoring "noauto" for root device
	[  +2.613431] kauditd_printk_skb: 53 callbacks suppressed
	[  +2.553691] systemd-fstab-generator[1464]: Ignoring "noauto" for root device
	[  +4.622040] systemd-fstab-generator[2329]: Ignoring "noauto" for root device
	[ +14.633926] kauditd_printk_skb: 41 callbacks suppressed
	[  +8.072809] kauditd_printk_skb: 107 callbacks suppressed
	[  +6.669604] kauditd_printk_skb: 4 callbacks suppressed
	[  +4.787326] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.
	[Nov22 18:38] kauditd_printk_skb: 4 callbacks suppressed
	[ +27.295898] kauditd_printk_skb: 8 callbacks suppressed
	[Nov22 18:39] kauditd_printk_skb: 4 callbacks suppressed
	[  +5.613009] kauditd_printk_skb: 11 callbacks suppressed
	[  +5.633125] kauditd_printk_skb: 3 callbacks suppressed
	[ +15.199058] kauditd_printk_skb: 3 callbacks suppressed
	[ +13.714176] kauditd_printk_skb: 12 callbacks suppressed
	[  +5.138815] kauditd_printk_skb: 2 callbacks suppressed
	[Nov22 18:40] kauditd_printk_skb: 5 callbacks suppressed
	[ +15.837572] kauditd_printk_skb: 1 callbacks suppressed
	[ +15.817877] kauditd_printk_skb: 1 callbacks suppressed
	
	* 
	* ==> etcd [ddf4ff8547de] <==
	* {"level":"info","ts":"2023-11-22T18:37:21.620379Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-11-22T18:37:21.620419Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-11-22T18:37:21.62028Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:37:21.621071Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-11-22T18:37:21.621428Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:37:21.621507Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:37:21.620291Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-22T18:37:21.627808Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:37:21.630837Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}
	{"level":"info","ts":"2023-11-22T18:37:42.373459Z","caller":"traceutil/trace.go:171","msg":"trace[1843909113] linearizableReadLoop","detail":"{readStateIndex:558; appliedIndex:557; }","duration":"133.916291ms","start":"2023-11-22T18:37:42.239534Z","end":"2023-11-22T18:37:42.37345Z","steps":["trace[1843909113] 'read index received'  (duration: 132.365555ms)","trace[1843909113] 'applied index is now lower than readState.Index'  (duration: 1.550268ms)"],"step_count":2}
	{"level":"info","ts":"2023-11-22T18:37:42.373554Z","caller":"traceutil/trace.go:171","msg":"trace[996313259] transaction","detail":"{read_only:false; response_revision:541; number_of_response:1; }","duration":"165.181492ms","start":"2023-11-22T18:37:42.208369Z","end":"2023-11-22T18:37:42.37355Z","steps":["trace[996313259] 'process raft request'  (duration: 163.55961ms)"],"step_count":1}
	{"level":"warn","ts":"2023-11-22T18:37:42.373627Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"134.098052ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2023-11-22T18:37:42.373643Z","caller":"traceutil/trace.go:171","msg":"trace[1171069976] range","detail":"{range_begin:/registry/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io; range_end:; response_count:0; response_revision:541; }","duration":"134.122321ms","start":"2023-11-22T18:37:42.239517Z","end":"2023-11-22T18:37:42.37364Z","steps":["trace[1171069976] 'agreement among raft nodes before linearized reading'  (duration: 134.088813ms)"],"step_count":1}
	{"level":"info","ts":"2023-11-22T18:37:42.749968Z","caller":"traceutil/trace.go:171","msg":"trace[1161346039] transaction","detail":"{read_only:false; response_revision:618; number_of_response:1; }","duration":"100.262397ms","start":"2023-11-22T18:37:42.649685Z","end":"2023-11-22T18:37:42.749947Z","steps":["trace[1161346039] 'process raft request'  (duration: 99.17064ms)"],"step_count":1}
	{"level":"info","ts":"2023-11-22T18:37:42.750013Z","caller":"traceutil/trace.go:171","msg":"trace[1675601651] linearizableReadLoop","detail":"{readStateIndex:635; appliedIndex:634; }","duration":"100.287645ms","start":"2023-11-22T18:37:42.649723Z","end":"2023-11-22T18:37:42.75001Z","steps":["trace[1675601651] 'read index received'  (duration: 101.546µs)","trace[1675601651] 'applied index is now lower than readState.Index'  (duration: 100.185801ms)"],"step_count":2}
	{"level":"warn","ts":"2023-11-22T18:37:42.750091Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.367477ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/ingress-nginx\" ","response":"range_response_count:1 size:849"}
	{"level":"info","ts":"2023-11-22T18:37:42.750102Z","caller":"traceutil/trace.go:171","msg":"trace[1962501179] range","detail":"{range_begin:/registry/namespaces/ingress-nginx; range_end:; response_count:1; response_revision:619; }","duration":"100.384381ms","start":"2023-11-22T18:37:42.649715Z","end":"2023-11-22T18:37:42.750099Z","steps":["trace[1962501179] 'agreement among raft nodes before linearized reading'  (duration: 100.355641ms)"],"step_count":1}
	{"level":"warn","ts":"2023-11-22T18:38:06.547592Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"219.03374ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/gcp-auth/\" range_end:\"/registry/pods/gcp-auth0\" ","response":"range_response_count:3 size:10572"}
	{"level":"info","ts":"2023-11-22T18:38:06.547622Z","caller":"traceutil/trace.go:171","msg":"trace[1454092806] range","detail":"{range_begin:/registry/pods/gcp-auth/; range_end:/registry/pods/gcp-auth0; response_count:3; response_revision:858; }","duration":"219.069146ms","start":"2023-11-22T18:38:06.328547Z","end":"2023-11-22T18:38:06.547617Z","steps":["trace[1454092806] 'range keys from in-memory index tree'  (duration: 218.825806ms)"],"step_count":1}
	{"level":"warn","ts":"2023-11-22T18:38:06.547664Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"181.611479ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2023-11-22T18:38:06.547672Z","caller":"traceutil/trace.go:171","msg":"trace[570614362] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:858; }","duration":"181.630787ms","start":"2023-11-22T18:38:06.366039Z","end":"2023-11-22T18:38:06.54767Z","steps":["trace[570614362] 'range keys from in-memory index tree'  (duration: 181.571152ms)"],"step_count":1}
	{"level":"info","ts":"2023-11-22T18:38:14.851314Z","caller":"traceutil/trace.go:171","msg":"trace[2136015333] transaction","detail":"{read_only:false; response_revision:900; number_of_response:1; }","duration":"309.161564ms","start":"2023-11-22T18:38:14.542141Z","end":"2023-11-22T18:38:14.851303Z","steps":["trace[2136015333] 'process raft request'  (duration: 309.064773ms)"],"step_count":1}
	{"level":"warn","ts":"2023-11-22T18:38:14.851538Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-11-22T18:38:14.542136Z","time spent":"309.212002ms","remote":"127.0.0.1:34142","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":840,"response count":0,"response size":39,"request content":"compare:<target:MOD key:\"/registry/events/ingress-nginx/ingress-nginx-controller-7c6974c4d8-t6v9l.179a05de957b9303\" mod_revision:835 > success:<request_put:<key:\"/registry/events/ingress-nginx/ingress-nginx-controller-7c6974c4d8-t6v9l.179a05de957b9303\" value_size:733 lease:400974265489091883 >> failure:<request_range:<key:\"/registry/events/ingress-nginx/ingress-nginx-controller-7c6974c4d8-t6v9l.179a05de957b9303\" > >"}
	{"level":"warn","ts":"2023-11-22T18:38:54.484491Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"117.377909ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2023-11-22T18:38:54.484534Z","caller":"traceutil/trace.go:171","msg":"trace[1206289214] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1056; }","duration":"117.435164ms","start":"2023-11-22T18:38:54.367092Z","end":"2023-11-22T18:38:54.484527Z","steps":["trace[1206289214] 'range keys from in-memory index tree'  (duration: 117.333155ms)"],"step_count":1}
	
	* 
	* ==> gcp-auth [1a012b0988d3] <==
	* 2023/11/22 18:38:57 GCP Auth Webhook started!
	2023/11/22 18:39:08 Ready to marshal response ...
	2023/11/22 18:39:08 Ready to write response ...
	2023/11/22 18:39:11 Ready to marshal response ...
	2023/11/22 18:39:11 Ready to write response ...
	2023/11/22 18:39:17 Ready to marshal response ...
	2023/11/22 18:39:17 Ready to write response ...
	2023/11/22 18:39:17 Ready to marshal response ...
	2023/11/22 18:39:17 Ready to write response ...
	2023/11/22 18:39:26 Ready to marshal response ...
	2023/11/22 18:39:26 Ready to write response ...
	2023/11/22 18:39:38 Ready to marshal response ...
	2023/11/22 18:39:38 Ready to write response ...
	2023/11/22 18:39:57 Ready to marshal response ...
	2023/11/22 18:39:57 Ready to write response ...
	2023/11/22 18:39:57 Ready to marshal response ...
	2023/11/22 18:39:57 Ready to write response ...
	2023/11/22 18:39:57 Ready to marshal response ...
	2023/11/22 18:39:57 Ready to write response ...
	2023/11/22 18:40:09 Ready to marshal response ...
	2023/11/22 18:40:09 Ready to write response ...
	2023/11/22 18:40:18 Ready to marshal response ...
	2023/11/22 18:40:18 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  18:40:42 up 3 min,  0 users,  load average: 0.28, 0.29, 0.13
	Linux addons-024000 5.10.57 #1 SMP PREEMPT Thu Nov 16 15:24:01 UTC 2023 aarch64 GNU/Linux
	PRETTY_NAME="Buildroot 2021.02.12"
	
	* 
	* ==> kube-apiserver [f1b3c3425d21] <==
	* I1122 18:39:52.179876       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.179908       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1122 18:39:52.201715       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.202017       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1122 18:39:52.211461       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.211989       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1122 18:39:52.218727       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.218864       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1122 18:39:52.224291       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.224673       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I1122 18:39:52.228807       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I1122 18:39:52.228829       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W1122 18:39:53.202193       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W1122 18:39:53.229488       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W1122 18:39:53.234140       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I1122 18:39:57.961216       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.105.248.58"}
	I1122 18:40:08.123422       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	I1122 18:40:08.126502       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W1122 18:40:09.142358       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	I1122 18:40:09.394573       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I1122 18:40:09.504278       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.96.152.226"}
	I1122 18:40:12.558133       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I1122 18:40:18.736565       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.97.115.229"}
	E1122 18:40:34.637952       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	E1122 18:40:34.654349       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"ingress-nginx\" not found]"
	
	* 
	* ==> kube-controller-manager [59e338a3d7bc] <==
	* I1122 18:40:18.672012       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="8.41142ms"
	I1122 18:40:18.679415       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="7.324028ms"
	I1122 18:40:18.679461       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="22.875µs"
	I1122 18:40:18.683429       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="12.417µs"
	I1122 18:40:21.011725       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="21.125µs"
	W1122 18:40:22.014254       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1122 18:40:22.014271       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1122 18:40:22.020159       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="45.626µs"
	I1122 18:40:23.029270       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="24.251µs"
	W1122 18:40:23.741083       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1122 18:40:23.741107       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1122 18:40:25.846323       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1122 18:40:25.846352       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W1122 18:40:32.769375       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1122 18:40:32.769476       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I1122 18:40:34.579556       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
	I1122 18:40:34.579651       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
	I1122 18:40:34.579745       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-7c6974c4d8" duration="2.208µs"
	I1122 18:40:37.123622       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="23.75µs"
	I1122 18:40:37.663930       1 shared_informer.go:311] Waiting for caches to sync for resource quota
	I1122 18:40:37.663946       1 shared_informer.go:318] Caches are synced for resource quota
	I1122 18:40:38.078068       1 shared_informer.go:311] Waiting for caches to sync for garbage collector
	I1122 18:40:38.078083       1 shared_informer.go:318] Caches are synced for garbage collector
	W1122 18:40:41.720397       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E1122 18:40:41.720426       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	* 
	* ==> kube-proxy [e7f0e783d991] <==
	* I1122 18:37:39.314002       1 server_others.go:69] "Using iptables proxy"
	I1122 18:37:39.407496       1 node.go:141] Successfully retrieved node IP: 192.168.105.2
	I1122 18:37:39.460273       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
	I1122 18:37:39.460288       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
	I1122 18:37:39.461128       1 server_others.go:152] "Using iptables Proxier"
	I1122 18:37:39.461159       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I1122 18:37:39.461254       1 server.go:846] "Version info" version="v1.28.4"
	I1122 18:37:39.461260       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1122 18:37:39.462587       1 config.go:188] "Starting service config controller"
	I1122 18:37:39.462594       1 shared_informer.go:311] Waiting for caches to sync for service config
	I1122 18:37:39.462606       1 config.go:97] "Starting endpoint slice config controller"
	I1122 18:37:39.462607       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I1122 18:37:39.463693       1 config.go:315] "Starting node config controller"
	I1122 18:37:39.463697       1 shared_informer.go:311] Waiting for caches to sync for node config
	I1122 18:37:39.563329       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I1122 18:37:39.563361       1 shared_informer.go:318] Caches are synced for service config
	I1122 18:37:39.563905       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [fd18408ced2c] <==
	* W1122 18:37:22.626037       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1122 18:37:22.626082       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W1122 18:37:22.626160       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1122 18:37:22.626189       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W1122 18:37:22.626230       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1122 18:37:22.626249       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W1122 18:37:22.626276       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1122 18:37:22.626317       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W1122 18:37:22.626375       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E1122 18:37:22.626383       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W1122 18:37:23.433166       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1122 18:37:23.433185       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W1122 18:37:23.461805       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1122 18:37:23.461816       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W1122 18:37:23.494385       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1122 18:37:23.494393       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W1122 18:37:23.524122       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1122 18:37:23.524130       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W1122 18:37:23.575940       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E1122 18:37:23.575955       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W1122 18:37:23.605714       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1122 18:37:23.605800       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W1122 18:37:23.612555       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E1122 18:37:23.612648       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	I1122 18:37:24.022885       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* -- Journal begins at Wed 2023-11-22 18:37:06 UTC, ends at Wed 2023-11-22 18:40:42 UTC. --
	Nov 22 18:40:25 addons-024000 kubelet[2335]: I1122 18:40:25.133949    2335 scope.go:117] "RemoveContainer" containerID="9e2f7ef6094f7330711eb372cf9a5a5d09bf9d2f134688f8e9e7c807459dc08e"
	Nov 22 18:40:30 addons-024000 kubelet[2335]: I1122 18:40:30.044497    2335 scope.go:117] "RemoveContainer" containerID="9ac3e3f949632b9bddfa458446e8fddad80aadc49d72eb1556ffdc47160abc18"
	Nov 22 18:40:30 addons-024000 kubelet[2335]: E1122 18:40:30.044674    2335 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(690c9c59-db52-4d8c-bbc6-2351e5f316de)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="690c9c59-db52-4d8c-bbc6-2351e5f316de"
	Nov 22 18:40:34 addons-024000 kubelet[2335]: I1122 18:40:34.078779    2335 scope.go:117] "RemoveContainer" containerID="9ac3e3f949632b9bddfa458446e8fddad80aadc49d72eb1556ffdc47160abc18"
	Nov 22 18:40:34 addons-024000 kubelet[2335]: I1122 18:40:34.103746    2335 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s9lr\" (UniqueName: \"kubernetes.io/projected/690c9c59-db52-4d8c-bbc6-2351e5f316de-kube-api-access-8s9lr\") pod \"690c9c59-db52-4d8c-bbc6-2351e5f316de\" (UID: \"690c9c59-db52-4d8c-bbc6-2351e5f316de\") "
	Nov 22 18:40:34 addons-024000 kubelet[2335]: I1122 18:40:34.106367    2335 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690c9c59-db52-4d8c-bbc6-2351e5f316de-kube-api-access-8s9lr" (OuterVolumeSpecName: "kube-api-access-8s9lr") pod "690c9c59-db52-4d8c-bbc6-2351e5f316de" (UID: "690c9c59-db52-4d8c-bbc6-2351e5f316de"). InnerVolumeSpecName "kube-api-access-8s9lr". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Nov 22 18:40:34 addons-024000 kubelet[2335]: I1122 18:40:34.204399    2335 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-8s9lr\" (UniqueName: \"kubernetes.io/projected/690c9c59-db52-4d8c-bbc6-2351e5f316de-kube-api-access-8s9lr\") on node \"addons-024000\" DevicePath \"\""
	Nov 22 18:40:35 addons-024000 kubelet[2335]: I1122 18:40:35.047751    2335 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="690c9c59-db52-4d8c-bbc6-2351e5f316de" path="/var/lib/kubelet/pods/690c9c59-db52-4d8c-bbc6-2351e5f316de/volumes"
	Nov 22 18:40:35 addons-024000 kubelet[2335]: I1122 18:40:35.047951    2335 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c859b21e-17c8-4ef9-8d48-273042fc6a24" path="/var/lib/kubelet/pods/c859b21e-17c8-4ef9-8d48-273042fc6a24/volumes"
	Nov 22 18:40:35 addons-024000 kubelet[2335]: I1122 18:40:35.048099    2335 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccb83d20-ac71-4870-8aaa-cd40ce0165f6" path="/var/lib/kubelet/pods/ccb83d20-ac71-4870-8aaa-cd40ce0165f6/volumes"
	Nov 22 18:40:36 addons-024000 kubelet[2335]: I1122 18:40:36.044534    2335 scope.go:117] "RemoveContainer" containerID="21794b78443c70935af694cf50cf914d14109e442b67a031e92a6f9e13d85439"
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.118306    2335 scope.go:117] "RemoveContainer" containerID="21794b78443c70935af694cf50cf914d14109e442b67a031e92a6f9e13d85439"
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.118523    2335 scope.go:117] "RemoveContainer" containerID="2e179095073ef568cd891f91572355b72e958b07b12326cbb37473bb629fda25"
	Nov 22 18:40:37 addons-024000 kubelet[2335]: E1122 18:40:37.118650    2335 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5d77478584-kqd4h_default(5a434105-4d72-4935-a135-5aba20d266f7)\"" pod="default/hello-world-app-5d77478584-kqd4h" podUID="5a434105-4d72-4935-a135-5aba20d266f7"
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.928281    2335 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-webhook-cert\") pod \"0bec8f7c-8c20-4ede-90c3-f3e8e54689ae\" (UID: \"0bec8f7c-8c20-4ede-90c3-f3e8e54689ae\") "
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.928308    2335 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp9cq\" (UniqueName: \"kubernetes.io/projected/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-kube-api-access-kp9cq\") pod \"0bec8f7c-8c20-4ede-90c3-f3e8e54689ae\" (UID: \"0bec8f7c-8c20-4ede-90c3-f3e8e54689ae\") "
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.932626    2335 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-kube-api-access-kp9cq" (OuterVolumeSpecName: "kube-api-access-kp9cq") pod "0bec8f7c-8c20-4ede-90c3-f3e8e54689ae" (UID: "0bec8f7c-8c20-4ede-90c3-f3e8e54689ae"). InnerVolumeSpecName "kube-api-access-kp9cq". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Nov 22 18:40:37 addons-024000 kubelet[2335]: I1122 18:40:37.932665    2335 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0bec8f7c-8c20-4ede-90c3-f3e8e54689ae" (UID: "0bec8f7c-8c20-4ede-90c3-f3e8e54689ae"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Nov 22 18:40:38 addons-024000 kubelet[2335]: I1122 18:40:38.029083    2335 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-webhook-cert\") on node \"addons-024000\" DevicePath \"\""
	Nov 22 18:40:38 addons-024000 kubelet[2335]: I1122 18:40:38.029099    2335 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-kp9cq\" (UniqueName: \"kubernetes.io/projected/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae-kube-api-access-kp9cq\") on node \"addons-024000\" DevicePath \"\""
	Nov 22 18:40:38 addons-024000 kubelet[2335]: I1122 18:40:38.124683    2335 scope.go:117] "RemoveContainer" containerID="6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932"
	Nov 22 18:40:38 addons-024000 kubelet[2335]: I1122 18:40:38.133866    2335 scope.go:117] "RemoveContainer" containerID="6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932"
	Nov 22 18:40:38 addons-024000 kubelet[2335]: E1122 18:40:38.134171    2335 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932" containerID="6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932"
	Nov 22 18:40:38 addons-024000 kubelet[2335]: I1122 18:40:38.134200    2335 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932"} err="failed to get container status \"6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932\": rpc error: code = Unknown desc = Error response from daemon: No such container: 6a9431ee647ee159769696f6979c096dd159dd430ee0cad752a487e167387932"
	Nov 22 18:40:39 addons-024000 kubelet[2335]: I1122 18:40:39.048537    2335 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0bec8f7c-8c20-4ede-90c3-f3e8e54689ae" path="/var/lib/kubelet/pods/0bec8f7c-8c20-4ede-90c3-f3e8e54689ae/volumes"
	
	* 
	* ==> storage-provisioner [1c564c842f20] <==
	* I1122 18:37:40.776064       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1122 18:37:40.781167       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1122 18:37:40.781197       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1122 18:37:40.784403       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1122 18:37:40.784471       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-024000_be69164c-bcc1-43cf-bf62-02a5ea8f7050!
	I1122 18:37:40.784501       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cbf2ec77-cec7-4d43-8900-600d63ad66f1", APIVersion:"v1", ResourceVersion:"450", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-024000_be69164c-bcc1-43cf-bf62-02a5ea8f7050 became leader
	I1122 18:37:40.884778       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-024000_be69164c-bcc1-43cf-bf62-02a5ea8f7050!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-024000 -n addons-024000
helpers_test.go:261: (dbg) Run:  kubectl --context addons-024000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (33.36s)

                                                
                                    
x
+
TestCertOptions (10.21s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-011000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-011000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.920141333s)

                                                
                                                
-- stdout --
	* [cert-options-011000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node cert-options-011000 in cluster cert-options-011000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-options-011000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-011000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-011000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-011000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-011000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 89 (81.5765ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-011000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-011000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 89
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-011000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-011000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-011000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 89 (42.922125ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-011000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-011000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 89
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-011000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2023-11-22 10:49:20.261085 -0800 PST m=+809.068306543
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-011000 -n cert-options-011000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-011000 -n cert-options-011000: exit status 7 (32.171417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-011000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-011000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-011000
--- FAIL: TestCertOptions (10.21s)

                                                
                                    
x
+
TestCertExpiration (195.49s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=3m --driver=qemu2 
E1122 10:49:07.851518    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (10.073883458s)

                                                
                                                
-- stdout --
	* [cert-expiration-403000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node cert-expiration-403000 in cluster cert-expiration-403000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "cert-expiration-403000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-403000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80
E1122 10:49:18.093556    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=8760h --driver=qemu2 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.230659625s)

                                                
                                                
-- stdout --
	* [cert-expiration-403000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node cert-expiration-403000 in cluster cert-expiration-403000
	* Restarting existing qemu2 VM for "cert-expiration-403000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-403000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-403000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-403000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-403000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node cert-expiration-403000 in cluster cert-expiration-403000
	* Restarting existing qemu2 VM for "cert-expiration-403000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "cert-expiration-403000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-403000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2023-11-22 10:52:20.306831 -0800 PST m=+989.117272626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-403000 -n cert-expiration-403000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-403000 -n cert-expiration-403000: exit status 7 (71.943291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-403000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-403000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-403000
--- FAIL: TestCertExpiration (195.49s)

                                                
                                    
x
+
TestDockerFlags (10.24s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-483000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 
E1122 10:49:00.168955    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:49:02.729376    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-483000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.981651625s)

                                                
                                                
-- stdout --
	* [docker-flags-483000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node docker-flags-483000 in cluster docker-flags-483000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "docker-flags-483000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:48:59.976132    3012 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:48:59.976270    3012 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:59.976273    3012 out.go:309] Setting ErrFile to fd 2...
	I1122 10:48:59.976276    3012 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:59.976401    3012 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:48:59.977443    3012 out.go:303] Setting JSON to false
	I1122 10:48:59.993337    3012 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1109,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:48:59.993418    3012 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:48:59.999386    3012 out.go:177] * [docker-flags-483000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:49:00.007370    3012 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:49:00.012450    3012 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:49:00.007438    3012 notify.go:220] Checking for updates...
	I1122 10:49:00.018401    3012 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:49:00.022429    3012 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:49:00.025347    3012 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:49:00.028417    3012 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:49:00.031827    3012 config.go:182] Loaded profile config "force-systemd-flag-060000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:49:00.031894    3012 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:49:00.031935    3012 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:49:00.036354    3012 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:49:00.043398    3012 start.go:298] selected driver: qemu2
	I1122 10:49:00.043404    3012 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:49:00.043412    3012 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:49:00.045807    3012 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:49:00.049358    3012 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:49:00.052502    3012 start_flags.go:926] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I1122 10:49:00.052560    3012 cni.go:84] Creating CNI manager for ""
	I1122 10:49:00.052567    3012 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:49:00.052571    3012 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:49:00.052577    3012 start_flags.go:323] config:
	{Name:docker-flags-483000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-483000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain
:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/ru
n/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:49:00.057134    3012 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:49:00.065367    3012 out.go:177] * Starting control plane node docker-flags-483000 in cluster docker-flags-483000
	I1122 10:49:00.069335    3012 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:49:00.069351    3012 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:49:00.069362    3012 cache.go:56] Caching tarball of preloaded images
	I1122 10:49:00.069421    3012 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:49:00.069428    3012 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:49:00.069506    3012 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/docker-flags-483000/config.json ...
	I1122 10:49:00.069523    3012 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/docker-flags-483000/config.json: {Name:mk0c8fe1be98828774c9417d4775fee7e99d9d54 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:49:00.069742    3012 start.go:365] acquiring machines lock for docker-flags-483000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:49:00.069774    3012 start.go:369] acquired machines lock for "docker-flags-483000" in 26.333µs
	I1122 10:49:00.069785    3012 start.go:93] Provisioning new machine with config: &{Name:docker-flags-483000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root
SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-483000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:49:00.069816    3012 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:49:00.078399    3012 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:49:00.096750    3012 start.go:159] libmachine.API.Create for "docker-flags-483000" (driver="qemu2")
	I1122 10:49:00.096781    3012 client.go:168] LocalClient.Create starting
	I1122 10:49:00.096861    3012 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:49:00.096890    3012 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:00.096902    3012 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:00.096957    3012 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:49:00.096980    3012 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:00.096987    3012 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:00.097339    3012 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:49:00.225457    3012 main.go:141] libmachine: Creating SSH key...
	I1122 10:49:00.367303    3012 main.go:141] libmachine: Creating Disk image...
	I1122 10:49:00.367309    3012 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:49:00.367510    3012 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:00.379970    3012 main.go:141] libmachine: STDOUT: 
	I1122 10:49:00.379986    3012 main.go:141] libmachine: STDERR: 
	I1122 10:49:00.380043    3012 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2 +20000M
	I1122 10:49:00.390521    3012 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:49:00.390541    3012 main.go:141] libmachine: STDERR: 
	I1122 10:49:00.390554    3012 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:00.390560    3012 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:49:00.390595    3012 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1e:d1:43:ca:f3:4a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:00.392279    3012 main.go:141] libmachine: STDOUT: 
	I1122 10:49:00.392294    3012 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:49:00.392310    3012 client.go:171] LocalClient.Create took 295.528208ms
	I1122 10:49:02.394502    3012 start.go:128] duration metric: createHost completed in 2.324693291s
	I1122 10:49:02.394571    3012 start.go:83] releasing machines lock for "docker-flags-483000", held for 2.324828834s
	W1122 10:49:02.394693    3012 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:49:02.412821    3012 out.go:177] * Deleting "docker-flags-483000" in qemu2 ...
	W1122 10:49:02.432559    3012 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:49:02.432583    3012 start.go:706] Will try again in 5 seconds ...
	I1122 10:49:07.434735    3012 start.go:365] acquiring machines lock for docker-flags-483000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:49:07.460699    3012 start.go:369] acquired machines lock for "docker-flags-483000" in 25.832375ms
	I1122 10:49:07.460860    3012 start.go:93] Provisioning new machine with config: &{Name:docker-flags-483000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root
SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-483000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:49:07.461109    3012 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:49:07.470845    3012 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:49:07.522297    3012 start.go:159] libmachine.API.Create for "docker-flags-483000" (driver="qemu2")
	I1122 10:49:07.522353    3012 client.go:168] LocalClient.Create starting
	I1122 10:49:07.522489    3012 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:49:07.522550    3012 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:07.522569    3012 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:07.522638    3012 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:49:07.522682    3012 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:07.522693    3012 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:07.523211    3012 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:49:07.668113    3012 main.go:141] libmachine: Creating SSH key...
	I1122 10:49:07.861015    3012 main.go:141] libmachine: Creating Disk image...
	I1122 10:49:07.861026    3012 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:49:07.861235    3012 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:07.873994    3012 main.go:141] libmachine: STDOUT: 
	I1122 10:49:07.874021    3012 main.go:141] libmachine: STDERR: 
	I1122 10:49:07.874079    3012 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2 +20000M
	I1122 10:49:07.884620    3012 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:49:07.884635    3012 main.go:141] libmachine: STDERR: 
	I1122 10:49:07.884660    3012 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:07.884674    3012 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:49:07.884720    3012 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/qemu.pid -device virtio-net-pci,netdev=net0,mac=66:8e:c4:e1:b1:7d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/docker-flags-483000/disk.qcow2
	I1122 10:49:07.886413    3012 main.go:141] libmachine: STDOUT: 
	I1122 10:49:07.886429    3012 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:49:07.886444    3012 client.go:171] LocalClient.Create took 364.090875ms
	I1122 10:49:09.888582    3012 start.go:128] duration metric: createHost completed in 2.42746625s
	I1122 10:49:09.888626    3012 start.go:83] releasing machines lock for "docker-flags-483000", held for 2.427941375s
	W1122 10:49:09.889043    3012 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-483000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-483000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:49:09.897568    3012 out.go:177] 
	W1122 10:49:09.902622    3012 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:49:09.902748    3012 out.go:239] * 
	* 
	W1122 10:49:09.905718    3012 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:49:09.913497    3012 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-483000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-483000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-483000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 89 (78.65925ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p docker-flags-483000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-483000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 89
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-483000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-483000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-483000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-483000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 89 (45.600042ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p docker-flags-483000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-483000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 89
docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-483000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-483000\"\n"
panic.go:523: *** TestDockerFlags FAILED at 2023-11-22 10:49:10.054965 -0800 PST m=+798.862004626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-483000 -n docker-flags-483000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-483000 -n docker-flags-483000: exit status 7 (30.786208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-483000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-483000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-483000
--- FAIL: TestDockerFlags (10.24s)

                                                
                                    
x
+
TestForceSystemdFlag (11.86s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-060000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 
E1122 10:48:57.596522    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.602871    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.615049    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.637132    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.677810    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.759928    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:57.922142    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:58.244386    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:48:58.506132    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:48:58.886691    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-060000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (11.632784208s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-060000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node force-systemd-flag-060000 in cluster force-systemd-flag-060000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-flag-060000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:48:53.169985    2988 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:48:53.170135    2988 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:53.170138    2988 out.go:309] Setting ErrFile to fd 2...
	I1122 10:48:53.170141    2988 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:53.170274    2988 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:48:53.171318    2988 out.go:303] Setting JSON to false
	I1122 10:48:53.187135    2988 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1103,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:48:53.187220    2988 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:48:53.192372    2988 out.go:177] * [force-systemd-flag-060000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:48:53.205244    2988 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:48:53.200232    2988 notify.go:220] Checking for updates...
	I1122 10:48:53.213073    2988 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:48:53.216232    2988 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:48:53.219231    2988 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:48:53.222272    2988 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:48:53.225221    2988 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:48:53.228589    2988 config.go:182] Loaded profile config "force-systemd-env-569000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:48:53.228664    2988 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:48:53.228706    2988 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:48:53.233189    2988 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:48:53.240257    2988 start.go:298] selected driver: qemu2
	I1122 10:48:53.240265    2988 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:48:53.240271    2988 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:48:53.242437    2988 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:48:53.245259    2988 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:48:53.248316    2988 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1122 10:48:53.248390    2988 cni.go:84] Creating CNI manager for ""
	I1122 10:48:53.248399    2988 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:48:53.248411    2988 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:48:53.248417    2988 start_flags.go:323] config:
	{Name:force-systemd-flag-060000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-060000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:48:53.252668    2988 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:53.260090    2988 out.go:177] * Starting control plane node force-systemd-flag-060000 in cluster force-systemd-flag-060000
	I1122 10:48:53.264136    2988 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:48:53.264150    2988 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:48:53.264156    2988 cache.go:56] Caching tarball of preloaded images
	I1122 10:48:53.264207    2988 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:48:53.264216    2988 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:48:53.264284    2988 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/force-systemd-flag-060000/config.json ...
	I1122 10:48:53.264295    2988 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/force-systemd-flag-060000/config.json: {Name:mka11c8b9ea7439fc5d070a228635698807e9947 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:48:53.264503    2988 start.go:365] acquiring machines lock for force-systemd-flag-060000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:53.264539    2988 start.go:369] acquired machines lock for "force-systemd-flag-060000" in 25.834µs
	I1122 10:48:53.264552    2988 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-060000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-060000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount
UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:53.264584    2988 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:53.273239    2988 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:48:53.289733    2988 start.go:159] libmachine.API.Create for "force-systemd-flag-060000" (driver="qemu2")
	I1122 10:48:53.289764    2988 client.go:168] LocalClient.Create starting
	I1122 10:48:53.289833    2988 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:53.289860    2988 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:53.289873    2988 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:53.289911    2988 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:53.289938    2988 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:53.289945    2988 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:53.290296    2988 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:53.416623    2988 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:53.555296    2988 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:53.555303    2988 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:53.555495    2988 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:48:53.567721    2988 main.go:141] libmachine: STDOUT: 
	I1122 10:48:53.567740    2988 main.go:141] libmachine: STDERR: 
	I1122 10:48:53.567803    2988 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2 +20000M
	I1122 10:48:53.578113    2988 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:53.578129    2988 main.go:141] libmachine: STDERR: 
	I1122 10:48:53.578147    2988 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:48:53.578153    2988 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:53.578187    2988 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:af:8a:d0:ce:0b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:48:53.579838    2988 main.go:141] libmachine: STDOUT: 
	I1122 10:48:53.579856    2988 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:53.579876    2988 client.go:171] LocalClient.Create took 290.112542ms
	I1122 10:48:55.582021    2988 start.go:128] duration metric: createHost completed in 2.317457834s
	I1122 10:48:55.582071    2988 start.go:83] releasing machines lock for "force-systemd-flag-060000", held for 2.317560667s
	W1122 10:48:55.582137    2988 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:55.593385    2988 out.go:177] * Deleting "force-systemd-flag-060000" in qemu2 ...
	W1122 10:48:55.617549    2988 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:55.617587    2988 start.go:706] Will try again in 5 seconds ...
	I1122 10:49:00.619725    2988 start.go:365] acquiring machines lock for force-systemd-flag-060000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:49:02.394770    2988 start.go:369] acquired machines lock for "force-systemd-flag-060000" in 1.774906833s
	I1122 10:49:02.394897    2988 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-060000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-060000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount
UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:49:02.395227    2988 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:49:02.403916    2988 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:49:02.451817    2988 start.go:159] libmachine.API.Create for "force-systemd-flag-060000" (driver="qemu2")
	I1122 10:49:02.451882    2988 client.go:168] LocalClient.Create starting
	I1122 10:49:02.452025    2988 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:49:02.452086    2988 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:02.452111    2988 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:02.452179    2988 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:49:02.452221    2988 main.go:141] libmachine: Decoding PEM data...
	I1122 10:49:02.452237    2988 main.go:141] libmachine: Parsing certificate...
	I1122 10:49:02.452886    2988 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:49:02.597856    2988 main.go:141] libmachine: Creating SSH key...
	I1122 10:49:02.702993    2988 main.go:141] libmachine: Creating Disk image...
	I1122 10:49:02.703004    2988 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:49:02.703192    2988 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:49:02.715431    2988 main.go:141] libmachine: STDOUT: 
	I1122 10:49:02.715457    2988 main.go:141] libmachine: STDERR: 
	I1122 10:49:02.715522    2988 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2 +20000M
	I1122 10:49:02.725819    2988 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:49:02.725841    2988 main.go:141] libmachine: STDERR: 
	I1122 10:49:02.725858    2988 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:49:02.725868    2988 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:49:02.725916    2988 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:80:2a:88:87:e3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-flag-060000/disk.qcow2
	I1122 10:49:02.727674    2988 main.go:141] libmachine: STDOUT: 
	I1122 10:49:02.727688    2988 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:49:02.727700    2988 client.go:171] LocalClient.Create took 275.818209ms
	I1122 10:49:04.729845    2988 start.go:128] duration metric: createHost completed in 2.334631166s
	I1122 10:49:04.729898    2988 start.go:83] releasing machines lock for "force-systemd-flag-060000", held for 2.335100709s
	W1122 10:49:04.730309    2988 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-060000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-060000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:49:04.737159    2988 out.go:177] 
	W1122 10:49:04.745228    2988 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:49:04.745261    2988 out.go:239] * 
	* 
	W1122 10:49:04.748164    2988 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:49:04.758992    2988 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-060000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-060000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-060000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (79.505208ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p force-systemd-flag-060000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-060000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2023-11-22 10:49:04.85546 -0800 PST m=+793.662405876
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-060000 -n force-systemd-flag-060000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-060000 -n force-systemd-flag-060000: exit status 7 (35.213041ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-060000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-060000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-060000
--- FAIL: TestForceSystemdFlag (11.86s)

                                                
                                    
x
+
TestForceSystemdEnv (9.93s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-569000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-569000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.712607083s)

                                                
                                                
-- stdout --
	* [force-systemd-env-569000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node force-systemd-env-569000 in cluster force-systemd-env-569000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "force-systemd-env-569000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:48:50.051228    2967 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:48:50.051386    2967 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:50.051389    2967 out.go:309] Setting ErrFile to fd 2...
	I1122 10:48:50.051392    2967 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:50.051510    2967 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:48:50.052679    2967 out.go:303] Setting JSON to false
	I1122 10:48:50.069793    2967 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1100,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:48:50.069877    2967 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:48:50.075496    2967 out.go:177] * [force-systemd-env-569000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:48:50.082518    2967 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:48:50.085549    2967 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:48:50.082559    2967 notify.go:220] Checking for updates...
	I1122 10:48:50.091478    2967 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:48:50.094584    2967 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:48:50.097432    2967 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:48:50.100476    2967 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I1122 10:48:50.103817    2967 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:48:50.103870    2967 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:48:50.108407    2967 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:48:50.115448    2967 start.go:298] selected driver: qemu2
	I1122 10:48:50.115454    2967 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:48:50.115459    2967 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:48:50.117697    2967 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:48:50.120480    2967 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:48:50.123533    2967 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1122 10:48:50.123564    2967 cni.go:84] Creating CNI manager for ""
	I1122 10:48:50.123571    2967 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:48:50.123576    2967 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:48:50.123581    2967 start_flags.go:323] config:
	{Name:force-systemd-env-569000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-569000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont
ainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:48:50.127849    2967 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:50.135465    2967 out.go:177] * Starting control plane node force-systemd-env-569000 in cluster force-systemd-env-569000
	I1122 10:48:50.139546    2967 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:48:50.139597    2967 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:48:50.139609    2967 cache.go:56] Caching tarball of preloaded images
	I1122 10:48:50.139693    2967 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:48:50.139700    2967 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:48:50.139785    2967 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/force-systemd-env-569000/config.json ...
	I1122 10:48:50.139797    2967 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/force-systemd-env-569000/config.json: {Name:mk9a437ad16225c15e594bed4064ad8ceff41b92 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:48:50.140034    2967 start.go:365] acquiring machines lock for force-systemd-env-569000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:50.140078    2967 start.go:369] acquired machines lock for "force-systemd-env-569000" in 23.25µs
	I1122 10:48:50.140088    2967 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-569000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-569000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:50.140119    2967 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:50.143458    2967 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:48:50.160133    2967 start.go:159] libmachine.API.Create for "force-systemd-env-569000" (driver="qemu2")
	I1122 10:48:50.160185    2967 client.go:168] LocalClient.Create starting
	I1122 10:48:50.160253    2967 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:50.160284    2967 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:50.160294    2967 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:50.160335    2967 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:50.160355    2967 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:50.160364    2967 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:50.160775    2967 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:50.291009    2967 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:50.353658    2967 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:50.353668    2967 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:50.353889    2967 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:50.366651    2967 main.go:141] libmachine: STDOUT: 
	I1122 10:48:50.366679    2967 main.go:141] libmachine: STDERR: 
	I1122 10:48:50.366746    2967 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2 +20000M
	I1122 10:48:50.378169    2967 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:50.378195    2967 main.go:141] libmachine: STDERR: 
	I1122 10:48:50.378211    2967 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:50.378216    2967 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:50.378249    2967 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:31:49:10:f2:dd -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:50.380046    2967 main.go:141] libmachine: STDOUT: 
	I1122 10:48:50.380062    2967 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:50.380080    2967 client.go:171] LocalClient.Create took 219.89375ms
	I1122 10:48:52.382263    2967 start.go:128] duration metric: createHost completed in 2.242149541s
	I1122 10:48:52.382373    2967 start.go:83] releasing machines lock for "force-systemd-env-569000", held for 2.24232425s
	W1122 10:48:52.382440    2967 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:52.389790    2967 out.go:177] * Deleting "force-systemd-env-569000" in qemu2 ...
	W1122 10:48:52.413139    2967 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:52.413180    2967 start.go:706] Will try again in 5 seconds ...
	I1122 10:48:57.415258    2967 start.go:365] acquiring machines lock for force-systemd-env-569000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:57.415670    2967 start.go:369] acquired machines lock for "force-systemd-env-569000" in 325.167µs
	I1122 10:48:57.415801    2967 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-569000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-569000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:57.416007    2967 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:57.425602    2967 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1122 10:48:57.473251    2967 start.go:159] libmachine.API.Create for "force-systemd-env-569000" (driver="qemu2")
	I1122 10:48:57.473294    2967 client.go:168] LocalClient.Create starting
	I1122 10:48:57.473423    2967 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:57.473487    2967 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:57.473504    2967 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:57.473560    2967 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:57.473603    2967 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:57.473618    2967 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:57.474747    2967 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:57.615165    2967 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:57.662511    2967 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:57.662517    2967 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:57.662707    2967 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:57.674647    2967 main.go:141] libmachine: STDOUT: 
	I1122 10:48:57.674666    2967 main.go:141] libmachine: STDERR: 
	I1122 10:48:57.674730    2967 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2 +20000M
	I1122 10:48:57.685217    2967 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:57.685232    2967 main.go:141] libmachine: STDERR: 
	I1122 10:48:57.685249    2967 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:57.685254    2967 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:57.685297    2967 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:68:3c:92:b7:86 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/force-systemd-env-569000/disk.qcow2
	I1122 10:48:57.687111    2967 main.go:141] libmachine: STDOUT: 
	I1122 10:48:57.687127    2967 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:57.687138    2967 client.go:171] LocalClient.Create took 213.843459ms
	I1122 10:48:59.689281    2967 start.go:128] duration metric: createHost completed in 2.273254542s
	I1122 10:48:59.689363    2967 start.go:83] releasing machines lock for "force-systemd-env-569000", held for 2.27370475s
	W1122 10:48:59.689762    2967 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-569000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-569000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:59.698444    2967 out.go:177] 
	W1122 10:48:59.704468    2967 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:48:59.704496    2967 out.go:239] * 
	* 
	W1122 10:48:59.707093    2967 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:48:59.716389    2967 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-569000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-569000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-569000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (78.433958ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p force-systemd-env-569000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-569000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2023-11-22 10:48:59.812576 -0800 PST m=+788.619432501
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-569000 -n force-systemd-env-569000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-569000 -n force-systemd-env-569000: exit status 7 (35.47825ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-569000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-569000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-569000
--- FAIL: TestForceSystemdEnv (9.93s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (29.98s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-902000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-902000 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-7799dfb7c6-tqcz7" [ff3ee5f5-3206-414f-9bde-5aeb9bc318fe] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
E1122 10:44:19.140925    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
helpers_test.go:344: "hello-node-connect-7799dfb7c6-tqcz7" [ff3ee5f5-3206-414f-9bde-5aeb9bc318fe] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.006971792s
functional_test.go:1648: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.105.4:31613
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1660: error fetching http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1680: failed to fetch http://192.168.105.4:31613: Get "http://192.168.105.4:31613": dial tcp 192.168.105.4:31613: connect: connection refused
functional_test.go:1597: service test failed - dumping debug information
functional_test.go:1598: -----------------------service failure post-mortem--------------------------------
functional_test.go:1601: (dbg) Run:  kubectl --context functional-902000 describe po hello-node-connect
functional_test.go:1605: hello-node pod describe:
Name:             hello-node-connect-7799dfb7c6-tqcz7
Namespace:        default
Priority:         0
Service Account:  default
Node:             functional-902000/192.168.105.4
Start Time:       Wed, 22 Nov 2023 10:44:17 -0800
Labels:           app=hello-node-connect
pod-template-hash=7799dfb7c6
Annotations:      <none>
Status:           Running
IP:               10.244.0.8
IPs:
IP:           10.244.0.8
Controlled By:  ReplicaSet/hello-node-connect-7799dfb7c6
Containers:
echoserver-arm:
Container ID:   docker://9dd0adb4a370f77a6dc8b69ca98c6c48b713d9eb0ab4c06952470cfdc0dcafea
Image:          registry.k8s.io/echoserver-arm:1.8
Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
Port:           <none>
Host Port:      <none>
State:          Terminated
Reason:       Error
Exit Code:    1
Started:      Wed, 22 Nov 2023 10:44:33 -0800
Finished:     Wed, 22 Nov 2023 10:44:33 -0800
Last State:     Terminated
Reason:       Error
Exit Code:    1
Started:      Wed, 22 Nov 2023 10:44:19 -0800
Finished:     Wed, 22 Nov 2023 10:44:19 -0800
Ready:          False
Restart Count:  2
Environment:    <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-g6ws7 (ro)
Conditions:
Type              Status
Initialized       True 
Ready             False 
ContainersReady   False 
PodScheduled      True 
Volumes:
kube-api-access-g6ws7:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason     Age                From               Message
----     ------     ----               ----               -------
Normal   Scheduled  29s                default-scheduler  Successfully assigned default/hello-node-connect-7799dfb7c6-tqcz7 to functional-902000
Normal   Pulled     13s (x3 over 28s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine
Normal   Created    13s (x3 over 28s)  kubelet            Created container echoserver-arm
Normal   Started    13s (x3 over 28s)  kubelet            Started container echoserver-arm
Warning  BackOff    12s (x2 over 26s)  kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-7799dfb7c6-tqcz7_default(ff3ee5f5-3206-414f-9bde-5aeb9bc318fe)

                                                
                                                
functional_test.go:1607: (dbg) Run:  kubectl --context functional-902000 logs -l app=hello-node-connect
functional_test.go:1611: hello-node logs:
exec /usr/sbin/nginx: exec format error
functional_test.go:1613: (dbg) Run:  kubectl --context functional-902000 describe svc hello-node-connect
functional_test.go:1617: hello-node svc describe:
Name:                     hello-node-connect
Namespace:                default
Labels:                   app=hello-node-connect
Annotations:              <none>
Selector:                 app=hello-node-connect
Type:                     NodePort
IP Family Policy:         SingleStack
IP Families:              IPv4
IP:                       10.111.71.227
IPs:                      10.111.71.227
Port:                     <unset>  8080/TCP
TargetPort:               8080/TCP
NodePort:                 <unset>  31613/TCP
Endpoints:                
Session Affinity:         None
External Traffic Policy:  Cluster
Events:                   <none>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-902000 -n functional-902000
helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 logs -n 25
helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |-----------|---------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	|  Command  |                                                        Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |
	|-----------|---------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001:/mount-9p     |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | -T /mount-9p | grep 9p                                                                                              |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -T /mount-9p | grep 9p                                                                                              |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh -- ls                                                                                         | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -la /mount-9p                                                                                                       |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh cat                                                                                           | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | /mount-9p/test-1700678679292187000                                                                                  |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh stat                                                                                          | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | /mount-9p/created-by-test                                                                                           |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh stat                                                                                          | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | /mount-9p/created-by-pod                                                                                            |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh sudo                                                                                          | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | umount -f /mount-9p                                                                                                 |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | -T /mount-9p | grep 9p                                                                                              |                   |         |         |                     |                     |
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port589573059/001:/mount-9p |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1 --port 46464                                                                                 |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -T /mount-9p | grep 9p                                                                                              |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh -- ls                                                                                         | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -la /mount-9p                                                                                                       |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh sudo                                                                                          | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | umount -f /mount-9p                                                                                                 |                   |         |         |                     |                     |
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount1  |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount3  |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount2  |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | -T /mount1                                                                                                          |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -T /mount1                                                                                                          |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -T /mount2                                                                                                          |                   |         |         |                     |                     |
	| ssh       | functional-902000 ssh findmnt                                                                                       | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST | 22 Nov 23 10:44 PST |
	|           | -T /mount3                                                                                                          |                   |         |         |                     |                     |
	| mount     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | --kill=true                                                                                                         |                   |         |         |                     |                     |
	| start     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | --dry-run --memory                                                                                                  |                   |         |         |                     |                     |
	|           | 250MB --alsologtostderr                                                                                             |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                      |                   |         |         |                     |                     |
	| start     | -p functional-902000 --dry-run                                                                                      | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                      |                   |         |         |                     |                     |
	| start     | -p functional-902000                                                                                                | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | --dry-run --memory                                                                                                  |                   |         |         |                     |                     |
	|           | 250MB --alsologtostderr                                                                                             |                   |         |         |                     |                     |
	|           | --driver=qemu2                                                                                                      |                   |         |         |                     |                     |
	| dashboard | --url --port 36195                                                                                                  | functional-902000 | jenkins | v1.32.0 | 22 Nov 23 10:44 PST |                     |
	|           | -p functional-902000                                                                                                |                   |         |         |                     |                     |
	|           | --alsologtostderr -v=1                                                                                              |                   |         |         |                     |                     |
	|-----------|---------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/22 10:44:46
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.21.4 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1122 10:44:46.786814    2251 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:44:46.786976    2251 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.786980    2251 out.go:309] Setting ErrFile to fd 2...
	I1122 10:44:46.786982    2251 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.787126    2251 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:44:46.788471    2251 out.go:303] Setting JSON to false
	I1122 10:44:46.806802    2251 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":856,"bootTime":1700677830,"procs":452,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:44:46.806894    2251 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:44:46.809900    2251 out.go:177] * [functional-902000] minikube v1.32.0 sur Darwin 14.1.1 (arm64)
	I1122 10:44:46.817245    2251 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:44:46.817372    2251 notify.go:220] Checking for updates...
	I1122 10:44:46.824735    2251 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:44:46.827795    2251 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:44:46.833770    2251 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:44:46.837768    2251 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:44:46.840821    2251 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:44:46.844066    2251 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:44:46.844315    2251 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:44:46.848749    2251 out.go:177] * Utilisation du pilote qemu2 basé sur le profil existant
	I1122 10:44:46.854754    2251 start.go:298] selected driver: qemu2
	I1122 10:44:46.854761    2251 start.go:902] validating driver "qemu2" against &{Name:functional-902000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:functional-902000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:44:46.854819    2251 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:44:46.861805    2251 out.go:177] 
	W1122 10:44:46.865845    2251 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1122 10:44:46.868808    2251 out.go:177] 
	
	* 
	* ==> Docker <==
	* -- Journal begins at Wed 2023-11-22 18:42:00 UTC, ends at Wed 2023-11-22 18:44:47 UTC. --
	Nov 22 18:44:40 functional-902000 dockerd[6660]: time="2023-11-22T18:44:40.264671163Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Nov 22 18:44:40 functional-902000 dockerd[6660]: time="2023-11-22T18:44:40.264677246Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:44:40 functional-902000 cri-dockerd[7013]: time="2023-11-22T18:44:40Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"
	Nov 22 18:44:41 functional-902000 cri-dockerd[7013]: time="2023-11-22T18:44:41Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/busybox:1.28.4-glibc: Status: Downloaded newer image for gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.755658092Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.755687966Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.755696591Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.755702633Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:44:41 functional-902000 dockerd[6652]: time="2023-11-22T18:44:41.801925431Z" level=info msg="ignoring event" container=efa24a741439320300fee3b34b726d466fb1b986da723bc5cb8c32d1e766cd61 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.802176508Z" level=info msg="shim disconnected" id=efa24a741439320300fee3b34b726d466fb1b986da723bc5cb8c32d1e766cd61 namespace=moby
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.802225341Z" level=warning msg="cleaning up after shim disconnected" id=efa24a741439320300fee3b34b726d466fb1b986da723bc5cb8c32d1e766cd61 namespace=moby
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.802229965Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:44:41 functional-902000 dockerd[6660]: time="2023-11-22T18:44:41.807335263Z" level=warning msg="cleanup warnings time=\"2023-11-22T18:44:41Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=moby
	Nov 22 18:44:43 functional-902000 dockerd[6652]: time="2023-11-22T18:44:43.434295366Z" level=info msg="ignoring event" container=446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Nov 22 18:44:43 functional-902000 dockerd[6660]: time="2023-11-22T18:44:43.434401406Z" level=info msg="shim disconnected" id=446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7 namespace=moby
	Nov 22 18:44:43 functional-902000 dockerd[6660]: time="2023-11-22T18:44:43.434449738Z" level=warning msg="cleaning up after shim disconnected" id=446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7 namespace=moby
	Nov 22 18:44:43 functional-902000 dockerd[6660]: time="2023-11-22T18:44:43.434454988Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.855595659Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.855642742Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.855849154Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.855890028Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.893333632Z" level=info msg="shim disconnected" id=3c319f29f61b0d5d61a6651f6ea7153c9ae04499ee9fe31fcdc81855b374cd3d namespace=moby
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.893376964Z" level=warning msg="cleaning up after shim disconnected" id=3c319f29f61b0d5d61a6651f6ea7153c9ae04499ee9fe31fcdc81855b374cd3d namespace=moby
	Nov 22 18:44:45 functional-902000 dockerd[6660]: time="2023-11-22T18:44:45.893381464Z" level=info msg="cleaning up dead shim" namespace=moby
	Nov 22 18:44:45 functional-902000 dockerd[6652]: time="2023-11-22T18:44:45.893512128Z" level=info msg="ignoring event" container=3c319f29f61b0d5d61a6651f6ea7153c9ae04499ee9fe31fcdc81855b374cd3d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	3c319f29f61b0       72565bf5bbedf                                                                                         2 seconds ago        Exited              echoserver-arm            3                   798af9fc740ed       hello-node-759d89bdcc-mlp4x
	efa24a7414393       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   6 seconds ago        Exited              mount-munger              0                   446cc64d7c869       busybox-mount
	9dd0adb4a370f       72565bf5bbedf                                                                                         14 seconds ago       Exited              echoserver-arm            2                   f50dd5adb8d03       hello-node-connect-7799dfb7c6-tqcz7
	d80d271d344ab       nginx@sha256:10d1f5b58f74683ad34eb29287e07dab1e90f10af243f151bb50aa5dbb4d62ee                         15 seconds ago       Running             myfrontend                0                   6a9393dd1374f       sp-pod
	987bbde20df41       nginx@sha256:db353d0f0c479c91bd15e01fc68ed0f33d9c4c52f3415e63332c3d0bf7a4bb77                         36 seconds ago       Running             nginx                     0                   74fd9d9e1f1b3       nginx-svc
	7a8920518d6ed       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       2                   8b36e157a507e       storage-provisioner
	ed55819d5f025       97e04611ad434                                                                                         About a minute ago   Running             coredns                   2                   5fe159f450901       coredns-5dd5756b68-96b29
	0797337643d5d       3ca3ca488cf13                                                                                         About a minute ago   Running             kube-proxy                2                   53ed60f3c7787       kube-proxy-2n2gf
	1b75a12cee96a       05c284c929889                                                                                         About a minute ago   Running             kube-scheduler            2                   91a035c4752cc       kube-scheduler-functional-902000
	c344b026622e2       9961cbceaf234                                                                                         About a minute ago   Running             kube-controller-manager   2                   97ff9d342bbc4       kube-controller-manager-functional-902000
	0f08712c6ea6a       9cdd6470f48c8                                                                                         About a minute ago   Running             etcd                      2                   249b842d19687       etcd-functional-902000
	89b9e1ad799ed       04b4c447bb9d4                                                                                         About a minute ago   Running             kube-apiserver            0                   6a8cdf4bb90fd       kube-apiserver-functional-902000
	e755f551a1fbb       ba04bb24b9575                                                                                         About a minute ago   Exited              storage-provisioner       1                   1cfac500a4569       storage-provisioner
	6f511449a1d08       97e04611ad434                                                                                         About a minute ago   Exited              coredns                   1                   88fef9ef73113       coredns-5dd5756b68-96b29
	0f2d3f3589aa3       3ca3ca488cf13                                                                                         About a minute ago   Exited              kube-proxy                1                   b1bcb39b40e32       kube-proxy-2n2gf
	b195fbbaa5417       9961cbceaf234                                                                                         About a minute ago   Exited              kube-controller-manager   1                   9b448f0b0bee8       kube-controller-manager-functional-902000
	3718152188a99       9cdd6470f48c8                                                                                         About a minute ago   Exited              etcd                      1                   63314eeab72c0       etcd-functional-902000
	3cd5e7c487521       05c284c929889                                                                                         About a minute ago   Exited              kube-scheduler            1                   00cd726ebb7d7       kube-scheduler-functional-902000
	
	* 
	* ==> coredns [6f511449a1d0] <==
	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] 127.0.0.1:58063 - 19900 "HINFO IN 4755269188785515100.2356803300341278951. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.048791653s
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	* 
	* ==> coredns [ed55819d5f02] <==
	* .:53
	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b
	CoreDNS-1.10.1
	linux/arm64, go1.20, 055b2c3
	[INFO] 127.0.0.1:60277 - 52130 "HINFO IN 1359937555603883305.3989787218244417160. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.196436326s
	[INFO] 10.244.0.1:3717 - 43724 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000092244s
	[INFO] 10.244.0.1:36624 - 14377 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.00008387s
	[INFO] 10.244.0.1:45910 - 54906 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000039955s
	[INFO] 10.244.0.1:30449 - 164 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001042563s
	[INFO] 10.244.0.1:49799 - 33811 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000064746s
	[INFO] 10.244.0.1:13498 - 47868 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.00009087s
	
	* 
	* ==> describe nodes <==
	* Name:               functional-902000
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=functional-902000
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=0a36d8b085cf00cc3f9aa9781dc3c3ed45b198bf
	                    minikube.k8s.io/name=functional-902000
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_11_22T10_42_17_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 22 Nov 2023 18:42:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  functional-902000
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 22 Nov 2023 18:44:42 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 22 Nov 2023 18:44:32 +0000   Wed, 22 Nov 2023 18:42:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 22 Nov 2023 18:44:32 +0000   Wed, 22 Nov 2023 18:42:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 22 Nov 2023 18:44:32 +0000   Wed, 22 Nov 2023 18:42:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 22 Nov 2023 18:44:32 +0000   Wed, 22 Nov 2023 18:42:20 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.105.4
	  Hostname:    functional-902000
	Capacity:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3905016Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  17784760Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             3905016Ki
	  pods:               110
	System Info:
	  Machine ID:                 da688f957dd64f26ac502f0cda084646
	  System UUID:                da688f957dd64f26ac502f0cda084646
	  Boot ID:                    1b2746cb-60ff-48a2-8792-b436e5bf577b
	  Kernel Version:             5.10.57
	  OS Image:                   Buildroot 2021.02.12
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.7
	  Kubelet Version:            v1.28.4
	  Kube-Proxy Version:         v1.28.4
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     hello-node-759d89bdcc-mlp4x                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         50s
	  default                     hello-node-connect-7799dfb7c6-tqcz7          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30s
	  default                     nginx-svc                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39s
	  default                     sp-pod                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         16s
	  kube-system                 coredns-5dd5756b68-96b29                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     2m16s
	  kube-system                 etcd-functional-902000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         2m30s
	  kube-system                 kube-apiserver-functional-902000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         76s
	  kube-system                 kube-controller-manager-functional-902000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m30s
	  kube-system                 kube-proxy-2n2gf                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m16s
	  kube-system                 kube-scheduler-functional-902000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m30s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m16s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 2m15s              kube-proxy       
	  Normal  Starting                 74s                kube-proxy       
	  Normal  Starting                 114s               kube-proxy       
	  Normal  Starting                 2m30s              kubelet          Starting kubelet.
	  Normal  NodeAllocatableEnforced  2m30s              kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeHasSufficientMemory  2m30s              kubelet          Node functional-902000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m30s              kubelet          Node functional-902000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m30s              kubelet          Node functional-902000 status is now: NodeHasSufficientPID
	  Normal  NodeReady                2m27s              kubelet          Node functional-902000 status is now: NodeReady
	  Normal  RegisteredNode           2m17s              node-controller  Node functional-902000 event: Registered Node functional-902000 in Controller
	  Normal  NodeNotReady             2m10s              kubelet          Node functional-902000 status is now: NodeNotReady
	  Normal  RegisteredNode           103s               node-controller  Node functional-902000 event: Registered Node functional-902000 in Controller
	  Normal  Starting                 79s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  79s (x8 over 79s)  kubelet          Node functional-902000 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    79s (x8 over 79s)  kubelet          Node functional-902000 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     79s (x7 over 79s)  kubelet          Node functional-902000 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  79s                kubelet          Updated Node Allocatable limit across pods
	  Normal  RegisteredNode           64s                node-controller  Node functional-902000 event: Registered Node functional-902000 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.153395] systemd-fstab-generator[3791]: Ignoring "noauto" for root device
	[  +0.097517] systemd-fstab-generator[3802]: Ignoring "noauto" for root device
	[  +0.102145] systemd-fstab-generator[3815]: Ignoring "noauto" for root device
	[  +7.724507] kauditd_printk_skb: 21 callbacks suppressed
	[  +3.628712] systemd-fstab-generator[4370]: Ignoring "noauto" for root device
	[  +0.089787] systemd-fstab-generator[4381]: Ignoring "noauto" for root device
	[  +0.081771] systemd-fstab-generator[4392]: Ignoring "noauto" for root device
	[  +0.081781] systemd-fstab-generator[4403]: Ignoring "noauto" for root device
	[  +0.094249] systemd-fstab-generator[4475]: Ignoring "noauto" for root device
	[  +3.565199] kauditd_printk_skb: 30 callbacks suppressed
	[Nov22 18:43] systemd-fstab-generator[6184]: Ignoring "noauto" for root device
	[  +0.147265] systemd-fstab-generator[6216]: Ignoring "noauto" for root device
	[  +0.096451] systemd-fstab-generator[6227]: Ignoring "noauto" for root device
	[  +0.104487] systemd-fstab-generator[6240]: Ignoring "noauto" for root device
	[ +11.426063] systemd-fstab-generator[6804]: Ignoring "noauto" for root device
	[  +0.085095] systemd-fstab-generator[6815]: Ignoring "noauto" for root device
	[  +0.074101] systemd-fstab-generator[6832]: Ignoring "noauto" for root device
	[  +0.078882] systemd-fstab-generator[6849]: Ignoring "noauto" for root device
	[  +0.097229] systemd-fstab-generator[7006]: Ignoring "noauto" for root device
	[  +1.313588] systemd-fstab-generator[7261]: Ignoring "noauto" for root device
	[  +3.605840] kauditd_printk_skb: 29 callbacks suppressed
	[ +25.318863] kauditd_printk_skb: 9 callbacks suppressed
	[  +0.968622] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.
	[Nov22 18:44] kauditd_printk_skb: 3 callbacks suppressed
	[  +5.592251] kauditd_printk_skb: 1 callbacks suppressed
	
	* 
	* ==> etcd [0f08712c6ea6] <==
	* {"level":"info","ts":"2023-11-22T18:43:29.640486Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-11-22T18:43:29.640513Z","caller":"etcdserver/server.go:754","msg":"starting initial election tick advance","election-ticks":10}
	{"level":"info","ts":"2023-11-22T18:43:29.640563Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-11-22T18:43:29.640589Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-11-22T18:43:29.640596Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-11-22T18:43:29.640674Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2023-11-22T18:43:29.640683Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2023-11-22T18:43:29.640886Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}
	{"level":"info","ts":"2023-11-22T18:43:29.640911Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}
	{"level":"info","ts":"2023-11-22T18:43:29.640951Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:43:29.640976Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-11-22T18:43:30.632869Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}
	{"level":"info","ts":"2023-11-22T18:43:30.632919Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}
	{"level":"info","ts":"2023-11-22T18:43:30.632936Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2023-11-22T18:43:30.632952Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}
	{"level":"info","ts":"2023-11-22T18:43:30.632963Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}
	{"level":"info","ts":"2023-11-22T18:43:30.632995Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}
	{"level":"info","ts":"2023-11-22T18:43:30.633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}
	{"level":"info","ts":"2023-11-22T18:43:30.633725Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-902000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}
	{"level":"info","ts":"2023-11-22T18:43:30.633742Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-22T18:43:30.633806Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-11-22T18:43:30.633816Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-11-22T18:43:30.63375Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-22T18:43:30.634256Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}
	{"level":"info","ts":"2023-11-22T18:43:30.634256Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	
	* 
	* ==> etcd [3718152188a9] <==
	* {"level":"info","ts":"2023-11-22T18:42:49.940361Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2023-11-22T18:42:51.624404Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 2"}
	{"level":"info","ts":"2023-11-22T18:42:51.624545Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}
	{"level":"info","ts":"2023-11-22T18:42:51.624609Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}
	{"level":"info","ts":"2023-11-22T18:42:51.62467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}
	{"level":"info","ts":"2023-11-22T18:42:51.624705Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2023-11-22T18:42:51.624732Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}
	{"level":"info","ts":"2023-11-22T18:42:51.624763Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}
	{"level":"info","ts":"2023-11-22T18:42:51.630443Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-902000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}
	{"level":"info","ts":"2023-11-22T18:42:51.630497Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-22T18:42:51.630458Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-11-22T18:42:51.632367Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}
	{"level":"info","ts":"2023-11-22T18:42:51.633336Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-11-22T18:42:51.633838Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-11-22T18:42:51.633859Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	{"level":"info","ts":"2023-11-22T18:43:15.68351Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
	{"level":"info","ts":"2023-11-22T18:43:15.683537Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"functional-902000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}
	{"level":"warn","ts":"2023-11-22T18:43:15.683576Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}
	{"level":"warn","ts":"2023-11-22T18:43:15.683589Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}
	{"level":"warn","ts":"2023-11-22T18:43:15.683613Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"warn","ts":"2023-11-22T18:43:15.683648Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"info","ts":"2023-11-22T18:43:15.694189Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}
	{"level":"info","ts":"2023-11-22T18:43:15.695675Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2023-11-22T18:43:15.69571Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}
	{"level":"info","ts":"2023-11-22T18:43:15.695714Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"functional-902000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}
	
	* 
	* ==> kernel <==
	*  18:44:47 up 2 min,  0 users,  load average: 1.09, 0.50, 0.19
	Linux functional-902000 5.10.57 #1 SMP PREEMPT Thu Nov 16 15:24:01 UTC 2023 aarch64 GNU/Linux
	PRETTY_NAME="Buildroot 2021.02.12"
	
	* 
	* ==> kube-apiserver [89b9e1ad799e] <==
	* E1122 18:43:31.255400       1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service
	I1122 18:43:31.255745       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
	I1122 18:43:31.255758       1 apf_controller.go:377] Running API Priority and Fairness config worker
	I1122 18:43:31.255760       1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process
	I1122 18:43:31.276738       1 shared_informer.go:318] Caches are synced for crd-autoregister
	I1122 18:43:31.276772       1 aggregator.go:166] initial CRD sync complete...
	I1122 18:43:31.276791       1 autoregister_controller.go:141] Starting autoregister controller
	I1122 18:43:31.276805       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I1122 18:43:31.276812       1 cache.go:39] Caches are synced for autoregister controller
	I1122 18:43:32.154278       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	I1122 18:43:32.774703       1 controller.go:624] quota admission added evaluator for: serviceaccounts
	I1122 18:43:32.777845       1 controller.go:624] quota admission added evaluator for: deployments.apps
	I1122 18:43:32.788890       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
	I1122 18:43:32.796525       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I1122 18:43:32.798666       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I1122 18:43:43.295699       1 controller.go:624] quota admission added evaluator for: endpoints
	I1122 18:43:43.330125       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I1122 18:43:52.160111       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.96.99.109"}
	I1122 18:43:57.556368       1 controller.go:624] quota admission added evaluator for: replicasets.apps
	I1122 18:43:57.602891       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.104.150.205"}
	I1122 18:44:08.558859       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.111.136.125"}
	I1122 18:44:17.999563       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.111.71.227"}
	I1122 18:44:47.217738       1 controller.go:624] quota admission added evaluator for: namespaces
	I1122 18:44:47.406329       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.101.143.75"}
	I1122 18:44:47.416493       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.102.168.64"}
	
	* 
	* ==> kube-controller-manager [b195fbbaa541] <==
	* I1122 18:43:04.790726       1 range_allocator.go:174] "Sending events to api server"
	I1122 18:43:04.790753       1 range_allocator.go:178] "Starting range CIDR allocator"
	I1122 18:43:04.790793       1 shared_informer.go:311] Waiting for caches to sync for cidrallocator
	I1122 18:43:04.790799       1 shared_informer.go:318] Caches are synced for cidrallocator
	I1122 18:43:04.792867       1 shared_informer.go:318] Caches are synced for disruption
	I1122 18:43:04.793983       1 shared_informer.go:318] Caches are synced for ephemeral
	I1122 18:43:04.795055       1 shared_informer.go:318] Caches are synced for job
	I1122 18:43:04.798199       1 shared_informer.go:318] Caches are synced for expand
	I1122 18:43:04.798216       1 shared_informer.go:318] Caches are synced for HPA
	I1122 18:43:04.835839       1 shared_informer.go:318] Caches are synced for ReplicaSet
	I1122 18:43:04.835845       1 shared_informer.go:318] Caches are synced for stateful set
	I1122 18:43:04.835849       1 shared_informer.go:318] Caches are synced for deployment
	I1122 18:43:04.838932       1 shared_informer.go:318] Caches are synced for PVC protection
	I1122 18:43:04.842283       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="6.393094ms"
	I1122 18:43:04.842352       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="12.378µs"
	I1122 18:43:04.848966       1 shared_informer.go:318] Caches are synced for daemon sets
	I1122 18:43:04.851581       1 shared_informer.go:318] Caches are synced for cronjob
	I1122 18:43:04.857284       1 shared_informer.go:318] Caches are synced for persistent volume
	I1122 18:43:04.908508       1 shared_informer.go:318] Caches are synced for resource quota
	I1122 18:43:04.958736       1 shared_informer.go:318] Caches are synced for endpoint_slice_mirroring
	I1122 18:43:04.965868       1 shared_informer.go:318] Caches are synced for resource quota
	I1122 18:43:04.985062       1 shared_informer.go:318] Caches are synced for endpoint_slice
	I1122 18:43:05.315278       1 shared_informer.go:318] Caches are synced for garbage collector
	I1122 18:43:05.350524       1 shared_informer.go:318] Caches are synced for garbage collector
	I1122 18:43:05.350542       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"
	
	* 
	* ==> kube-controller-manager [c344b026622e] <==
	* I1122 18:44:47.299384       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set kubernetes-dashboard-8694d4445c to 1"
	I1122 18:44:47.301662       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I1122 18:44:47.308332       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="9.530455ms"
	E1122 18:44:47.308347       1 replica_set.go:557] sync "kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" failed with pods "dashboard-metrics-scraper-7fd5cb4ddc-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I1122 18:44:47.308620       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-7fd5cb4ddc-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I1122 18:44:47.310281       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="12.716566ms"
	E1122 18:44:47.310292       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I1122 18:44:47.314640       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="5.830563ms"
	E1122 18:44:47.314652       1 replica_set.go:557] sync "kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" failed with pods "dashboard-metrics-scraper-7fd5cb4ddc-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I1122 18:44:47.314732       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="4.431755ms"
	E1122 18:44:47.314740       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I1122 18:44:47.314773       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-7fd5cb4ddc-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I1122 18:44:47.314813       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I1122 18:44:47.320954       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="5.026036ms"
	E1122 18:44:47.320984       1 replica_set.go:557] sync "kubernetes-dashboard/kubernetes-dashboard-8694d4445c" failed with pods "kubernetes-dashboard-8694d4445c-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
	I1122 18:44:47.321111       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-8694d4445c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"
	I1122 18:44:47.336957       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-8694d4445c-bdc7p"
	I1122 18:44:47.342008       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="15.630181ms"
	I1122 18:44:47.364403       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-7fd5cb4ddc-d48zq"
	I1122 18:44:47.372406       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="17.243693ms"
	I1122 18:44:47.376200       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="34.05602ms"
	I1122 18:44:47.376330       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-8694d4445c" duration="49.5µs"
	I1122 18:44:47.400465       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="28.031877ms"
	I1122 18:44:47.411044       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="10.522272ms"
	I1122 18:44:47.411076       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc" duration="18.874µs"
	
	* 
	* ==> kube-proxy [0797337643d5] <==
	* I1122 18:43:32.419764       1 server_others.go:69] "Using iptables proxy"
	I1122 18:43:32.427603       1 node.go:141] Successfully retrieved node IP: 192.168.105.4
	I1122 18:43:32.440208       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
	I1122 18:43:32.440634       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
	I1122 18:43:32.442638       1 server_others.go:152] "Using iptables Proxier"
	I1122 18:43:32.442660       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I1122 18:43:32.442719       1 server.go:846] "Version info" version="v1.28.4"
	I1122 18:43:32.442727       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1122 18:43:32.443099       1 config.go:315] "Starting node config controller"
	I1122 18:43:32.443108       1 shared_informer.go:311] Waiting for caches to sync for node config
	I1122 18:43:32.443224       1 config.go:97] "Starting endpoint slice config controller"
	I1122 18:43:32.443233       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I1122 18:43:32.443261       1 config.go:188] "Starting service config controller"
	I1122 18:43:32.443266       1 shared_informer.go:311] Waiting for caches to sync for service config
	I1122 18:43:32.544847       1 shared_informer.go:318] Caches are synced for node config
	I1122 18:43:32.544847       1 shared_informer.go:318] Caches are synced for service config
	I1122 18:43:32.544876       1 shared_informer.go:318] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-proxy [0f2d3f3589aa] <==
	* I1122 18:42:50.687627       1 server_others.go:69] "Using iptables proxy"
	I1122 18:42:52.259056       1 node.go:141] Successfully retrieved node IP: 192.168.105.4
	I1122 18:42:52.285747       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"
	I1122 18:42:52.285883       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"
	I1122 18:42:52.296787       1 server_others.go:152] "Using iptables Proxier"
	I1122 18:42:52.296918       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I1122 18:42:52.297034       1 server.go:846] "Version info" version="v1.28.4"
	I1122 18:42:52.297183       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1122 18:42:52.299782       1 config.go:188] "Starting service config controller"
	I1122 18:42:52.299840       1 shared_informer.go:311] Waiting for caches to sync for service config
	I1122 18:42:52.299863       1 config.go:97] "Starting endpoint slice config controller"
	I1122 18:42:52.299894       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I1122 18:42:52.300163       1 config.go:315] "Starting node config controller"
	I1122 18:42:52.300197       1 shared_informer.go:311] Waiting for caches to sync for node config
	I1122 18:42:52.400451       1 shared_informer.go:318] Caches are synced for node config
	I1122 18:42:52.400485       1 shared_informer.go:318] Caches are synced for service config
	I1122 18:42:52.400508       1 shared_informer.go:318] Caches are synced for endpoint slice config
	
	* 
	* ==> kube-scheduler [1b75a12cee96] <==
	* I1122 18:43:30.109268       1 serving.go:348] Generated self-signed cert in-memory
	W1122 18:43:31.203064       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W1122 18:43:31.203079       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W1122 18:43:31.203084       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1122 18:43:31.203087       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1122 18:43:31.221780       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
	I1122 18:43:31.221795       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1122 18:43:31.222672       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I1122 18:43:31.222692       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1122 18:43:31.223346       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
	I1122 18:43:31.223394       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
	I1122 18:43:31.323463       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kube-scheduler [3cd5e7c48752] <==
	* I1122 18:42:50.263951       1 serving.go:348] Generated self-signed cert in-memory
	W1122 18:42:52.238862       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W1122 18:42:52.238951       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W1122 18:42:52.238976       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1122 18:42:52.238991       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1122 18:42:52.252774       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"
	I1122 18:42:52.252920       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I1122 18:42:52.256365       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
	I1122 18:42:52.256468       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
	I1122 18:42:52.260056       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I1122 18:42:52.260139       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1122 18:42:52.360943       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1122 18:43:15.686009       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259
	I1122 18:43:15.686029       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
	E1122 18:43:15.686119       1 run.go:74] "command failed" err="finished without leader elect"
	
	* 
	* ==> kubelet <==
	* -- Journal begins at Wed 2023-11-22 18:42:00 UTC, ends at Wed 2023-11-22 18:44:47 UTC. --
	Nov 22 18:44:34 functional-902000 kubelet[7267]: I1122 18:44:34.811407    7267 scope.go:117] "RemoveContainer" containerID="34782ddeff5f63b75234a94645b1891d873f37b8fea098ff4febe17f78efe791"
	Nov 22 18:44:34 functional-902000 kubelet[7267]: E1122 18:44:34.811527    7267 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-759d89bdcc-mlp4x_default(7edfeba7-ad58-469e-a929-33745170f4cd)\"" pod="default/hello-node-759d89bdcc-mlp4x" podUID="7edfeba7-ad58-469e-a929-33745170f4cd"
	Nov 22 18:44:39 functional-902000 kubelet[7267]: I1122 18:44:39.907077    7267 topology_manager.go:215] "Topology Admit Handler" podUID="a5e6e23d-7b67-42b4-af50-078b877fcf21" podNamespace="default" podName="busybox-mount"
	Nov 22 18:44:40 functional-902000 kubelet[7267]: I1122 18:44:40.051622    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/a5e6e23d-7b67-42b4-af50-078b877fcf21-test-volume\") pod \"busybox-mount\" (UID: \"a5e6e23d-7b67-42b4-af50-078b877fcf21\") " pod="default/busybox-mount"
	Nov 22 18:44:40 functional-902000 kubelet[7267]: I1122 18:44:40.051723    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f7j8\" (UniqueName: \"kubernetes.io/projected/a5e6e23d-7b67-42b4-af50-078b877fcf21-kube-api-access-8f7j8\") pod \"busybox-mount\" (UID: \"a5e6e23d-7b67-42b4-af50-078b877fcf21\") " pod="default/busybox-mount"
	Nov 22 18:44:40 functional-902000 kubelet[7267]: I1122 18:44:40.364550    7267 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7"
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.580396    7267 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/a5e6e23d-7b67-42b4-af50-078b877fcf21-test-volume\") pod \"a5e6e23d-7b67-42b4-af50-078b877fcf21\" (UID: \"a5e6e23d-7b67-42b4-af50-078b877fcf21\") "
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.580427    7267 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f7j8\" (UniqueName: \"kubernetes.io/projected/a5e6e23d-7b67-42b4-af50-078b877fcf21-kube-api-access-8f7j8\") pod \"a5e6e23d-7b67-42b4-af50-078b877fcf21\" (UID: \"a5e6e23d-7b67-42b4-af50-078b877fcf21\") "
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.580613    7267 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a5e6e23d-7b67-42b4-af50-078b877fcf21-test-volume" (OuterVolumeSpecName: "test-volume") pod "a5e6e23d-7b67-42b4-af50-078b877fcf21" (UID: "a5e6e23d-7b67-42b4-af50-078b877fcf21"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.581943    7267 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e6e23d-7b67-42b4-af50-078b877fcf21-kube-api-access-8f7j8" (OuterVolumeSpecName: "kube-api-access-8f7j8") pod "a5e6e23d-7b67-42b4-af50-078b877fcf21" (UID: "a5e6e23d-7b67-42b4-af50-078b877fcf21"). InnerVolumeSpecName "kube-api-access-8f7j8". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.681277    7267 reconciler_common.go:300] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/a5e6e23d-7b67-42b4-af50-078b877fcf21-test-volume\") on node \"functional-902000\" DevicePath \"\""
	Nov 22 18:44:43 functional-902000 kubelet[7267]: I1122 18:44:43.681291    7267 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-8f7j8\" (UniqueName: \"kubernetes.io/projected/a5e6e23d-7b67-42b4-af50-078b877fcf21-kube-api-access-8f7j8\") on node \"functional-902000\" DevicePath \"\""
	Nov 22 18:44:44 functional-902000 kubelet[7267]: I1122 18:44:44.388405    7267 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="446cc64d7c86932674b6725f03f9bd1d9755c0c61b89c20441b692c1f21573c7"
	Nov 22 18:44:45 functional-902000 kubelet[7267]: I1122 18:44:45.811348    7267 scope.go:117] "RemoveContainer" containerID="34782ddeff5f63b75234a94645b1891d873f37b8fea098ff4febe17f78efe791"
	Nov 22 18:44:46 functional-902000 kubelet[7267]: I1122 18:44:46.401540    7267 scope.go:117] "RemoveContainer" containerID="34782ddeff5f63b75234a94645b1891d873f37b8fea098ff4febe17f78efe791"
	Nov 22 18:44:46 functional-902000 kubelet[7267]: I1122 18:44:46.401655    7267 scope.go:117] "RemoveContainer" containerID="3c319f29f61b0d5d61a6651f6ea7153c9ae04499ee9fe31fcdc81855b374cd3d"
	Nov 22 18:44:46 functional-902000 kubelet[7267]: E1122 18:44:46.401745    7267 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 40s restarting failed container=echoserver-arm pod=hello-node-759d89bdcc-mlp4x_default(7edfeba7-ad58-469e-a929-33745170f4cd)\"" pod="default/hello-node-759d89bdcc-mlp4x" podUID="7edfeba7-ad58-469e-a929-33745170f4cd"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.340570    7267 topology_manager.go:215] "Topology Admit Handler" podUID="277b313f-aff0-4109-8cea-3eab3a9052f7" podNamespace="kubernetes-dashboard" podName="kubernetes-dashboard-8694d4445c-bdc7p"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: E1122 18:44:47.340605    7267 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="a5e6e23d-7b67-42b4-af50-078b877fcf21" containerName="mount-munger"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.340623    7267 memory_manager.go:346] "RemoveStaleState removing state" podUID="a5e6e23d-7b67-42b4-af50-078b877fcf21" containerName="mount-munger"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.372371    7267 topology_manager.go:215] "Topology Admit Handler" podUID="f96037cb-9fd8-4fc6-a859-46831d413398" podNamespace="kubernetes-dashboard" podName="dashboard-metrics-scraper-7fd5cb4ddc-d48zq"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.522147    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cgxm\" (UniqueName: \"kubernetes.io/projected/f96037cb-9fd8-4fc6-a859-46831d413398-kube-api-access-8cgxm\") pod \"dashboard-metrics-scraper-7fd5cb4ddc-d48zq\" (UID: \"f96037cb-9fd8-4fc6-a859-46831d413398\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc-d48zq"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.522212    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/277b313f-aff0-4109-8cea-3eab3a9052f7-tmp-volume\") pod \"kubernetes-dashboard-8694d4445c-bdc7p\" (UID: \"277b313f-aff0-4109-8cea-3eab3a9052f7\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-bdc7p"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.522224    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/f96037cb-9fd8-4fc6-a859-46831d413398-tmp-volume\") pod \"dashboard-metrics-scraper-7fd5cb4ddc-d48zq\" (UID: \"f96037cb-9fd8-4fc6-a859-46831d413398\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-7fd5cb4ddc-d48zq"
	Nov 22 18:44:47 functional-902000 kubelet[7267]: I1122 18:44:47.522234    7267 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp76k\" (UniqueName: \"kubernetes.io/projected/277b313f-aff0-4109-8cea-3eab3a9052f7-kube-api-access-mp76k\") pod \"kubernetes-dashboard-8694d4445c-bdc7p\" (UID: \"277b313f-aff0-4109-8cea-3eab3a9052f7\") " pod="kubernetes-dashboard/kubernetes-dashboard-8694d4445c-bdc7p"
	
	* 
	* ==> storage-provisioner [7a8920518d6e] <==
	* I1122 18:43:32.453048       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1122 18:43:32.456771       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1122 18:43:32.456822       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1122 18:43:49.842484       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1122 18:43:49.842553       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-902000_806308cc-bf52-4bf7-b4e9-5d6eb6afe159!
	I1122 18:43:49.843386       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1fc5c6f5-1caf-48c3-9c19-fb66ff35788b", APIVersion:"v1", ResourceVersion:"560", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-902000_806308cc-bf52-4bf7-b4e9-5d6eb6afe159 became leader
	I1122 18:43:49.943081       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-902000_806308cc-bf52-4bf7-b4e9-5d6eb6afe159!
	I1122 18:44:20.235939       1 controller.go:1332] provision "default/myclaim" class "standard": started
	I1122 18:44:20.235986       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    66255b57-1df1-48e9-82f0-ade6a2494357 306 0 2023-11-22 18:42:31 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}
	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2023-11-22 18:42:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-aa5928a6-9e6f-4a29-92ab-12ec3b3fc659 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  aa5928a6-9e6f-4a29-92ab-12ec3b3fc659 696 0 2023-11-22 18:44:20 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea
dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}
	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2023-11-22 18:44:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2023-11-22 18:44:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:
ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim
	I1122 18:44:20.236895       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-aa5928a6-9e6f-4a29-92ab-12ec3b3fc659" provisioned
	I1122 18:44:20.236915       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded
	I1122 18:44:20.236922       1 volume_store.go:212] Trying to save persistentvolume "pvc-aa5928a6-9e6f-4a29-92ab-12ec3b3fc659"
	I1122 18:44:20.236473       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"aa5928a6-9e6f-4a29-92ab-12ec3b3fc659", APIVersion:"v1", ResourceVersion:"696", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"
	I1122 18:44:20.241106       1 volume_store.go:219] persistentvolume "pvc-aa5928a6-9e6f-4a29-92ab-12ec3b3fc659" saved
	I1122 18:44:20.241767       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"aa5928a6-9e6f-4a29-92ab-12ec3b3fc659", APIVersion:"v1", ResourceVersion:"696", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-aa5928a6-9e6f-4a29-92ab-12ec3b3fc659
	
	* 
	* ==> storage-provisioner [e755f551a1fb] <==
	* I1122 18:42:50.669814       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1122 18:42:52.276652       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1122 18:42:52.276826       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1122 18:42:52.287280       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1122 18:42:52.287380       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-902000_14aa7114-4aee-4407-b01e-40fc97e88bb7!
	I1122 18:42:52.287898       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1fc5c6f5-1caf-48c3-9c19-fb66ff35788b", APIVersion:"v1", ResourceVersion:"383", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-902000_14aa7114-4aee-4407-b01e-40fc97e88bb7 became leader
	I1122 18:42:52.387512       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-902000_14aa7114-4aee-4407-b01e-40fc97e88bb7!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-902000 -n functional-902000
helpers_test.go:261: (dbg) Run:  kubectl --context functional-902000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-d48zq kubernetes-dashboard-8694d4445c-bdc7p
helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context functional-902000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-d48zq kubernetes-dashboard-8694d4445c-bdc7p
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context functional-902000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-d48zq kubernetes-dashboard-8694d4445c-bdc7p: exit status 1 (43.193167ms)

                                                
                                                
-- stdout --
	Name:             busybox-mount
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             functional-902000/192.168.105.4
	Start Time:       Wed, 22 Nov 2023 10:44:39 -0800
	Labels:           integration-test=busybox-mount
	Annotations:      <none>
	Status:           Succeeded
	IP:               10.244.0.11
	IPs:
	  IP:  10.244.0.11
	Containers:
	  mount-munger:
	    Container ID:  docker://efa24a741439320300fee3b34b726d466fb1b986da723bc5cb8c32d1e766cd61
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      /bin/sh
	      -c
	      --
	    Args:
	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates
	    State:          Terminated
	      Reason:       Completed
	      Exit Code:    0
	      Started:      Wed, 22 Nov 2023 10:44:41 -0800
	      Finished:     Wed, 22 Nov 2023 10:44:41 -0800
	    Ready:          False
	    Restart Count:  0
	    Environment:    <none>
	    Mounts:
	      /mount-9p from test-volume (rw)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8f7j8 (ro)
	Conditions:
	  Type              Status
	  Initialized       True 
	  Ready             False 
	  ContainersReady   False 
	  PodScheduled      True 
	Volumes:
	  test-volume:
	    Type:          HostPath (bare host directory volume)
	    Path:          /mount-9p
	    HostPathType:  
	  kube-api-access-8f7j8:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type    Reason     Age   From               Message
	  ----    ------     ----  ----               -------
	  Normal  Scheduled  9s    default-scheduler  Successfully assigned default/busybox-mount to functional-902000
	  Normal  Pulling    8s    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Normal  Pulled     7s    kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.332s (1.332s including waiting)
	  Normal  Created    7s    kubelet            Created container mount-munger
	  Normal  Started    7s    kubelet            Started container mount-munger

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "dashboard-metrics-scraper-7fd5cb4ddc-d48zq" not found
	Error from server (NotFound): pods "kubernetes-dashboard-8694d4445c-bdc7p" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context functional-902000 describe pod busybox-mount dashboard-metrics-scraper-7fd5cb4ddc-d48zq kubernetes-dashboard-8694d4445c-bdc7p: exit status 1
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (29.98s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (9.8s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-338000 --driver=qemu2 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-338000 --driver=qemu2 : exit status 80 (9.724838584s)

                                                
                                                
-- stdout --
	* [image-338000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node image-338000 in cluster image-338000
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "image-338000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p image-338000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-338000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-338000 -n image-338000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-338000 -n image-338000: exit status 7 (69.502584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-338000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (9.80s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (19.24s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-darwin-arm64 start -p ingress-addon-legacy-389000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=qemu2 
E1122 10:45:20.584915    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ingress-addon-legacy-389000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (19.242777958s)

                                                
                                                
-- stdout --
	* [ingress-addon-legacy-389000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node ingress-addon-legacy-389000 in cluster ingress-addon-legacy-389000
	* Downloading Kubernetes v1.18.20 preload ...
	* Creating qemu2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "ingress-addon-legacy-389000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:45:03.501495    2338 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:45:03.501663    2338 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:03.501666    2338 out.go:309] Setting ErrFile to fd 2...
	I1122 10:45:03.501669    2338 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:03.501795    2338 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:45:03.502760    2338 out.go:303] Setting JSON to false
	I1122 10:45:03.518742    2338 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":873,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:45:03.518836    2338 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:45:03.528347    2338 out.go:177] * [ingress-addon-legacy-389000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:45:03.533467    2338 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:45:03.533499    2338 notify.go:220] Checking for updates...
	I1122 10:45:03.538459    2338 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:45:03.542455    2338 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:45:03.545393    2338 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:45:03.548418    2338 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:45:03.551341    2338 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:45:03.554737    2338 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:45:03.559437    2338 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:45:03.566370    2338 start.go:298] selected driver: qemu2
	I1122 10:45:03.566376    2338 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:45:03.566382    2338 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:45:03.568731    2338 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:45:03.572469    2338 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:45:03.575359    2338 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:45:03.575412    2338 cni.go:84] Creating CNI manager for ""
	I1122 10:45:03.575418    2338 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:45:03.575422    2338 start_flags.go:323] config:
	{Name:ingress-addon-legacy-389000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-389000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP
: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:45:03.580040    2338 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:45:03.587279    2338 out.go:177] * Starting control plane node ingress-addon-legacy-389000 in cluster ingress-addon-legacy-389000
	I1122 10:45:03.591448    2338 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1122 10:45:03.647816    2338 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1122 10:45:03.647829    2338 cache.go:56] Caching tarball of preloaded images
	I1122 10:45:03.648014    2338 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1122 10:45:03.652472    2338 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I1122 10:45:03.660351    2338 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:45:03.738052    2338 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I1122 10:45:12.318293    2338 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:45:12.318459    2338 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:45:13.067296    2338 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I1122 10:45:13.067526    2338 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/ingress-addon-legacy-389000/config.json ...
	I1122 10:45:13.067546    2338 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/ingress-addon-legacy-389000/config.json: {Name:mk95c4939d31a99e40c353c702e6034c02cccc78 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:45:13.067781    2338 start.go:365] acquiring machines lock for ingress-addon-legacy-389000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:45:13.067810    2338 start.go:369] acquired machines lock for "ingress-addon-legacy-389000" in 21.208µs
	I1122 10:45:13.067818    2338 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-389000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K
ubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-389000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:doc
ker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:45:13.067843    2338 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:45:13.073885    2338 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	I1122 10:45:13.089292    2338 start.go:159] libmachine.API.Create for "ingress-addon-legacy-389000" (driver="qemu2")
	I1122 10:45:13.089318    2338 client.go:168] LocalClient.Create starting
	I1122 10:45:13.089397    2338 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:45:13.089428    2338 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:13.089444    2338 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:13.089480    2338 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:45:13.089504    2338 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:13.089510    2338 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:13.089880    2338 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:45:13.211307    2338 main.go:141] libmachine: Creating SSH key...
	I1122 10:45:13.310653    2338 main.go:141] libmachine: Creating Disk image...
	I1122 10:45:13.310659    2338 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:45:13.310818    2338 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:13.322766    2338 main.go:141] libmachine: STDOUT: 
	I1122 10:45:13.322785    2338 main.go:141] libmachine: STDERR: 
	I1122 10:45:13.322845    2338 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2 +20000M
	I1122 10:45:13.333530    2338 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:45:13.333548    2338 main.go:141] libmachine: STDERR: 
	I1122 10:45:13.333565    2338 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:13.333571    2338 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:45:13.333609    2338 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4096 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:d7:ad:98:c0:d5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:13.335338    2338 main.go:141] libmachine: STDOUT: 
	I1122 10:45:13.335354    2338 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:45:13.335374    2338 client.go:171] LocalClient.Create took 246.053333ms
	I1122 10:45:15.337729    2338 start.go:128] duration metric: createHost completed in 2.269800333s
	I1122 10:45:15.337845    2338 start.go:83] releasing machines lock for "ingress-addon-legacy-389000", held for 2.270042292s
	W1122 10:45:15.337889    2338 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:45:15.348044    2338 out.go:177] * Deleting "ingress-addon-legacy-389000" in qemu2 ...
	W1122 10:45:15.371030    2338 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:45:15.371056    2338 start.go:706] Will try again in 5 seconds ...
	I1122 10:45:20.373234    2338 start.go:365] acquiring machines lock for ingress-addon-legacy-389000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:45:20.373719    2338 start.go:369] acquired machines lock for "ingress-addon-legacy-389000" in 351.5µs
	I1122 10:45:20.373867    2338 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-389000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K
ubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-389000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:doc
ker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:45:20.374102    2338 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:45:20.386540    2338 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	I1122 10:45:20.436160    2338 start.go:159] libmachine.API.Create for "ingress-addon-legacy-389000" (driver="qemu2")
	I1122 10:45:20.436193    2338 client.go:168] LocalClient.Create starting
	I1122 10:45:20.436326    2338 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:45:20.436383    2338 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:20.436401    2338 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:20.436465    2338 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:45:20.436511    2338 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:20.436523    2338 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:20.437052    2338 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:45:20.567800    2338 main.go:141] libmachine: Creating SSH key...
	I1122 10:45:20.617195    2338 main.go:141] libmachine: Creating Disk image...
	I1122 10:45:20.617200    2338 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:45:20.617389    2338 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:20.629953    2338 main.go:141] libmachine: STDOUT: 
	I1122 10:45:20.629972    2338 main.go:141] libmachine: STDERR: 
	I1122 10:45:20.630046    2338 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2 +20000M
	I1122 10:45:20.640639    2338 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:45:20.640656    2338 main.go:141] libmachine: STDERR: 
	I1122 10:45:20.640672    2338 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:20.640678    2338 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:45:20.640717    2338 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4096 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:0f:3f:9d:14:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/ingress-addon-legacy-389000/disk.qcow2
	I1122 10:45:20.642513    2338 main.go:141] libmachine: STDOUT: 
	I1122 10:45:20.642530    2338 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:45:20.642544    2338 client.go:171] LocalClient.Create took 206.347584ms
	I1122 10:45:22.644708    2338 start.go:128] duration metric: createHost completed in 2.270594125s
	I1122 10:45:22.644787    2338 start.go:83] releasing machines lock for "ingress-addon-legacy-389000", held for 2.271057958s
	W1122 10:45:22.645155    2338 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p ingress-addon-legacy-389000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p ingress-addon-legacy-389000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:45:22.658823    2338 out.go:177] 
	W1122 10:45:22.662812    2338 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:45:22.662859    2338 out.go:239] * 
	* 
	W1122 10:45:22.665841    2338 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:45:22.677757    2338 out.go:177] 

                                                
                                                
** /stderr **
ingress_addon_legacy_test.go:41: failed to start minikube with args: "out/minikube-darwin-arm64 start -p ingress-addon-legacy-389000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80
--- FAIL: TestIngressAddonLegacy/StartLegacyK8sCluster (19.24s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (0.12s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-389000 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ingress-addon-legacy-389000 addons enable ingress --alsologtostderr -v=5: exit status 10 (87.996417ms)

                                                
                                                
-- stdout --
	* ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.
	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS
	* Verifying ingress addon...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:45:22.770975    2356 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:45:22.771251    2356 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:22.771254    2356 out.go:309] Setting ErrFile to fd 2...
	I1122 10:45:22.771258    2356 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:22.771405    2356 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:45:22.771678    2356 mustload.go:65] Loading cluster: ingress-addon-legacy-389000
	I1122 10:45:22.771914    2356 config.go:182] Loaded profile config "ingress-addon-legacy-389000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1122 10:45:22.771921    2356 addons.go:594] checking whether the cluster is paused
	I1122 10:45:22.771978    2356 config.go:182] Loaded profile config "ingress-addon-legacy-389000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1122 10:45:22.771993    2356 host.go:66] Checking if "ingress-addon-legacy-389000" exists ...
	I1122 10:45:22.776829    2356 out.go:177] * ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.
	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS
	I1122 10:45:22.780798    2356 config.go:182] Loaded profile config "ingress-addon-legacy-389000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1122 10:45:22.780804    2356 addons.go:69] Setting ingress=true in profile "ingress-addon-legacy-389000"
	I1122 10:45:22.780810    2356 addons.go:231] Setting addon ingress=true in "ingress-addon-legacy-389000"
	I1122 10:45:22.780826    2356 host.go:66] Checking if "ingress-addon-legacy-389000" exists ...
	W1122 10:45:22.781046    2356 host.go:58] "ingress-addon-legacy-389000" host status: Stopped
	W1122 10:45:22.781051    2356 addons.go:277] "ingress-addon-legacy-389000" is not running, setting ingress=true and skipping enablement (err=<nil>)
	I1122 10:45:22.781057    2356 addons.go:467] Verifying addon ingress=true in "ingress-addon-legacy-389000"
	I1122 10:45:22.784672    2356 out.go:177] * Verifying ingress addon...
	I1122 10:45:22.789100    2356 out.go:177] 
	W1122 10:45:22.793666    2356 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-389000" does not exist: client config: context "ingress-addon-legacy-389000" does not exist]
	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-389000" does not exist: client config: context "ingress-addon-legacy-389000" does not exist]
	W1122 10:45:22.793675    2356 out.go:239] * 
	* 
	W1122 10:45:22.795604    2356 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                           │
	│    * If the above advice does not help, please let us know:                                                               │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │
	│                                                                                                                           │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │
	│    * Please also attach the following file to the GitHub issue:                                                           │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │
	│                                                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                           │
	│    * If the above advice does not help, please let us know:                                                               │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │
	│                                                                                                                           │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │
	│    * Please also attach the following file to the GitHub issue:                                                           │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │
	│                                                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:45:22.799661    2356 out.go:177] 

                                                
                                                
** /stderr **
ingress_addon_legacy_test.go:71: failed to enable ingress addon: exit status 10
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ingress-addon-legacy-389000 -n ingress-addon-legacy-389000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ingress-addon-legacy-389000 -n ingress-addon-legacy-389000: exit status 7 (34.340083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ingress-addon-legacy-389000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (0.12s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (0.03s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:200: failed to get Kubernetes client: <nil>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ingress-addon-legacy-389000 -n ingress-addon-legacy-389000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ingress-addon-legacy-389000 -n ingress-addon-legacy-389000: exit status 7 (31.664958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ingress-addon-legacy-389000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (0.03s)

                                                
                                    
x
+
TestJSONOutput/start/Command (9.84s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-763000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-763000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.842053375s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"f0adad6f-3a0e-4a33-8aaf-2b6781daeffd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-763000] minikube v1.32.0 on Darwin 14.1.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"2a31def5-f2c0-4d31-b0fa-9854449c3c13","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17658"}}
	{"specversion":"1.0","id":"da9a7e97-27bc-49fa-82c2-90356f15ad95","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig"}}
	{"specversion":"1.0","id":"2f4f06a9-e234-4181-aa7c-c01c1f8ea4ff","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"68dc6d6a-e040-417d-a7f7-74d5a2288025","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"11c4ba64-25fd-40e7-ad6d-cd659900b8a8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube"}}
	{"specversion":"1.0","id":"7d2057d2-c63f-4468-a747-9e848cd6665f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"9779cd53-8846-42b6-9849-f6212bf7afad","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"8570dbee-ae4e-43c6-bde7-003368ab31e2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}
	{"specversion":"1.0","id":"a2e2b619-5fd3-490a-a638-f60531e2286a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node json-output-763000 in cluster json-output-763000","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"3d887d02-93e0-49bb-8e6f-229ee066c216","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"ccaec049-ff5e-4b7c-a411-9d2b751ca241","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-763000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"a1bd3472-ae3f-4533-9637-82cd581b26c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"fdf19096-c5ff-488e-a1c0-f1bebf1f7fd1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	{"specversion":"1.0","id":"b47afb03-0044-4c0e-9cf0-a6a37ece41fa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-763000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}
	{"specversion":"1.0","id":"20da8795-49b7-43bf-8d5e-0514e28e52eb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}
	{"specversion":"1.0","id":"18de1738-4fd7-409b-a518-0e891923f943","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-763000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80
json_output_test.go:213: unable to marshal output: OUTPUT: 
json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value
--- FAIL: TestJSONOutput/start/Command (9.84s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.08s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-763000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-763000 --output=json --user=testUser: exit status 89 (78.900459ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"86e312ef-bdb7-4cae-a8a7-5223dd5feafb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control plane node must be running for this command"}}
	{"specversion":"1.0","id":"6851d2e5-2922-4e90-9f47-9489720f976b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-763000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-763000 --output=json --user=testUser": exit status 89
--- FAIL: TestJSONOutput/pause/Command (0.08s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.05s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-763000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-763000 --output=json --user=testUser: exit status 89 (46.135209ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p json-output-763000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-763000 --output=json --user=testUser": exit status 89
json_output_test.go:213: unable to marshal output: * The control plane node must be running for this command
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (10.16s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-182000 --driver=qemu2 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-182000 --driver=qemu2 : exit status 80 (9.71438s)

                                                
                                                
-- stdout --
	* [first-182000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node first-182000 in cluster first-182000
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "first-182000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p first-182000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-182000 --driver=qemu2 ": exit status 80
panic.go:523: *** TestMinikubeProfile FAILED at 2023-11-22 10:45:43.217073 -0800 PST m=+591.884164668
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-184000 -n second-184000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-184000 -n second-184000: exit status 85 (78.331875ms)

                                                
                                                
-- stdout --
	* Profile "second-184000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-184000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-184000" host is not running, skipping log retrieval (state="* Profile \"second-184000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-184000\"")
helpers_test.go:175: Cleaning up "second-184000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-184000
panic.go:523: *** TestMinikubeProfile FAILED at 2023-11-22 10:45:43.52916 -0800 PST m=+592.196253626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-182000 -n first-182000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-182000 -n first-182000: exit status 7 (32.067583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-182000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-182000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-182000
--- FAIL: TestMinikubeProfile (10.16s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (9.95s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-079000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-079000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.880451792s)

                                                
                                                
-- stdout --
	* [mount-start-1-079000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting minikube without Kubernetes in cluster mount-start-1-079000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "mount-start-1-079000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-079000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-079000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-079000 -n mount-start-1-079000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-079000 -n mount-start-1-079000: exit status 7 (71.274084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-079000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (9.95s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (9.87s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-722000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:85: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-722000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.798519416s)

                                                
                                                
-- stdout --
	* [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node multinode-722000 in cluster multinode-722000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-722000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:45:53.841103    2479 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:45:53.841281    2479 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:53.841284    2479 out.go:309] Setting ErrFile to fd 2...
	I1122 10:45:53.841287    2479 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:45:53.841407    2479 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:45:53.842438    2479 out.go:303] Setting JSON to false
	I1122 10:45:53.858583    2479 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":923,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:45:53.858687    2479 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:45:53.863902    2479 out.go:177] * [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:45:53.871827    2479 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:45:53.871881    2479 notify.go:220] Checking for updates...
	I1122 10:45:53.876814    2479 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:45:53.878278    2479 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:45:53.881794    2479 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:45:53.884785    2479 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:45:53.887828    2479 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:45:53.890928    2479 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:45:53.894759    2479 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:45:53.901737    2479 start.go:298] selected driver: qemu2
	I1122 10:45:53.901742    2479 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:45:53.901748    2479 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:45:53.904285    2479 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:45:53.906790    2479 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:45:53.909891    2479 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:45:53.909944    2479 cni.go:84] Creating CNI manager for ""
	I1122 10:45:53.909949    2479 cni.go:136] 0 nodes found, recommending kindnet
	I1122 10:45:53.909957    2479 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I1122 10:45:53.909962    2479 start_flags.go:323] config:
	{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAge
ntPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:45:53.914523    2479 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:45:53.921741    2479 out.go:177] * Starting control plane node multinode-722000 in cluster multinode-722000
	I1122 10:45:53.924766    2479 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:45:53.924784    2479 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:45:53.924790    2479 cache.go:56] Caching tarball of preloaded images
	I1122 10:45:53.924865    2479 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:45:53.924870    2479 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:45:53.925097    2479 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/multinode-722000/config.json ...
	I1122 10:45:53.925108    2479 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/multinode-722000/config.json: {Name:mkc72a453df9ec0d14ab1aa6ce66b0181ba65746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:45:53.925341    2479 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:45:53.925373    2479 start.go:369] acquired machines lock for "multinode-722000" in 26µs
	I1122 10:45:53.925383    2479 start.go:93] Provisioning new machine with config: &{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz
e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:45:53.925417    2479 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:45:53.933688    2479 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:45:53.950444    2479 start.go:159] libmachine.API.Create for "multinode-722000" (driver="qemu2")
	I1122 10:45:53.950471    2479 client.go:168] LocalClient.Create starting
	I1122 10:45:53.950536    2479 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:45:53.950567    2479 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:53.950582    2479 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:53.950630    2479 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:45:53.950653    2479 main.go:141] libmachine: Decoding PEM data...
	I1122 10:45:53.950660    2479 main.go:141] libmachine: Parsing certificate...
	I1122 10:45:53.951058    2479 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:45:54.071627    2479 main.go:141] libmachine: Creating SSH key...
	I1122 10:45:54.155643    2479 main.go:141] libmachine: Creating Disk image...
	I1122 10:45:54.155654    2479 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:45:54.155827    2479 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:45:54.167961    2479 main.go:141] libmachine: STDOUT: 
	I1122 10:45:54.167981    2479 main.go:141] libmachine: STDERR: 
	I1122 10:45:54.168038    2479 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2 +20000M
	I1122 10:45:54.178439    2479 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:45:54.178455    2479 main.go:141] libmachine: STDERR: 
	I1122 10:45:54.178476    2479 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:45:54.178481    2479 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:45:54.178520    2479 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:eb:90:4b:c8:76 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:45:54.180253    2479 main.go:141] libmachine: STDOUT: 
	I1122 10:45:54.180270    2479 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:45:54.180290    2479 client.go:171] LocalClient.Create took 229.819625ms
	I1122 10:45:56.182476    2479 start.go:128] duration metric: createHost completed in 2.257063583s
	I1122 10:45:56.182548    2479 start.go:83] releasing machines lock for "multinode-722000", held for 2.257208375s
	W1122 10:45:56.182623    2479 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:45:56.189015    2479 out.go:177] * Deleting "multinode-722000" in qemu2 ...
	W1122 10:45:56.214698    2479 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:45:56.214729    2479 start.go:706] Will try again in 5 seconds ...
	I1122 10:46:01.216835    2479 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:46:01.217388    2479 start.go:369] acquired machines lock for "multinode-722000" in 432.583µs
	I1122 10:46:01.217541    2479 start.go:93] Provisioning new machine with config: &{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz
e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:46:01.217965    2479 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:46:01.228625    2479 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:46:01.276617    2479 start.go:159] libmachine.API.Create for "multinode-722000" (driver="qemu2")
	I1122 10:46:01.276666    2479 client.go:168] LocalClient.Create starting
	I1122 10:46:01.276825    2479 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:46:01.276900    2479 main.go:141] libmachine: Decoding PEM data...
	I1122 10:46:01.276921    2479 main.go:141] libmachine: Parsing certificate...
	I1122 10:46:01.276983    2479 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:46:01.277025    2479 main.go:141] libmachine: Decoding PEM data...
	I1122 10:46:01.277035    2479 main.go:141] libmachine: Parsing certificate...
	I1122 10:46:01.277620    2479 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:46:01.410591    2479 main.go:141] libmachine: Creating SSH key...
	I1122 10:46:01.536521    2479 main.go:141] libmachine: Creating Disk image...
	I1122 10:46:01.536529    2479 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:46:01.536710    2479 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:46:01.548559    2479 main.go:141] libmachine: STDOUT: 
	I1122 10:46:01.548587    2479 main.go:141] libmachine: STDERR: 
	I1122 10:46:01.548651    2479 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2 +20000M
	I1122 10:46:01.559196    2479 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:46:01.559213    2479 main.go:141] libmachine: STDERR: 
	I1122 10:46:01.559227    2479 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:46:01.559237    2479 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:46:01.559287    2479 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:e8:73:17:b1:55 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:46:01.561039    2479 main.go:141] libmachine: STDOUT: 
	I1122 10:46:01.561057    2479 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:46:01.561075    2479 client.go:171] LocalClient.Create took 284.406583ms
	I1122 10:46:03.563218    2479 start.go:128] duration metric: createHost completed in 2.345266417s
	I1122 10:46:03.563271    2479 start.go:83] releasing machines lock for "multinode-722000", held for 2.345868083s
	W1122 10:46:03.563715    2479 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:46:03.574352    2479 out.go:177] 
	W1122 10:46:03.581486    2479 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:46:03.581543    2479 out.go:239] * 
	* 
	W1122 10:46:03.584275    2479 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:46:03.594353    2479 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:87: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-722000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (68.79525ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.87s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (91.41s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:481: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (59.025167ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-722000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:483: failed to create busybox deployment to multinode cluster
multinode_test.go:486: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- rollout status deployment/busybox: exit status 1 (58.88375ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:488: failed to deploy busybox to multinode cluster
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (58.092541ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.560833ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.258417ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.775709ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.357875ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.338708ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.899875ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.852791ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
E1122 10:46:42.370052    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.090042ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.263834ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.151292ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:512: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:516: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:516: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.876167ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:518: failed get Pod names
multinode_test.go:524: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.io: exit status 1 (57.255209ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:526: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.default: exit status 1 (57.79775ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:536: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:542: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (58.085ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:544: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.886875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (91.41s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:552: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-722000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.715042ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:554: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.660709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-722000 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-722000 -v 3 --alsologtostderr: exit status 89 (49.862959ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-722000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:35.209681    2590 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:35.209902    2590 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.209906    2590 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:35.209909    2590 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.210040    2590 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:35.210258    2590 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:35.210461    2590 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:35.214864    2590 out.go:177] * The control plane node must be running for this command
	I1122 10:47:35.218942    2590 out.go:177]   To start a cluster, run: "minikube start -p multinode-722000"

                                                
                                                
** /stderr **
multinode_test.go:112: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-722000 -v 3 --alsologtostderr" : exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.844417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.08s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
multinode_test.go:155: expected profile "multinode-722000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-722000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-722000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"VMDriver\":\"\",\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidd
en\":false,\"KVMNUMACount\":1,\"APIServerPort\":0,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-722000\",\"Namespace\":\"default\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\",\"NodeIP\":\"\",\"NodePort\":8443,\"NodeName\":\"\"},\"Nodes\":[{\"Name\":\"\
",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPat
h\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"AutoPauseInterval\":60000000000,\"GPUs\":\"\"},\"Active\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.569125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.10s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status --output json --alsologtostderr
multinode_test.go:173: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status --output json --alsologtostderr: exit status 7 (31.728125ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-722000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:35.392914    2600 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:35.393071    2600 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.393074    2600 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:35.393077    2600 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.393203    2600 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:35.393313    2600 out.go:303] Setting JSON to true
	I1122 10:47:35.393325    2600 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:35.393385    2600 notify.go:220] Checking for updates...
	I1122 10:47:35.393506    2600 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:35.393511    2600 status.go:255] checking status of multinode-722000 ...
	I1122 10:47:35.393710    2600 status.go:330] multinode-722000 host status = "Stopped" (err=<nil>)
	I1122 10:47:35.393714    2600 status.go:343] host is not running, skipping remaining checks
	I1122 10:47:35.393717    2600 status.go:257] multinode-722000 status: &{Name:multinode-722000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:180: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-722000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (30.39625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 node stop m03
multinode_test.go:210: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 node stop m03: exit status 85 (48.086292ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:212: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-722000 node stop m03": exit status 85
multinode_test.go:216: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status: exit status 7 (31.022125ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr: exit status 7 (30.659833ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:35.533851    2608 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:35.534005    2608 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.534008    2608 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:35.534011    2608 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.534144    2608 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:35.534260    2608 out.go:303] Setting JSON to false
	I1122 10:47:35.534272    2608 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:35.534318    2608 notify.go:220] Checking for updates...
	I1122 10:47:35.534465    2608 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:35.534470    2608 status.go:255] checking status of multinode-722000 ...
	I1122 10:47:35.534683    2608 status.go:330] multinode-722000 host status = "Stopped" (err=<nil>)
	I1122 10:47:35.534686    2608 status.go:343] host is not running, skipping remaining checks
	I1122 10:47:35.534688    2608 status.go:257] multinode-722000 status: &{Name:multinode-722000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:229: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr": multinode-722000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (30.69225ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.14s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (0.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 node start m03 --alsologtostderr: exit status 85 (52.044417ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:35.595977    2612 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:35.596196    2612 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.596199    2612 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:35.596202    2612 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.596326    2612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:35.596540    2612 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:35.596710    2612 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:35.601852    2612 out.go:177] 
	W1122 10:47:35.604826    2612 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W1122 10:47:35.604831    2612 out.go:239] * 
	* 
	W1122 10:47:35.606235    2612 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:47:35.609851    2612 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:256: I1122 10:47:35.595977    2612 out.go:296] Setting OutFile to fd 1 ...
I1122 10:47:35.596196    2612 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:47:35.596199    2612 out.go:309] Setting ErrFile to fd 2...
I1122 10:47:35.596202    2612 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:47:35.596326    2612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:47:35.596540    2612 mustload.go:65] Loading cluster: multinode-722000
I1122 10:47:35.596710    2612 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:47:35.601852    2612 out.go:177] 
W1122 10:47:35.604826    2612 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W1122 10:47:35.604831    2612 out.go:239] * 
* 
W1122 10:47:35.606235    2612 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I1122 10:47:35.609851    2612 out.go:177] 
multinode_test.go:257: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-722000 node start m03 --alsologtostderr": exit status 85
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status: exit status 7 (31.148042ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:263: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-722000 status" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (30.689ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (0.11s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (5.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-722000
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 stop -p multinode-722000
multinode_test.go:295: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-722000 --wait=true -v=8 --alsologtostderr
multinode_test.go:295: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-722000 --wait=true -v=8 --alsologtostderr: exit status 80 (5.190796042s)

                                                
                                                
-- stdout --
	* [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node multinode-722000 in cluster multinode-722000
	* Restarting existing qemu2 VM for "multinode-722000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-722000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:35.802535    2622 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:35.802665    2622 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.802669    2622 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:35.802671    2622 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:35.802790    2622 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:35.803790    2622 out.go:303] Setting JSON to false
	I1122 10:47:35.819296    2622 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1025,"bootTime":1700677830,"procs":456,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:47:35.819385    2622 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:47:35.823876    2622 out.go:177] * [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:47:35.829741    2622 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:47:35.833812    2622 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:47:35.829782    2622 notify.go:220] Checking for updates...
	I1122 10:47:35.841739    2622 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:47:35.845757    2622 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:47:35.848824    2622 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:47:35.851862    2622 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:47:35.855086    2622 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:35.855140    2622 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:47:35.859798    2622 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:47:35.866860    2622 start.go:298] selected driver: qemu2
	I1122 10:47:35.866865    2622 start.go:902] validating driver "qemu2" against &{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2
62144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:47:35.866906    2622 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:47:35.869127    2622 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:47:35.869180    2622 cni.go:84] Creating CNI manager for ""
	I1122 10:47:35.869185    2622 cni.go:136] 1 nodes found, recommending kindnet
	I1122 10:47:35.869194    2622 start_flags.go:323] config:
	{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:47:35.873376    2622 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:47:35.880833    2622 out.go:177] * Starting control plane node multinode-722000 in cluster multinode-722000
	I1122 10:47:35.884790    2622 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:47:35.884803    2622 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:47:35.884809    2622 cache.go:56] Caching tarball of preloaded images
	I1122 10:47:35.884857    2622 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:47:35.884862    2622 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:47:35.884912    2622 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/multinode-722000/config.json ...
	I1122 10:47:35.885414    2622 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:47:35.885443    2622 start.go:369] acquired machines lock for "multinode-722000" in 23.833µs
	I1122 10:47:35.885451    2622 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:47:35.885457    2622 fix.go:54] fixHost starting: 
	I1122 10:47:35.885580    2622 fix.go:102] recreateIfNeeded on multinode-722000: state=Stopped err=<nil>
	W1122 10:47:35.885588    2622 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:47:35.888857    2622 out.go:177] * Restarting existing qemu2 VM for "multinode-722000" ...
	I1122 10:47:35.895765    2622 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:e8:73:17:b1:55 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:47:35.897717    2622 main.go:141] libmachine: STDOUT: 
	I1122 10:47:35.897737    2622 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:47:35.897762    2622 fix.go:56] fixHost completed within 12.30475ms
	I1122 10:47:35.897765    2622 start.go:83] releasing machines lock for "multinode-722000", held for 12.318209ms
	W1122 10:47:35.897772    2622 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:47:35.897804    2622 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:47:35.897809    2622 start.go:706] Will try again in 5 seconds ...
	I1122 10:47:40.899923    2622 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:47:40.900328    2622 start.go:369] acquired machines lock for "multinode-722000" in 258.75µs
	I1122 10:47:40.900467    2622 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:47:40.900488    2622 fix.go:54] fixHost starting: 
	I1122 10:47:40.901204    2622 fix.go:102] recreateIfNeeded on multinode-722000: state=Stopped err=<nil>
	W1122 10:47:40.901232    2622 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:47:40.910740    2622 out.go:177] * Restarting existing qemu2 VM for "multinode-722000" ...
	I1122 10:47:40.915015    2622 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:e8:73:17:b1:55 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:47:40.924821    2622 main.go:141] libmachine: STDOUT: 
	I1122 10:47:40.924881    2622 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:47:40.924938    2622 fix.go:56] fixHost completed within 24.45325ms
	I1122 10:47:40.924950    2622 start.go:83] releasing machines lock for "multinode-722000", held for 24.600916ms
	W1122 10:47:40.925099    2622 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:47:40.932556    2622 out.go:177] 
	W1122 10:47:40.936746    2622 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:47:40.936797    2622 out.go:239] * 
	* 
	W1122 10:47:40.939652    2622 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:47:40.949652    2622 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:297: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p multinode-722000" : exit status 80
multinode_test.go:300: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-722000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (34.482167ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (5.39s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.1s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 node delete m03
multinode_test.go:394: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 node delete m03: exit status 89 (40.942042ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-722000"

                                                
                                                
-- /stdout --
multinode_test.go:396: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-722000 node delete m03": exit status 89
multinode_test.go:400: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr
multinode_test.go:400: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr: exit status 7 (31.655084ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:41.143975    2638 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:41.144144    2638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.144151    2638 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:41.144153    2638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.144285    2638 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:41.144410    2638 out.go:303] Setting JSON to false
	I1122 10:47:41.144422    2638 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:41.144478    2638 notify.go:220] Checking for updates...
	I1122 10:47:41.144648    2638 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:41.144654    2638 status.go:255] checking status of multinode-722000 ...
	I1122 10:47:41.144851    2638 status.go:330] multinode-722000 host status = "Stopped" (err=<nil>)
	I1122 10:47:41.144855    2638 status.go:343] host is not running, skipping remaining checks
	I1122 10:47:41.144857    2638 status.go:257] multinode-722000 status: &{Name:multinode-722000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:402: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.761834ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.10s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (0.16s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 stop
multinode_test.go:320: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status: exit status 7 (32.006167ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr: exit status 7 (32.153042ms)

                                                
                                                
-- stdout --
	multinode-722000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:41.302511    2646 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:41.302699    2646 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.302703    2646 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:41.302705    2646 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.302850    2646 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:41.302969    2646 out.go:303] Setting JSON to false
	I1122 10:47:41.302981    2646 mustload.go:65] Loading cluster: multinode-722000
	I1122 10:47:41.303031    2646 notify.go:220] Checking for updates...
	I1122 10:47:41.303195    2646 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:41.303201    2646 status.go:255] checking status of multinode-722000 ...
	I1122 10:47:41.303413    2646 status.go:330] multinode-722000 host status = "Stopped" (err=<nil>)
	I1122 10:47:41.303416    2646 status.go:343] host is not running, skipping remaining checks
	I1122 10:47:41.303418    2646 status.go:257] multinode-722000 status: &{Name:multinode-722000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:333: incorrect number of stopped hosts: args "out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr": multinode-722000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:337: incorrect number of stopped kubelets: args "out/minikube-darwin-arm64 -p multinode-722000 status --alsologtostderr": multinode-722000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (31.809291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (0.16s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:354: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-722000 --wait=true -v=8 --alsologtostderr --driver=qemu2 
multinode_test.go:354: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-722000 --wait=true -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (5.183184167s)

                                                
                                                
-- stdout --
	* [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node multinode-722000 in cluster multinode-722000
	* Restarting existing qemu2 VM for "multinode-722000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "multinode-722000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:47:41.365805    2650 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:47:41.365972    2650 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.365975    2650 out.go:309] Setting ErrFile to fd 2...
	I1122 10:47:41.365978    2650 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:47:41.366112    2650 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:47:41.367045    2650 out.go:303] Setting JSON to false
	I1122 10:47:41.382979    2650 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1031,"bootTime":1700677830,"procs":458,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:47:41.383079    2650 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:47:41.388059    2650 out.go:177] * [multinode-722000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:47:41.395088    2650 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:47:41.398941    2650 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:47:41.395126    2650 notify.go:220] Checking for updates...
	I1122 10:47:41.405034    2650 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:47:41.407973    2650 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:47:41.411006    2650 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:47:41.414061    2650 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:47:41.417271    2650 config.go:182] Loaded profile config "multinode-722000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:47:41.417529    2650 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:47:41.422045    2650 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:47:41.427991    2650 start.go:298] selected driver: qemu2
	I1122 10:47:41.427997    2650 start.go:902] validating driver "qemu2" against &{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2
62144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:47:41.428048    2650 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:47:41.430337    2650 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:47:41.430378    2650 cni.go:84] Creating CNI manager for ""
	I1122 10:47:41.430382    2650 cni.go:136] 1 nodes found, recommending kindnet
	I1122 10:47:41.430386    2650 start_flags.go:323] config:
	{Name:multinode-722000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-722000 Namespace:default API
ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di
sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:47:41.434500    2650 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:47:41.442065    2650 out.go:177] * Starting control plane node multinode-722000 in cluster multinode-722000
	I1122 10:47:41.445976    2650 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:47:41.445992    2650 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:47:41.446001    2650 cache.go:56] Caching tarball of preloaded images
	I1122 10:47:41.446048    2650 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:47:41.446053    2650 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:47:41.446118    2650 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/multinode-722000/config.json ...
	I1122 10:47:41.446601    2650 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:47:41.446630    2650 start.go:369] acquired machines lock for "multinode-722000" in 23.625µs
	I1122 10:47:41.446637    2650 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:47:41.446642    2650 fix.go:54] fixHost starting: 
	I1122 10:47:41.446748    2650 fix.go:102] recreateIfNeeded on multinode-722000: state=Stopped err=<nil>
	W1122 10:47:41.446755    2650 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:47:41.450995    2650 out.go:177] * Restarting existing qemu2 VM for "multinode-722000" ...
	I1122 10:47:41.458996    2650 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:e8:73:17:b1:55 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:47:41.460928    2650 main.go:141] libmachine: STDOUT: 
	I1122 10:47:41.460954    2650 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:47:41.460979    2650 fix.go:56] fixHost completed within 14.336625ms
	I1122 10:47:41.460983    2650 start.go:83] releasing machines lock for "multinode-722000", held for 14.349125ms
	W1122 10:47:41.460990    2650 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:47:41.461018    2650 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:47:41.461022    2650 start.go:706] Will try again in 5 seconds ...
	I1122 10:47:46.463110    2650 start.go:365] acquiring machines lock for multinode-722000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:47:46.463506    2650 start.go:369] acquired machines lock for "multinode-722000" in 277.958µs
	I1122 10:47:46.463608    2650 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:47:46.463627    2650 fix.go:54] fixHost starting: 
	I1122 10:47:46.464266    2650 fix.go:102] recreateIfNeeded on multinode-722000: state=Stopped err=<nil>
	W1122 10:47:46.464293    2650 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:47:46.468425    2650 out.go:177] * Restarting existing qemu2 VM for "multinode-722000" ...
	I1122 10:47:46.475542    2650 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:e8:73:17:b1:55 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/multinode-722000/disk.qcow2
	I1122 10:47:46.484517    2650 main.go:141] libmachine: STDOUT: 
	I1122 10:47:46.484598    2650 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:47:46.484676    2650 fix.go:56] fixHost completed within 21.044833ms
	I1122 10:47:46.484693    2650 start.go:83] releasing machines lock for "multinode-722000", held for 21.165583ms
	W1122 10:47:46.484852    2650 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-722000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:47:46.492315    2650 out.go:177] 
	W1122 10:47:46.495448    2650 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:47:46.495496    2650 out.go:239] * 
	* 
	W1122 10:47:46.498025    2650 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:47:46.505394    2650 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:356: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-722000 --wait=true -v=8 --alsologtostderr --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (71.0915ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.26s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (20.18s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-722000
multinode_test.go:452: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-722000-m01 --driver=qemu2 
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-722000-m01 --driver=qemu2 : exit status 80 (9.818244042s)

                                                
                                                
-- stdout --
	* [multinode-722000-m01] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node multinode-722000-m01 in cluster multinode-722000-m01
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-722000-m01" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-722000-m01" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-722000-m02 --driver=qemu2 
multinode_test.go:460: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-722000-m02 --driver=qemu2 : exit status 80 (10.103255208s)

                                                
                                                
-- stdout --
	* [multinode-722000-m02] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node multinode-722000-m02 in cluster multinode-722000-m02
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "multinode-722000-m02" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p multinode-722000-m02" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:462: failed to start profile. args "out/minikube-darwin-arm64 start -p multinode-722000-m02 --driver=qemu2 " : exit status 80
multinode_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-722000
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-722000: exit status 89 (80.304292ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-722000"

                                                
                                                
-- /stdout --
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 delete -p multinode-722000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-722000 -n multinode-722000: exit status 7 (32.000709ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (20.18s)

                                                
                                    
x
+
TestPreload (9.95s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p test-preload-505000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p test-preload-505000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4: exit status 80 (9.777436083s)

                                                
                                                
-- stdout --
	* [test-preload-505000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node test-preload-505000 in cluster test-preload-505000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "test-preload-505000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:48:06.932750    2708 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:48:06.932899    2708 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:06.932902    2708 out.go:309] Setting ErrFile to fd 2...
	I1122 10:48:06.932905    2708 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:48:06.933033    2708 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:48:06.934163    2708 out.go:303] Setting JSON to false
	I1122 10:48:06.950173    2708 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1056,"bootTime":1700677830,"procs":456,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:48:06.950264    2708 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:48:06.956416    2708 out.go:177] * [test-preload-505000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:48:06.960344    2708 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:48:06.964324    2708 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:48:06.960405    2708 notify.go:220] Checking for updates...
	I1122 10:48:06.970787    2708 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:48:06.974335    2708 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:48:06.977365    2708 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:48:06.980365    2708 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:48:06.983822    2708 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:48:06.983863    2708 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:48:06.988333    2708 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:48:06.995384    2708 start.go:298] selected driver: qemu2
	I1122 10:48:06.995392    2708 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:48:06.995398    2708 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:48:06.997679    2708 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:48:07.000370    2708 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:48:07.003427    2708 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:48:07.003468    2708 cni.go:84] Creating CNI manager for ""
	I1122 10:48:07.003477    2708 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:48:07.003482    2708 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:48:07.003489    2708 start_flags.go:323] config:
	{Name:test-preload-505000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-505000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock:
SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:48:07.007972    2708 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.015321    2708 out.go:177] * Starting control plane node test-preload-505000 in cluster test-preload-505000
	I1122 10:48:07.018355    2708 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I1122 10:48:07.018443    2708 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/test-preload-505000/config.json ...
	I1122 10:48:07.018466    2708 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/test-preload-505000/config.json: {Name:mk35d00e3b10a4cb7e34fd4aef817f1fa239502f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:48:07.018454    2708 cache.go:107] acquiring lock: {Name:mkbef117d2e894e7b753701ebf11c035a4ee5166 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018454    2708 cache.go:107] acquiring lock: {Name:mk0f6cdb8005d4a570d795f2da365a2399b596a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018489    2708 cache.go:107] acquiring lock: {Name:mke6f5c5ff6953ed8a6b03852cc42d5af56482b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018497    2708 cache.go:107] acquiring lock: {Name:mk946bd913c23deb712dffb487b09d62b227edd9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018622    2708 cache.go:107] acquiring lock: {Name:mka166b303b3c3ae8aad20c6d4b60a50def2fe2d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018725    2708 cache.go:107] acquiring lock: {Name:mk4bb583fe2645725c3e52539fbb430b18fd5192 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018741    2708 start.go:365] acquiring machines lock for test-preload-505000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:07.018661    2708 cache.go:107] acquiring lock: {Name:mkf2550f288c90ef26731e08c0c454727a0df616 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018693    2708 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1122 10:48:07.018704    2708 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1122 10:48:07.018707    2708 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I1122 10:48:07.018821    2708 start.go:369] acquired machines lock for "test-preload-505000" in 73.334µs
	I1122 10:48:07.018709    2708 cache.go:107] acquiring lock: {Name:mkca21a2ffa1fdf9ef685fea366b8ce270cfbafa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:48:07.018870    2708 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1122 10:48:07.018832    2708 start.go:93] Provisioning new machine with config: &{Name:test-preload-505000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-505000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mo
untMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:07.018884    2708 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:07.022414    2708 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:48:07.018962    2708 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1122 10:48:07.019011    2708 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I1122 10:48:07.019092    2708 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I1122 10:48:07.019412    2708 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I1122 10:48:07.029398    2708 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1122 10:48:07.029486    2708 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1122 10:48:07.030201    2708 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I1122 10:48:07.031399    2708 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1122 10:48:07.031439    2708 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1122 10:48:07.031473    2708 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1122 10:48:07.031507    2708 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I1122 10:48:07.032693    2708 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I1122 10:48:07.039331    2708 start.go:159] libmachine.API.Create for "test-preload-505000" (driver="qemu2")
	I1122 10:48:07.039352    2708 client.go:168] LocalClient.Create starting
	I1122 10:48:07.039412    2708 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:07.039440    2708 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:07.039452    2708 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:07.039490    2708 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:07.039513    2708 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:07.039522    2708 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:07.039847    2708 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:07.167560    2708 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:07.213490    2708 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:07.213515    2708 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:07.213735    2708 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:07.226365    2708 main.go:141] libmachine: STDOUT: 
	I1122 10:48:07.226383    2708 main.go:141] libmachine: STDERR: 
	I1122 10:48:07.226439    2708 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2 +20000M
	I1122 10:48:07.238164    2708 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:07.238192    2708 main.go:141] libmachine: STDERR: 
	I1122 10:48:07.238208    2708 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:07.238212    2708 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:07.238246    2708 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:82:3f:3a:62:25 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:07.240155    2708 main.go:141] libmachine: STDOUT: 
	I1122 10:48:07.240174    2708 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:07.240190    2708 client.go:171] LocalClient.Create took 200.836208ms
	I1122 10:48:07.419253    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4
	I1122 10:48:07.420284    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7
	I1122 10:48:07.422802    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4
	I1122 10:48:07.460941    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0
	W1122 10:48:07.478726    2708 image.go:265] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing
	I1122 10:48:07.478759    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6
	I1122 10:48:07.525017    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4
	I1122 10:48:07.545439    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4
	I1122 10:48:07.547533    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 exists
	I1122 10:48:07.547549    2708 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7" took 529.081167ms
	I1122 10:48:07.547569    2708 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 succeeded
	W1122 10:48:08.105782    2708 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I1122 10:48:08.105889    2708 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1122 10:48:08.388537    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1122 10:48:08.388607    2708 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 1.370175875s
	I1122 10:48:08.388641    2708 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1122 10:48:09.082741    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I1122 10:48:09.082796    2708 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6" took 2.064106583s
	I1122 10:48:09.082831    2708 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I1122 10:48:09.240363    2708 start.go:128] duration metric: createHost completed in 2.22149525s
	I1122 10:48:09.240419    2708 start.go:83] releasing machines lock for "test-preload-505000", held for 2.221622041s
	W1122 10:48:09.240472    2708 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:09.249605    2708 out.go:177] * Deleting "test-preload-505000" in qemu2 ...
	W1122 10:48:09.273456    2708 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:09.273489    2708 start.go:706] Will try again in 5 seconds ...
	I1122 10:48:09.822214    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I1122 10:48:09.822286    2708 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4" took 2.803717334s
	I1122 10:48:09.822316    2708 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I1122 10:48:10.735802    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I1122 10:48:10.735854    2708 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4" took 3.717296084s
	I1122 10:48:10.735881    2708 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I1122 10:48:11.418964    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I1122 10:48:11.419012    2708 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4" took 4.400635458s
	I1122 10:48:11.419040    2708 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I1122 10:48:12.526927    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I1122 10:48:12.526981    2708 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4" took 5.508366167s
	I1122 10:48:12.527016    2708 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I1122 10:48:14.273743    2708 start.go:365] acquiring machines lock for test-preload-505000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:48:14.274099    2708 start.go:369] acquired machines lock for "test-preload-505000" in 273.208µs
	I1122 10:48:14.274208    2708 start.go:93] Provisioning new machine with config: &{Name:test-preload-505000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-505000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mo
untMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:48:14.274426    2708 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:48:14.285060    2708 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:48:14.332233    2708 start.go:159] libmachine.API.Create for "test-preload-505000" (driver="qemu2")
	I1122 10:48:14.332277    2708 client.go:168] LocalClient.Create starting
	I1122 10:48:14.332379    2708 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:48:14.332438    2708 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:14.332468    2708 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:14.332536    2708 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:48:14.332577    2708 main.go:141] libmachine: Decoding PEM data...
	I1122 10:48:14.332590    2708 main.go:141] libmachine: Parsing certificate...
	I1122 10:48:14.333110    2708 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:48:14.475094    2708 main.go:141] libmachine: Creating SSH key...
	I1122 10:48:14.612146    2708 main.go:141] libmachine: Creating Disk image...
	I1122 10:48:14.612152    2708 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:48:14.612317    2708 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:14.624418    2708 main.go:141] libmachine: STDOUT: 
	I1122 10:48:14.624451    2708 main.go:141] libmachine: STDERR: 
	I1122 10:48:14.624505    2708 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2 +20000M
	I1122 10:48:14.635159    2708 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:48:14.635188    2708 main.go:141] libmachine: STDERR: 
	I1122 10:48:14.635203    2708 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:14.635207    2708 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:48:14.635257    2708 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/qemu.pid -device virtio-net-pci,netdev=net0,mac=8a:a7:5a:66:c7:48 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/test-preload-505000/disk.qcow2
	I1122 10:48:14.637072    2708 main.go:141] libmachine: STDOUT: 
	I1122 10:48:14.637097    2708 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:48:14.637113    2708 client.go:171] LocalClient.Create took 304.835417ms
	I1122 10:48:16.273082    2708 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 exists
	I1122 10:48:16.273136    2708 cache.go:96] cache image "registry.k8s.io/etcd:3.5.3-0" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0" took 9.254807333s
	I1122 10:48:16.273166    2708 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.3-0 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0 succeeded
	I1122 10:48:16.273214    2708 cache.go:87] Successfully saved all images to host disk.
	I1122 10:48:16.639334    2708 start.go:128] duration metric: createHost completed in 2.364890375s
	I1122 10:48:16.639401    2708 start.go:83] releasing machines lock for "test-preload-505000", held for 2.365323292s
	W1122 10:48:16.639694    2708 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p test-preload-505000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p test-preload-505000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:48:16.649260    2708 out.go:177] 
	W1122 10:48:16.653238    2708 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:48:16.653265    2708 out.go:239] * 
	* 
	W1122 10:48:16.656004    2708 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:48:16.665212    2708 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-arm64 start -p test-preload-505000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4 failed: exit status 80
panic.go:523: *** TestPreload FAILED at 2023-11-22 10:48:16.683305 -0800 PST m=+745.489390335
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-505000 -n test-preload-505000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-505000 -n test-preload-505000: exit status 7 (67.271417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-505000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-505000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p test-preload-505000
--- FAIL: TestPreload (9.95s)

                                                
                                    
x
+
TestScheduledStopUnix (9.98s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 start -p scheduled-stop-847000 --memory=2048 --driver=qemu2 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p scheduled-stop-847000 --memory=2048 --driver=qemu2 : exit status 80 (9.811294208s)

                                                
                                                
-- stdout --
	* [scheduled-stop-847000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node scheduled-stop-847000 in cluster scheduled-stop-847000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-847000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-847000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [scheduled-stop-847000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node scheduled-stop-847000 in cluster scheduled-stop-847000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "scheduled-stop-847000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p scheduled-stop-847000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:523: *** TestScheduledStopUnix FAILED at 2023-11-22 10:48:26.664681 -0800 PST m=+755.470944626
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-847000 -n scheduled-stop-847000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p scheduled-stop-847000 -n scheduled-stop-847000: exit status 7 (71.266542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-847000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-847000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p scheduled-stop-847000
--- FAIL: TestScheduledStopUnix (9.98s)

                                                
                                    
x
+
TestSkaffold (12.98s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/skaffold.exe54599874 version
skaffold_test.go:63: skaffold version: v2.9.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-arm64 start -p skaffold-054000 --memory=2600 --driver=qemu2 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p skaffold-054000 --memory=2600 --driver=qemu2 : exit status 80 (9.85345225s)

                                                
                                                
-- stdout --
	* [skaffold-054000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node skaffold-054000 in cluster skaffold-054000
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-054000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-054000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 80

                                                
                                                
-- stdout --
	* [skaffold-054000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node skaffold-054000 in cluster skaffold-054000
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "skaffold-054000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p skaffold-054000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
panic.go:523: *** TestSkaffold FAILED at 2023-11-22 10:48:39.644447 -0800 PST m=+768.450942460
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-054000 -n skaffold-054000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p skaffold-054000 -n skaffold-054000: exit status 7 (64.37625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-054000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-054000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p skaffold-054000
--- FAIL: TestSkaffold (12.98s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (121.75s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
E1122 10:49:26.209615    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:49:38.575655    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
E1122 10:50:19.535367    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
version_upgrade_test.go:107: v1.6.2 release installation failed: bad response code: 404
panic.go:523: *** TestRunningBinaryUpgrade FAILED at 2023-11-22 10:51:21.81371 -0800 PST m=+930.623105126
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-328000 -n running-upgrade-328000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p running-upgrade-328000 -n running-upgrade-328000: exit status 85 (87.410875ms)

                                                
                                                
-- stdout --
	* Profile "running-upgrade-328000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p running-upgrade-328000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "running-upgrade-328000" host is not running, skipping log retrieval (state="* Profile \"running-upgrade-328000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p running-upgrade-328000\"")
helpers_test.go:175: Cleaning up "running-upgrade-328000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p running-upgrade-328000
--- FAIL: TestRunningBinaryUpgrade (121.75s)

                                                
                                    
x
+
TestKubernetesUpgrade (15.37s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:235: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:235: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (9.833883292s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-462000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node kubernetes-upgrade-462000 in cluster kubernetes-upgrade-462000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubernetes-upgrade-462000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:51:22.167365    3152 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:51:22.167506    3152 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:51:22.167509    3152 out.go:309] Setting ErrFile to fd 2...
	I1122 10:51:22.167512    3152 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:51:22.167642    3152 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:51:22.168745    3152 out.go:303] Setting JSON to false
	I1122 10:51:22.184615    3152 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1252,"bootTime":1700677830,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:51:22.184711    3152 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:51:22.189519    3152 out.go:177] * [kubernetes-upgrade-462000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:51:22.197476    3152 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:51:22.201498    3152 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:51:22.197530    3152 notify.go:220] Checking for updates...
	I1122 10:51:22.208486    3152 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:51:22.216338    3152 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:51:22.219490    3152 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:51:22.223500    3152 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:51:22.225374    3152 config.go:182] Loaded profile config "cert-expiration-403000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:51:22.225443    3152 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:51:22.225490    3152 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:51:22.229396    3152 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:51:22.236304    3152 start.go:298] selected driver: qemu2
	I1122 10:51:22.236310    3152 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:51:22.236317    3152 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:51:22.238640    3152 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:51:22.241416    3152 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:51:22.244543    3152 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1122 10:51:22.244582    3152 cni.go:84] Creating CNI manager for ""
	I1122 10:51:22.244589    3152 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:51:22.244593    3152 start_flags.go:323] config:
	{Name:kubernetes-upgrade-462000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-462000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:51:22.249021    3152 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:51:22.256428    3152 out.go:177] * Starting control plane node kubernetes-upgrade-462000 in cluster kubernetes-upgrade-462000
	I1122 10:51:22.260443    3152 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:51:22.260463    3152 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:51:22.260474    3152 cache.go:56] Caching tarball of preloaded images
	I1122 10:51:22.260533    3152 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:51:22.260547    3152 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1122 10:51:22.260604    3152 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubernetes-upgrade-462000/config.json ...
	I1122 10:51:22.260621    3152 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubernetes-upgrade-462000/config.json: {Name:mkb24b770c641d8830abaf6fce9a9f51611b9913 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:51:22.260836    3152 start.go:365] acquiring machines lock for kubernetes-upgrade-462000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:51:22.260872    3152 start.go:369] acquired machines lock for "kubernetes-upgrade-462000" in 26.458µs
	I1122 10:51:22.260883    3152 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-462000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-462000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID
:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:51:22.260916    3152 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:51:22.268508    3152 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:51:22.286004    3152 start.go:159] libmachine.API.Create for "kubernetes-upgrade-462000" (driver="qemu2")
	I1122 10:51:22.286026    3152 client.go:168] LocalClient.Create starting
	I1122 10:51:22.286091    3152 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:51:22.286120    3152 main.go:141] libmachine: Decoding PEM data...
	I1122 10:51:22.286130    3152 main.go:141] libmachine: Parsing certificate...
	I1122 10:51:22.286167    3152 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:51:22.286190    3152 main.go:141] libmachine: Decoding PEM data...
	I1122 10:51:22.286198    3152 main.go:141] libmachine: Parsing certificate...
	I1122 10:51:22.286559    3152 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:51:22.412101    3152 main.go:141] libmachine: Creating SSH key...
	I1122 10:51:22.490009    3152 main.go:141] libmachine: Creating Disk image...
	I1122 10:51:22.490015    3152 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:51:22.490189    3152 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:22.502093    3152 main.go:141] libmachine: STDOUT: 
	I1122 10:51:22.502113    3152 main.go:141] libmachine: STDERR: 
	I1122 10:51:22.502163    3152 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2 +20000M
	I1122 10:51:22.512879    3152 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:51:22.512900    3152 main.go:141] libmachine: STDERR: 
	I1122 10:51:22.512935    3152 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:22.512941    3152 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:51:22.512976    3152 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/qemu.pid -device virtio-net-pci,netdev=net0,mac=16:db:b6:5f:39:30 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:22.514825    3152 main.go:141] libmachine: STDOUT: 
	I1122 10:51:22.514852    3152 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:51:22.514869    3152 client.go:171] LocalClient.Create took 228.8425ms
	I1122 10:51:24.517013    3152 start.go:128] duration metric: createHost completed in 2.256114792s
	I1122 10:51:24.517057    3152 start.go:83] releasing machines lock for "kubernetes-upgrade-462000", held for 2.256215583s
	W1122 10:51:24.517121    3152 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:51:24.531487    3152 out.go:177] * Deleting "kubernetes-upgrade-462000" in qemu2 ...
	W1122 10:51:24.555159    3152 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:51:24.555187    3152 start.go:706] Will try again in 5 seconds ...
	I1122 10:51:29.557366    3152 start.go:365] acquiring machines lock for kubernetes-upgrade-462000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:51:29.557704    3152 start.go:369] acquired machines lock for "kubernetes-upgrade-462000" in 254µs
	I1122 10:51:29.557877    3152 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-462000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-462000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID
:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:51:29.558117    3152 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:51:29.573066    3152 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:51:29.624249    3152 start.go:159] libmachine.API.Create for "kubernetes-upgrade-462000" (driver="qemu2")
	I1122 10:51:29.624293    3152 client.go:168] LocalClient.Create starting
	I1122 10:51:29.624405    3152 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:51:29.624463    3152 main.go:141] libmachine: Decoding PEM data...
	I1122 10:51:29.624478    3152 main.go:141] libmachine: Parsing certificate...
	I1122 10:51:29.624554    3152 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:51:29.624597    3152 main.go:141] libmachine: Decoding PEM data...
	I1122 10:51:29.624609    3152 main.go:141] libmachine: Parsing certificate...
	I1122 10:51:29.625124    3152 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:51:29.794735    3152 main.go:141] libmachine: Creating SSH key...
	I1122 10:51:29.901998    3152 main.go:141] libmachine: Creating Disk image...
	I1122 10:51:29.902004    3152 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:51:29.902454    3152 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:29.915068    3152 main.go:141] libmachine: STDOUT: 
	I1122 10:51:29.915091    3152 main.go:141] libmachine: STDERR: 
	I1122 10:51:29.915147    3152 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2 +20000M
	I1122 10:51:29.925677    3152 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:51:29.925709    3152 main.go:141] libmachine: STDERR: 
	I1122 10:51:29.925727    3152 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:29.925736    3152 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:51:29.925776    3152 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:51:42:e1:dc:b8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:29.927482    3152 main.go:141] libmachine: STDOUT: 
	I1122 10:51:29.927498    3152 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:51:29.927511    3152 client.go:171] LocalClient.Create took 303.215375ms
	I1122 10:51:31.929665    3152 start.go:128] duration metric: createHost completed in 2.371529792s
	I1122 10:51:31.929713    3152 start.go:83] releasing machines lock for "kubernetes-upgrade-462000", held for 2.372028542s
	W1122 10:51:31.930144    3152 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-462000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-462000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:51:31.940902    3152 out.go:177] 
	W1122 10:51:31.944835    3152 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:51:31.944863    3152 out.go:239] * 
	* 
	W1122 10:51:31.947831    3152 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:51:31.956827    3152 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:237: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=qemu2 : exit status 80
version_upgrade_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 stop -p kubernetes-upgrade-462000
version_upgrade_test.go:245: (dbg) Run:  out/minikube-darwin-arm64 -p kubernetes-upgrade-462000 status --format={{.Host}}
version_upgrade_test.go:245: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p kubernetes-upgrade-462000 status --format={{.Host}}: exit status 7 (37.783208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:247: status error: exit status 7 (may be ok)
version_upgrade_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.28.4 --alsologtostderr -v=1 --driver=qemu2 
version_upgrade_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.28.4 --alsologtostderr -v=1 --driver=qemu2 : exit status 80 (5.188328292s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-462000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node kubernetes-upgrade-462000 in cluster kubernetes-upgrade-462000
	* Restarting existing qemu2 VM for "kubernetes-upgrade-462000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "kubernetes-upgrade-462000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:51:32.144620    3170 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:51:32.144781    3170 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:51:32.144784    3170 out.go:309] Setting ErrFile to fd 2...
	I1122 10:51:32.144787    3170 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:51:32.144915    3170 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:51:32.145908    3170 out.go:303] Setting JSON to false
	I1122 10:51:32.161752    3170 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1262,"bootTime":1700677830,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:51:32.161815    3170 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:51:32.166826    3170 out.go:177] * [kubernetes-upgrade-462000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:51:32.173800    3170 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:51:32.173841    3170 notify.go:220] Checking for updates...
	I1122 10:51:32.181709    3170 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:51:32.184774    3170 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:51:32.187783    3170 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:51:32.190784    3170 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:51:32.193782    3170 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:51:32.197052    3170 config.go:182] Loaded profile config "kubernetes-upgrade-462000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1122 10:51:32.197332    3170 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:51:32.201731    3170 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:51:32.208788    3170 start.go:298] selected driver: qemu2
	I1122 10:51:32.208794    3170 start.go:902] validating driver "qemu2" against &{Name:kubernetes-upgrade-462000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubern
etesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-462000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:do
cker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:51:32.208850    3170 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:51:32.211337    3170 cni.go:84] Creating CNI manager for ""
	I1122 10:51:32.211356    3170 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:51:32.211364    3170 start_flags.go:323] config:
	{Name:kubernetes-upgrade-462000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubernetes-upgrade-462000 Nam
espace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFi
rmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:51:32.215753    3170 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:51:32.222789    3170 out.go:177] * Starting control plane node kubernetes-upgrade-462000 in cluster kubernetes-upgrade-462000
	I1122 10:51:32.226778    3170 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:51:32.226795    3170 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:51:32.226805    3170 cache.go:56] Caching tarball of preloaded images
	I1122 10:51:32.226862    3170 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:51:32.226868    3170 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:51:32.226938    3170 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubernetes-upgrade-462000/config.json ...
	I1122 10:51:32.227476    3170 start.go:365] acquiring machines lock for kubernetes-upgrade-462000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:51:32.227501    3170 start.go:369] acquired machines lock for "kubernetes-upgrade-462000" in 19.625µs
	I1122 10:51:32.227509    3170 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:51:32.227515    3170 fix.go:54] fixHost starting: 
	I1122 10:51:32.227630    3170 fix.go:102] recreateIfNeeded on kubernetes-upgrade-462000: state=Stopped err=<nil>
	W1122 10:51:32.227639    3170 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:51:32.236748    3170 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-462000" ...
	I1122 10:51:32.240732    3170 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:51:42:e1:dc:b8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:32.242900    3170 main.go:141] libmachine: STDOUT: 
	I1122 10:51:32.242923    3170 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:51:32.242951    3170 fix.go:56] fixHost completed within 15.43575ms
	I1122 10:51:32.242956    3170 start.go:83] releasing machines lock for "kubernetes-upgrade-462000", held for 15.4515ms
	W1122 10:51:32.242967    3170 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:51:32.242999    3170 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:51:32.243004    3170 start.go:706] Will try again in 5 seconds ...
	I1122 10:51:37.245095    3170 start.go:365] acquiring machines lock for kubernetes-upgrade-462000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:51:37.245483    3170 start.go:369] acquired machines lock for "kubernetes-upgrade-462000" in 265.375µs
	I1122 10:51:37.245596    3170 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:51:37.245614    3170 fix.go:54] fixHost starting: 
	I1122 10:51:37.246281    3170 fix.go:102] recreateIfNeeded on kubernetes-upgrade-462000: state=Stopped err=<nil>
	W1122 10:51:37.246307    3170 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:51:37.251108    3170 out.go:177] * Restarting existing qemu2 VM for "kubernetes-upgrade-462000" ...
	I1122 10:51:37.260372    3170 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4e:51:42:e1:dc:b8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubernetes-upgrade-462000/disk.qcow2
	I1122 10:51:37.269353    3170 main.go:141] libmachine: STDOUT: 
	I1122 10:51:37.269428    3170 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:51:37.269494    3170 fix.go:56] fixHost completed within 23.880875ms
	I1122 10:51:37.269511    3170 start.go:83] releasing machines lock for "kubernetes-upgrade-462000", held for 24.006792ms
	W1122 10:51:37.269684    3170 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-462000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubernetes-upgrade-462000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:51:37.277132    3170 out.go:177] 
	W1122 10:51:37.280119    3170 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:51:37.280143    3170 out.go:239] * 
	* 
	W1122 10:51:37.282450    3170 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:51:37.290113    3170 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:258: failed to upgrade with newest k8s version. args: out/minikube-darwin-arm64 start -p kubernetes-upgrade-462000 --memory=2200 --kubernetes-version=v1.28.4 --alsologtostderr -v=1 --driver=qemu2  : exit status 80
version_upgrade_test.go:261: (dbg) Run:  kubectl --context kubernetes-upgrade-462000 version --output=json
version_upgrade_test.go:261: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-462000 version --output=json: exit status 1 (64.307625ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-462000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:263: error running kubectl: exit status 1
panic.go:523: *** TestKubernetesUpgrade FAILED at 2023-11-22 10:51:37.369352 -0800 PST m=+946.179025918
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-462000 -n kubernetes-upgrade-462000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p kubernetes-upgrade-462000 -n kubernetes-upgrade-462000: exit status 7 (35.982333ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-462000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-462000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p kubernetes-upgrade-462000
--- FAIL: TestKubernetesUpgrade (15.37s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1.45s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0 on darwin (arm64)
- MINIKUBE_LOCATION=17658
- KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current1755727272/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (1.45s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.22s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0 on darwin (arm64)
- MINIKUBE_LOCATION=17658
- KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current52146677/001
* Using the hyperkit driver based on user configuration

                                                
                                                
X Exiting due to DRV_UNSUPPORTED_OS: The driver 'hyperkit' is not supported on darwin/arm64

                                                
                                                
driver_install_or_update_test.go:209: failed to run minikube. got: exit status 56
--- FAIL: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (1.22s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (150.46s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
E1122 10:51:41.456311    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
version_upgrade_test.go:168: v1.6.2 release installation failed: bad response code: 404
--- FAIL: TestStoppedBinaryUpgrade/Setup (150.46s)

                                                
                                    
x
+
TestPause/serial/Start (9.82s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-arm64 start -p pause-986000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p pause-986000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 : exit status 80 (9.745165708s)

                                                
                                                
-- stdout --
	* [pause-986000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node pause-986000 in cluster pause-986000
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "pause-986000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p pause-986000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-arm64 start -p pause-986000 --memory=2048 --install-addons=false --wait=all --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p pause-986000 -n pause-986000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p pause-986000 -n pause-986000: exit status 7 (70.518292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-986000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (9.82s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (9.93s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 : exit status 80 (9.86184125s)

                                                
                                                
-- stdout --
	* [NoKubernetes-675000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node NoKubernetes-675000 in cluster NoKubernetes-675000
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "NoKubernetes-675000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-675000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000: exit status 7 (70.183042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-675000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (9.93s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 : exit status 80 (5.260220041s)

                                                
                                                
-- stdout --
	* [NoKubernetes-675000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-675000
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-675000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000: exit status 7 (71.742459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-675000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 : exit status 80 (5.243430542s)

                                                
                                                
-- stdout --
	* [NoKubernetes-675000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-675000
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-675000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000: exit status 7 (70.265708ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-675000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 : exit status 80 (5.245041083s)

                                                
                                                
-- stdout --
	* [NoKubernetes-675000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-675000
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "NoKubernetes-675000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p NoKubernetes-675000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-arm64 start -p NoKubernetes-675000 --driver=qemu2 " : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p NoKubernetes-675000 -n NoKubernetes-675000: exit status 7 (70.146791ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-675000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (9.94s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p auto-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p auto-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=qemu2 : exit status 80 (9.935839792s)

                                                
                                                
-- stdout --
	* [auto-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node auto-410000 in cluster auto-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "auto-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:52:56.843833    3301 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:52:56.843985    3301 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:52:56.843988    3301 out.go:309] Setting ErrFile to fd 2...
	I1122 10:52:56.843991    3301 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:52:56.844103    3301 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:52:56.845127    3301 out.go:303] Setting JSON to false
	I1122 10:52:56.861136    3301 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1346,"bootTime":1700677830,"procs":446,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:52:56.861202    3301 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:52:56.867608    3301 out.go:177] * [auto-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:52:56.875561    3301 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:52:56.875621    3301 notify.go:220] Checking for updates...
	I1122 10:52:56.880606    3301 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:52:56.883514    3301 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:52:56.886569    3301 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:52:56.889534    3301 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:52:56.892515    3301 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:52:56.895819    3301 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:52:56.895862    3301 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:52:56.900560    3301 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:52:56.907592    3301 start.go:298] selected driver: qemu2
	I1122 10:52:56.907600    3301 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:52:56.907607    3301 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:52:56.909973    3301 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:52:56.914556    3301 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:52:56.917599    3301 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:52:56.917634    3301 cni.go:84] Creating CNI manager for ""
	I1122 10:52:56.917642    3301 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:52:56.917646    3301 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:52:56.917652    3301 start_flags.go:323] config:
	{Name:auto-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:auto-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISoc
ket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0
AutoPauseInterval:1m0s GPUs:}
	I1122 10:52:56.922027    3301 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:52:56.928567    3301 out.go:177] * Starting control plane node auto-410000 in cluster auto-410000
	I1122 10:52:56.932531    3301 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:52:56.932547    3301 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:52:56.932561    3301 cache.go:56] Caching tarball of preloaded images
	I1122 10:52:56.932635    3301 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:52:56.932642    3301 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:52:56.932714    3301 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/auto-410000/config.json ...
	I1122 10:52:56.932734    3301 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/auto-410000/config.json: {Name:mk7430778a55bea785f458fe95e050dd0004894d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:52:56.932956    3301 start.go:365] acquiring machines lock for auto-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:52:56.932988    3301 start.go:369] acquired machines lock for "auto-410000" in 26.417µs
	I1122 10:52:56.932999    3301 start.go:93] Provisioning new machine with config: &{Name:auto-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:
{KubernetesVersion:v1.28.4 ClusterName:auto-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:52:56.933042    3301 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:52:56.940506    3301 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:52:56.958112    3301 start.go:159] libmachine.API.Create for "auto-410000" (driver="qemu2")
	I1122 10:52:56.958138    3301 client.go:168] LocalClient.Create starting
	I1122 10:52:56.958207    3301 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:52:56.958240    3301 main.go:141] libmachine: Decoding PEM data...
	I1122 10:52:56.958250    3301 main.go:141] libmachine: Parsing certificate...
	I1122 10:52:56.958291    3301 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:52:56.958313    3301 main.go:141] libmachine: Decoding PEM data...
	I1122 10:52:56.958319    3301 main.go:141] libmachine: Parsing certificate...
	I1122 10:52:56.958651    3301 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:52:57.086489    3301 main.go:141] libmachine: Creating SSH key...
	I1122 10:52:57.193642    3301 main.go:141] libmachine: Creating Disk image...
	I1122 10:52:57.193647    3301 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:52:57.193821    3301 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:52:57.206187    3301 main.go:141] libmachine: STDOUT: 
	I1122 10:52:57.206209    3301 main.go:141] libmachine: STDERR: 
	I1122 10:52:57.206268    3301 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2 +20000M
	I1122 10:52:57.216658    3301 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:52:57.216674    3301 main.go:141] libmachine: STDERR: 
	I1122 10:52:57.216694    3301 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:52:57.216699    3301 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:52:57.216726    3301 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:d0:27:ca:60:93 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:52:57.218437    3301 main.go:141] libmachine: STDOUT: 
	I1122 10:52:57.218461    3301 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:52:57.218487    3301 client.go:171] LocalClient.Create took 260.339792ms
	I1122 10:52:59.220627    3301 start.go:128] duration metric: createHost completed in 2.287603792s
	I1122 10:52:59.220680    3301 start.go:83] releasing machines lock for "auto-410000", held for 2.287723292s
	W1122 10:52:59.220742    3301 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:52:59.230866    3301 out.go:177] * Deleting "auto-410000" in qemu2 ...
	W1122 10:52:59.255978    3301 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:52:59.256005    3301 start.go:706] Will try again in 5 seconds ...
	I1122 10:53:04.258097    3301 start.go:365] acquiring machines lock for auto-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:04.258516    3301 start.go:369] acquired machines lock for "auto-410000" in 301.25µs
	I1122 10:53:04.258631    3301 start.go:93] Provisioning new machine with config: &{Name:auto-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:
{KubernetesVersion:v1.28.4 ClusterName:auto-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:04.258931    3301 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:04.265406    3301 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:04.310422    3301 start.go:159] libmachine.API.Create for "auto-410000" (driver="qemu2")
	I1122 10:53:04.310475    3301 client.go:168] LocalClient.Create starting
	I1122 10:53:04.310575    3301 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:04.310638    3301 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:04.310654    3301 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:04.310725    3301 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:04.310770    3301 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:04.310782    3301 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:04.311313    3301 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:04.448756    3301 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:04.678722    3301 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:04.678733    3301 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:04.678954    3301 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:53:04.691752    3301 main.go:141] libmachine: STDOUT: 
	I1122 10:53:04.691776    3301 main.go:141] libmachine: STDERR: 
	I1122 10:53:04.691851    3301 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2 +20000M
	I1122 10:53:04.702334    3301 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:04.702350    3301 main.go:141] libmachine: STDERR: 
	I1122 10:53:04.702365    3301 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:53:04.702368    3301 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:04.702410    3301 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=de:bb:80:0d:af:3d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/auto-410000/disk.qcow2
	I1122 10:53:04.703997    3301 main.go:141] libmachine: STDOUT: 
	I1122 10:53:04.704021    3301 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:04.704034    3301 client.go:171] LocalClient.Create took 393.559834ms
	I1122 10:53:06.706193    3301 start.go:128] duration metric: createHost completed in 2.447244167s
	I1122 10:53:06.706267    3301 start.go:83] releasing machines lock for "auto-410000", held for 2.447770542s
	W1122 10:53:06.706708    3301 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p auto-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p auto-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:06.716437    3301 out.go:177] 
	W1122 10:53:06.721601    3301 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:53:06.721674    3301 out.go:239] * 
	* 
	W1122 10:53:06.724199    3301 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:53:06.734346    3301 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/auto/Start (9.94s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (9.89s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p flannel-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p flannel-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=qemu2 : exit status 80 (9.889434459s)

                                                
                                                
-- stdout --
	* [flannel-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node flannel-410000 in cluster flannel-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "flannel-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:53:08.966237    3413 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:08.966382    3413 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:08.966385    3413 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:08.966388    3413 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:08.966527    3413 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:08.967501    3413 out.go:303] Setting JSON to false
	I1122 10:53:08.983791    3413 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1358,"bootTime":1700677830,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:08.983883    3413 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:08.989243    3413 out.go:177] * [flannel-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:08.997275    3413 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:09.002190    3413 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:08.997335    3413 notify.go:220] Checking for updates...
	I1122 10:53:09.008259    3413 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:09.011205    3413 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:09.014201    3413 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:09.017213    3413 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:09.020514    3413 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:09.020555    3413 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:09.025167    3413 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:09.031145    3413 start.go:298] selected driver: qemu2
	I1122 10:53:09.031151    3413 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:09.031156    3413 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:09.033527    3413 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:09.037280    3413 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:53:09.040298    3413 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:09.040353    3413 cni.go:84] Creating CNI manager for "flannel"
	I1122 10:53:09.040359    3413 start_flags.go:318] Found "Flannel" CNI - setting NetworkPlugin=cni
	I1122 10:53:09.040369    3413 start_flags.go:323] config:
	{Name:flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: S
SHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:09.044972    3413 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:09.053187    3413 out.go:177] * Starting control plane node flannel-410000 in cluster flannel-410000
	I1122 10:53:09.057153    3413 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:09.057169    3413 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:09.057179    3413 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:09.057241    3413 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:09.057246    3413 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:09.057303    3413 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/flannel-410000/config.json ...
	I1122 10:53:09.057314    3413 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/flannel-410000/config.json: {Name:mk4c6f1d9440f7d1a435b7e9009094a381671ccc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:09.057535    3413 start.go:365] acquiring machines lock for flannel-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:09.057567    3413 start.go:369] acquired machines lock for "flannel-410000" in 26.5µs
	I1122 10:53:09.057577    3413 start.go:93] Provisioning new machine with config: &{Name:flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Moun
tMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:09.057625    3413 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:09.066215    3413 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:09.084555    3413 start.go:159] libmachine.API.Create for "flannel-410000" (driver="qemu2")
	I1122 10:53:09.084580    3413 client.go:168] LocalClient.Create starting
	I1122 10:53:09.084648    3413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:09.084676    3413 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:09.084691    3413 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:09.084730    3413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:09.084753    3413 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:09.084760    3413 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:09.085119    3413 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:09.213072    3413 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:09.382095    3413 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:09.382101    3413 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:09.382283    3413 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:09.394969    3413 main.go:141] libmachine: STDOUT: 
	I1122 10:53:09.394990    3413 main.go:141] libmachine: STDERR: 
	I1122 10:53:09.395047    3413 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2 +20000M
	I1122 10:53:09.405413    3413 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:09.405432    3413 main.go:141] libmachine: STDERR: 
	I1122 10:53:09.405449    3413 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:09.405454    3413 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:09.405506    3413 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:ba:33:c3:d4:8b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:09.407860    3413 main.go:141] libmachine: STDOUT: 
	I1122 10:53:09.407888    3413 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:09.407904    3413 client.go:171] LocalClient.Create took 323.323292ms
	I1122 10:53:11.410042    3413 start.go:128] duration metric: createHost completed in 2.352440167s
	I1122 10:53:11.410102    3413 start.go:83] releasing machines lock for "flannel-410000", held for 2.352566791s
	W1122 10:53:11.410177    3413 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:11.421288    3413 out.go:177] * Deleting "flannel-410000" in qemu2 ...
	W1122 10:53:11.447665    3413 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:11.447692    3413 start.go:706] Will try again in 5 seconds ...
	I1122 10:53:16.449761    3413 start.go:365] acquiring machines lock for flannel-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:16.450123    3413 start.go:369] acquired machines lock for "flannel-410000" in 257.417µs
	I1122 10:53:16.450269    3413 start.go:93] Provisioning new machine with config: &{Name:flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Moun
tMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:16.450522    3413 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:16.460213    3413 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:16.508371    3413 start.go:159] libmachine.API.Create for "flannel-410000" (driver="qemu2")
	I1122 10:53:16.508408    3413 client.go:168] LocalClient.Create starting
	I1122 10:53:16.508549    3413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:16.508608    3413 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:16.508632    3413 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:16.508688    3413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:16.508729    3413 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:16.508748    3413 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:16.509277    3413 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:16.644063    3413 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:16.753869    3413 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:16.753875    3413 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:16.754041    3413 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:16.765964    3413 main.go:141] libmachine: STDOUT: 
	I1122 10:53:16.765985    3413 main.go:141] libmachine: STDERR: 
	I1122 10:53:16.766043    3413 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2 +20000M
	I1122 10:53:16.776668    3413 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:16.776686    3413 main.go:141] libmachine: STDERR: 
	I1122 10:53:16.776702    3413 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:16.776706    3413 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:16.776750    3413 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:ac:a1:d3:eb:f9 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/flannel-410000/disk.qcow2
	I1122 10:53:16.778444    3413 main.go:141] libmachine: STDOUT: 
	I1122 10:53:16.778467    3413 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:16.778479    3413 client.go:171] LocalClient.Create took 270.0705ms
	I1122 10:53:18.780622    3413 start.go:128] duration metric: createHost completed in 2.330113958s
	I1122 10:53:18.780677    3413 start.go:83] releasing machines lock for "flannel-410000", held for 2.33055225s
	W1122 10:53:18.781065    3413 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p flannel-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p flannel-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:18.793715    3413 out.go:177] 
	W1122 10:53:18.797750    3413 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:53:18.797786    3413 out.go:239] * 
	* 
	W1122 10:53:18.800399    3413 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:53:18.810677    3413 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/flannel/Start (9.89s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (9.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p enable-default-cni-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p enable-default-cni-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=qemu2 : exit status 80 (9.812143291s)

                                                
                                                
-- stdout --
	* [enable-default-cni-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node enable-default-cni-410000 in cluster enable-default-cni-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "enable-default-cni-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:53:21.223160    3536 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:21.223320    3536 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:21.223323    3536 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:21.223327    3536 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:21.223470    3536 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:21.224529    3536 out.go:303] Setting JSON to false
	I1122 10:53:21.240376    3536 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1371,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:21.240459    3536 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:21.246096    3536 out.go:177] * [enable-default-cni-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:21.250068    3536 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:21.254143    3536 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:21.250160    3536 notify.go:220] Checking for updates...
	I1122 10:53:21.261108    3536 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:21.264921    3536 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:21.269074    3536 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:21.272129    3536 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:21.274036    3536 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:21.274076    3536 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:21.277063    3536 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:21.283896    3536 start.go:298] selected driver: qemu2
	I1122 10:53:21.283901    3536 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:21.283907    3536 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:21.286276    3536 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:21.291129    3536 out.go:177] * Automatically selected the socket_vmnet network
	E1122 10:53:21.294174    3536 start_flags.go:465] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I1122 10:53:21.294194    3536 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:21.294236    3536 cni.go:84] Creating CNI manager for "bridge"
	I1122 10:53:21.294240    3536 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:53:21.294244    3536 start_flags.go:323] config:
	{Name:enable-default-cni-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Sta
ticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:21.298527    3536 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:21.307052    3536 out.go:177] * Starting control plane node enable-default-cni-410000 in cluster enable-default-cni-410000
	I1122 10:53:21.310105    3536 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:21.310118    3536 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:21.310125    3536 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:21.310178    3536 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:21.310183    3536 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:21.310242    3536 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/enable-default-cni-410000/config.json ...
	I1122 10:53:21.310253    3536 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/enable-default-cni-410000/config.json: {Name:mk45e72d671993a157b2b326776998d6dbb5ee94 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:21.310595    3536 start.go:365] acquiring machines lock for enable-default-cni-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:21.310627    3536 start.go:369] acquired machines lock for "enable-default-cni-410000" in 25.083µs
	I1122 10:53:21.310636    3536 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID
:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:21.310664    3536 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:21.315055    3536 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:21.330858    3536 start.go:159] libmachine.API.Create for "enable-default-cni-410000" (driver="qemu2")
	I1122 10:53:21.330883    3536 client.go:168] LocalClient.Create starting
	I1122 10:53:21.330934    3536 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:21.330965    3536 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:21.330974    3536 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:21.331012    3536 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:21.331033    3536 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:21.331040    3536 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:21.331387    3536 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:21.456018    3536 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:21.634579    3536 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:21.634586    3536 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:21.634766    3536 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:21.647224    3536 main.go:141] libmachine: STDOUT: 
	I1122 10:53:21.647243    3536 main.go:141] libmachine: STDERR: 
	I1122 10:53:21.647293    3536 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2 +20000M
	I1122 10:53:21.657597    3536 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:21.657614    3536 main.go:141] libmachine: STDERR: 
	I1122 10:53:21.657628    3536 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:21.657633    3536 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:21.657665    3536 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3e:29:ad:8e:64:d2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:21.659417    3536 main.go:141] libmachine: STDOUT: 
	I1122 10:53:21.659437    3536 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:21.659453    3536 client.go:171] LocalClient.Create took 328.57125ms
	I1122 10:53:23.661709    3536 start.go:128] duration metric: createHost completed in 2.351046791s
	I1122 10:53:23.661790    3536 start.go:83] releasing machines lock for "enable-default-cni-410000", held for 2.351195334s
	W1122 10:53:23.661947    3536 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:23.677077    3536 out.go:177] * Deleting "enable-default-cni-410000" in qemu2 ...
	W1122 10:53:23.703459    3536 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:23.703485    3536 start.go:706] Will try again in 5 seconds ...
	I1122 10:53:28.705608    3536 start.go:365] acquiring machines lock for enable-default-cni-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:28.705981    3536 start.go:369] acquired machines lock for "enable-default-cni-410000" in 294.167µs
	I1122 10:53:28.706105    3536 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID
:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:28.706342    3536 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:28.717875    3536 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:28.766436    3536 start.go:159] libmachine.API.Create for "enable-default-cni-410000" (driver="qemu2")
	I1122 10:53:28.766485    3536 client.go:168] LocalClient.Create starting
	I1122 10:53:28.766601    3536 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:28.766665    3536 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:28.766689    3536 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:28.766755    3536 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:28.766802    3536 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:28.766822    3536 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:28.767420    3536 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:28.905626    3536 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:28.936196    3536 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:28.936204    3536 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:28.936374    3536 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:28.948440    3536 main.go:141] libmachine: STDOUT: 
	I1122 10:53:28.948465    3536 main.go:141] libmachine: STDERR: 
	I1122 10:53:28.948527    3536 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2 +20000M
	I1122 10:53:28.959047    3536 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:28.959068    3536 main.go:141] libmachine: STDERR: 
	I1122 10:53:28.959082    3536 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:28.959088    3536 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:28.959126    3536 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=be:08:c8:7f:15:20 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/enable-default-cni-410000/disk.qcow2
	I1122 10:53:28.960815    3536 main.go:141] libmachine: STDOUT: 
	I1122 10:53:28.960833    3536 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:28.960845    3536 client.go:171] LocalClient.Create took 194.3585ms
	I1122 10:53:30.962991    3536 start.go:128] duration metric: createHost completed in 2.256655167s
	I1122 10:53:30.963044    3536 start.go:83] releasing machines lock for "enable-default-cni-410000", held for 2.257079333s
	W1122 10:53:30.963458    3536 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p enable-default-cni-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:30.972033    3536 out.go:177] 
	W1122 10:53:30.978236    3536 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:53:30.978295    3536 out.go:239] * 
	* 
	W1122 10:53:30.980832    3536 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:53:30.990120    3536 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (9.81s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (9.94s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kindnet-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kindnet-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=qemu2 : exit status 80 (9.939596833s)

                                                
                                                
-- stdout --
	* [kindnet-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node kindnet-410000 in cluster kindnet-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kindnet-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:53:33.285318    3648 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:33.285468    3648 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:33.285471    3648 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:33.285474    3648 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:33.285602    3648 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:33.286675    3648 out.go:303] Setting JSON to false
	I1122 10:53:33.302692    3648 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1383,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:33.302786    3648 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:33.308782    3648 out.go:177] * [kindnet-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:33.312771    3648 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:33.316744    3648 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:33.312825    3648 notify.go:220] Checking for updates...
	I1122 10:53:33.323203    3648 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:33.330719    3648 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:33.338729    3648 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:33.342705    3648 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:33.349229    3648 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:33.349281    3648 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:33.355698    3648 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:33.365676    3648 start.go:298] selected driver: qemu2
	I1122 10:53:33.365681    3648 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:33.365687    3648 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:33.368186    3648 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:33.372716    3648 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:53:33.376784    3648 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:33.376836    3648 cni.go:84] Creating CNI manager for "kindnet"
	I1122 10:53:33.376841    3648 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I1122 10:53:33.376848    3648 start_flags.go:323] config:
	{Name:kindnet-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: S
SHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:33.381737    3648 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:33.388772    3648 out.go:177] * Starting control plane node kindnet-410000 in cluster kindnet-410000
	I1122 10:53:33.392778    3648 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:33.392794    3648 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:33.392805    3648 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:33.392874    3648 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:33.392881    3648 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:33.392971    3648 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kindnet-410000/config.json ...
	I1122 10:53:33.392983    3648 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kindnet-410000/config.json: {Name:mke8793762b6e30e818cd18e6a359ed36e615495 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:33.393216    3648 start.go:365] acquiring machines lock for kindnet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:33.393251    3648 start.go:369] acquired machines lock for "kindnet-410000" in 28.542µs
	I1122 10:53:33.393262    3648 start.go:93] Provisioning new machine with config: &{Name:kindnet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Moun
tMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:33.393292    3648 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:33.400732    3648 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:33.419297    3648 start.go:159] libmachine.API.Create for "kindnet-410000" (driver="qemu2")
	I1122 10:53:33.419322    3648 client.go:168] LocalClient.Create starting
	I1122 10:53:33.419373    3648 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:33.419408    3648 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:33.419418    3648 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:33.419461    3648 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:33.419484    3648 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:33.419493    3648 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:33.419921    3648 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:33.544359    3648 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:33.727946    3648 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:33.727956    3648 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:33.728149    3648 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:33.740605    3648 main.go:141] libmachine: STDOUT: 
	I1122 10:53:33.740630    3648 main.go:141] libmachine: STDERR: 
	I1122 10:53:33.740689    3648 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2 +20000M
	I1122 10:53:33.751246    3648 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:33.751262    3648 main.go:141] libmachine: STDERR: 
	I1122 10:53:33.751286    3648 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:33.751292    3648 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:33.751340    3648 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ae:af:6c:6d:80:d2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:33.753112    3648 main.go:141] libmachine: STDOUT: 
	I1122 10:53:33.753125    3648 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:33.753142    3648 client.go:171] LocalClient.Create took 333.8205ms
	I1122 10:53:35.755283    3648 start.go:128] duration metric: createHost completed in 2.362009417s
	I1122 10:53:35.755359    3648 start.go:83] releasing machines lock for "kindnet-410000", held for 2.362141s
	W1122 10:53:35.755427    3648 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:35.768697    3648 out.go:177] * Deleting "kindnet-410000" in qemu2 ...
	W1122 10:53:35.793971    3648 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:35.794000    3648 start.go:706] Will try again in 5 seconds ...
	I1122 10:53:40.796150    3648 start.go:365] acquiring machines lock for kindnet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:40.796608    3648 start.go:369] acquired machines lock for "kindnet-410000" in 321.958µs
	I1122 10:53:40.796749    3648 start.go:93] Provisioning new machine with config: &{Name:kindnet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Moun
tMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:40.797041    3648 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:40.807700    3648 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:40.856527    3648 start.go:159] libmachine.API.Create for "kindnet-410000" (driver="qemu2")
	I1122 10:53:40.856571    3648 client.go:168] LocalClient.Create starting
	I1122 10:53:40.856689    3648 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:40.856749    3648 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:40.856767    3648 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:40.856833    3648 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:40.856878    3648 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:40.856888    3648 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:40.857412    3648 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:40.993635    3648 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:41.123742    3648 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:41.123748    3648 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:41.123926    3648 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:41.136234    3648 main.go:141] libmachine: STDOUT: 
	I1122 10:53:41.136251    3648 main.go:141] libmachine: STDERR: 
	I1122 10:53:41.136305    3648 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2 +20000M
	I1122 10:53:41.147024    3648 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:41.147037    3648 main.go:141] libmachine: STDERR: 
	I1122 10:53:41.147050    3648 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:41.147056    3648 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:41.147108    3648 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1e:d4:8f:8f:75:89 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kindnet-410000/disk.qcow2
	I1122 10:53:41.148768    3648 main.go:141] libmachine: STDOUT: 
	I1122 10:53:41.148781    3648 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:41.148797    3648 client.go:171] LocalClient.Create took 292.226416ms
	I1122 10:53:43.150928    3648 start.go:128] duration metric: createHost completed in 2.353902833s
	I1122 10:53:43.150984    3648 start.go:83] releasing machines lock for "kindnet-410000", held for 2.354389084s
	W1122 10:53:43.151531    3648 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kindnet-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kindnet-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:43.166073    3648 out.go:177] 
	W1122 10:53:43.170180    3648 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:53:43.170221    3648 out.go:239] * 
	* 
	W1122 10:53:43.172713    3648 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:53:43.179123    3648 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kindnet/Start (9.94s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (9.9s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p bridge-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p bridge-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=qemu2 : exit status 80 (9.899212667s)

                                                
                                                
-- stdout --
	* [bridge-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node bridge-410000 in cluster bridge-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "bridge-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:53:45.560640    3765 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:45.560787    3765 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:45.560791    3765 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:45.560793    3765 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:45.560933    3765 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:45.561935    3765 out.go:303] Setting JSON to false
	I1122 10:53:45.577832    3765 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1395,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:45.577928    3765 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:45.584140    3765 out.go:177] * [bridge-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:45.594130    3765 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:45.594174    3765 notify.go:220] Checking for updates...
	I1122 10:53:45.598088    3765 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:45.602067    3765 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:45.605079    3765 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:45.608108    3765 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:45.611106    3765 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:45.614453    3765 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:45.614506    3765 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:45.618075    3765 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:45.625107    3765 start.go:298] selected driver: qemu2
	I1122 10:53:45.625112    3765 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:45.625117    3765 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:45.627457    3765 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:45.631040    3765 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:53:45.634189    3765 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:45.634226    3765 cni.go:84] Creating CNI manager for "bridge"
	I1122 10:53:45.634230    3765 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:53:45.634235    3765 start_flags.go:323] config:
	{Name:bridge-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:bridge-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR
ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHA
gentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:45.638691    3765 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:45.647092    3765 out.go:177] * Starting control plane node bridge-410000 in cluster bridge-410000
	I1122 10:53:45.651062    3765 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:45.651076    3765 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:45.651082    3765 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:45.651154    3765 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:45.651160    3765 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:45.651216    3765 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/bridge-410000/config.json ...
	I1122 10:53:45.651227    3765 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/bridge-410000/config.json: {Name:mk9ead42de7f20d72b7aa1543bf5ea7c0f6ab344 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:45.651449    3765 start.go:365] acquiring machines lock for bridge-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:45.651481    3765 start.go:369] acquired machines lock for "bridge-410000" in 26.333µs
	I1122 10:53:45.651491    3765 start.go:93] Provisioning new machine with config: &{Name:bridge-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:bridge-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:45.651530    3765 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:45.660100    3765 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:45.677889    3765 start.go:159] libmachine.API.Create for "bridge-410000" (driver="qemu2")
	I1122 10:53:45.677919    3765 client.go:168] LocalClient.Create starting
	I1122 10:53:45.677983    3765 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:45.678010    3765 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:45.678029    3765 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:45.678071    3765 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:45.678093    3765 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:45.678099    3765 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:45.678467    3765 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:45.804253    3765 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:45.888373    3765 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:45.888382    3765 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:45.888554    3765 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:45.900858    3765 main.go:141] libmachine: STDOUT: 
	I1122 10:53:45.900875    3765 main.go:141] libmachine: STDERR: 
	I1122 10:53:45.900929    3765 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2 +20000M
	I1122 10:53:45.911335    3765 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:45.911353    3765 main.go:141] libmachine: STDERR: 
	I1122 10:53:45.911372    3765 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:45.911377    3765 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:45.911407    3765 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e2:83:07:56:7b:71 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:45.913116    3765 main.go:141] libmachine: STDOUT: 
	I1122 10:53:45.913137    3765 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:45.913161    3765 client.go:171] LocalClient.Create took 235.239792ms
	I1122 10:53:47.915306    3765 start.go:128] duration metric: createHost completed in 2.263789291s
	I1122 10:53:47.915365    3765 start.go:83] releasing machines lock for "bridge-410000", held for 2.26391175s
	W1122 10:53:47.915443    3765 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:47.928683    3765 out.go:177] * Deleting "bridge-410000" in qemu2 ...
	W1122 10:53:47.952828    3765 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:47.952880    3765 start.go:706] Will try again in 5 seconds ...
	I1122 10:53:52.955053    3765 start.go:365] acquiring machines lock for bridge-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:52.955445    3765 start.go:369] acquired machines lock for "bridge-410000" in 282.333µs
	I1122 10:53:52.955575    3765 start.go:93] Provisioning new machine with config: &{Name:bridge-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:bridge-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:52.955861    3765 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:52.963610    3765 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:53.015455    3765 start.go:159] libmachine.API.Create for "bridge-410000" (driver="qemu2")
	I1122 10:53:53.015515    3765 client.go:168] LocalClient.Create starting
	I1122 10:53:53.015643    3765 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:53.015757    3765 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:53.015778    3765 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:53.015866    3765 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:53.015914    3765 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:53.015932    3765 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:53.016490    3765 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:53.154326    3765 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:53.358552    3765 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:53.358562    3765 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:53.358768    3765 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:53.371567    3765 main.go:141] libmachine: STDOUT: 
	I1122 10:53:53.371589    3765 main.go:141] libmachine: STDERR: 
	I1122 10:53:53.371659    3765 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2 +20000M
	I1122 10:53:53.382167    3765 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:53.382202    3765 main.go:141] libmachine: STDERR: 
	I1122 10:53:53.382221    3765 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:53.382227    3765 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:53.382268    3765 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:1d:f3:e9:1a:9f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/bridge-410000/disk.qcow2
	I1122 10:53:53.383968    3765 main.go:141] libmachine: STDOUT: 
	I1122 10:53:53.383982    3765 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:53.383997    3765 client.go:171] LocalClient.Create took 368.480542ms
	I1122 10:53:55.386152    3765 start.go:128] duration metric: createHost completed in 2.430307s
	I1122 10:53:55.386208    3765 start.go:83] releasing machines lock for "bridge-410000", held for 2.430780167s
	W1122 10:53:55.386729    3765 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p bridge-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p bridge-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:53:55.396309    3765 out.go:177] 
	W1122 10:53:55.402499    3765 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:53:55.402536    3765 out.go:239] * 
	* 
	W1122 10:53:55.405144    3765 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:53:55.414357    3765 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/bridge/Start (9.90s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (10.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p kubenet-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 
E1122 10:53:58.501392    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p kubenet-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=qemu2 : exit status 80 (10.034920334s)

                                                
                                                
-- stdout --
	* [kubenet-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node kubenet-410000 in cluster kubenet-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "kubenet-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:53:57.712232    3878 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:57.712369    3878 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:57.712372    3878 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:57.712375    3878 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:57.712501    3878 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:57.713561    3878 out.go:303] Setting JSON to false
	I1122 10:53:57.729158    3878 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1407,"bootTime":1700677830,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:57.729241    3878 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:57.732836    3878 out.go:177] * [kubenet-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:57.740727    3878 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:57.740802    3878 notify.go:220] Checking for updates...
	I1122 10:53:57.742428    3878 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:57.746781    3878 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:57.749763    3878 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:57.751178    3878 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:57.754710    3878 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:57.758124    3878 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:57.758170    3878 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:57.759868    3878 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:57.766708    3878 start.go:298] selected driver: qemu2
	I1122 10:53:57.766713    3878 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:57.766718    3878 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:57.768982    3878 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:57.771792    3878 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:53:57.775746    3878 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:57.775787    3878 cni.go:80] network plugin configured as "kubenet", returning disabled
	I1122 10:53:57.775791    3878 start_flags.go:323] config:
	{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHA
gentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:57.780130    3878 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:57.788750    3878 out.go:177] * Starting control plane node kubenet-410000 in cluster kubenet-410000
	I1122 10:53:57.792715    3878 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:57.792733    3878 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:57.792741    3878 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:57.792800    3878 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:57.792806    3878 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:57.792875    3878 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubenet-410000/config.json ...
	I1122 10:53:57.792887    3878 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubenet-410000/config.json: {Name:mk634ac5d4d7373e4ed0123c01516b6f12d1a722 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:57.793090    3878 start.go:365] acquiring machines lock for kubenet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:57.793121    3878 start.go:369] acquired machines lock for "kubenet-410000" in 25.083µs
	I1122 10:53:57.793131    3878 start.go:93] Provisioning new machine with config: &{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:57.793166    3878 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:57.800732    3878 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:57.817754    3878 start.go:159] libmachine.API.Create for "kubenet-410000" (driver="qemu2")
	I1122 10:53:57.817779    3878 client.go:168] LocalClient.Create starting
	I1122 10:53:57.817826    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:57.817852    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:57.817863    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:57.817899    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:57.817920    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:57.817927    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:57.818259    3878 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:57.942597    3878 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:58.061248    3878 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:58.061254    3878 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:58.061438    3878 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.073719    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:53:58.073743    3878 main.go:141] libmachine: STDERR: 
	I1122 10:53:58.073795    3878 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2 +20000M
	I1122 10:53:58.084385    3878 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:58.084401    3878 main.go:141] libmachine: STDERR: 
	I1122 10:53:58.084421    3878 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.084426    3878 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:58.084460    3878 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:a4:68:ab:aa:28 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.086105    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:53:58.086121    3878 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:58.086146    3878 client.go:171] LocalClient.Create took 268.368042ms
	I1122 10:54:00.088285    3878 start.go:128] duration metric: createHost completed in 2.295137s
	I1122 10:54:00.088351    3878 start.go:83] releasing machines lock for "kubenet-410000", held for 2.295262459s
	W1122 10:54:00.088397    3878 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:00.101493    3878 out.go:177] * Deleting "kubenet-410000" in qemu2 ...
	W1122 10:54:00.124721    3878 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:00.124752    3878 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:05.126893    3878 start.go:365] acquiring machines lock for kubenet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:05.127284    3878 start.go:369] acquired machines lock for "kubenet-410000" in 287.417µs
	I1122 10:54:05.127400    3878 start.go:93] Provisioning new machine with config: &{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:05.127635    3878 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:05.138118    3878 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:05.186087    3878 start.go:159] libmachine.API.Create for "kubenet-410000" (driver="qemu2")
	I1122 10:54:05.186141    3878 client.go:168] LocalClient.Create starting
	I1122 10:54:05.186266    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:05.186326    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:05.186341    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:05.186417    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:05.186469    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:05.186481    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:05.187044    3878 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:05.323757    3878 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:05.642248    3878 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:05.642263    3878 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:05.642521    3878 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.655393    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:54:05.655417    3878 main.go:141] libmachine: STDERR: 
	I1122 10:54:05.655488    3878 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2 +20000M
	I1122 10:54:05.666334    3878 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:05.666347    3878 main.go:141] libmachine: STDERR: 
	I1122 10:54:05.666361    3878 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.666372    3878 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:05.666416    3878 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9a:8c:e9:ec:eb:2d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.668130    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:54:05.668142    3878 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:05.668159    3878 client.go:171] LocalClient.Create took 482.019ms
	I1122 10:54:07.670303    3878 start.go:128] duration metric: createHost completed in 2.542681375s
	I1122 10:54:07.670412    3878 start.go:83] releasing machines lock for "kubenet-410000", held for 2.543108833s
	W1122 10:54:07.670789    3878 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubenet-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p kubenet-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:07.683416    3878 out.go:177] 
	W1122 10:54:07.687519    3878 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:07.687571    3878 out.go:239] * 
	* 
	W1122 10:54:07.690032    3878 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:07.702436    3878 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/kubenet/Start (10.04s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (1.64s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:196: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 : fork/exec /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe: permission denied (1.623958ms)
version_upgrade_test.go:196: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 : fork/exec /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe: permission denied (1.676458ms)
version_upgrade_test.go:196: (dbg) Run:  /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe start -p stopped-upgrade-521000 --memory=2200 --vm-driver=qemu2 : fork/exec /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe: permission denied (1.79725ms)
version_upgrade_test.go:202: legacy v1.6.2 start failed: fork/exec /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube-v1.6.2.877333819.exe: permission denied
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (1.64s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.1s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:219: (dbg) Run:  out/minikube-darwin-arm64 logs -p stopped-upgrade-521000
version_upgrade_test.go:219: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p stopped-upgrade-521000: exit status 85 (94.650709ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------|----------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |    Profile     |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|----------------|---------|---------|---------------------|---------------------|
	| ssh     | -p bridge-410000 sudo crictl                         | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | ps --all                                             |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo find                           | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/cni -type f -exec sh -c                         |                |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo ip a s                         | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	| ssh     | -p bridge-410000 sudo ip r s                         | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | iptables-save                                        |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo iptables                       | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | -t nat -L -n -v                                      |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl status kubelet --all                       |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl cat kubelet                                |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | journalctl -xeu kubelet --all                        |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /var/lib/kubelet/config.yaml                         |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl status docker --all                        |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl cat docker                                 |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/docker/daemon.json                              |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo docker                         | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | system info                                          |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl status cri-docker                          |                |         |         |                     |                     |
	|         | --all --full --no-pager                              |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl cat cri-docker                             |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | cri-dockerd --version                                |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl status containerd                          |                |         |         |                     |                     |
	|         | --all --full --no-pager                              |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl cat containerd                             |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /lib/systemd/system/containerd.service               |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo cat                            | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/containerd/config.toml                          |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | containerd config dump                               |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl status crio --all                          |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo                                | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | systemctl cat crio --no-pager                        |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo find                           | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | /etc/crio -type f -exec sh -c                        |                |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                |         |         |                     |                     |
	| ssh     | -p bridge-410000 sudo crio                           | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | config                                               |                |         |         |                     |                     |
	| delete  | -p bridge-410000                                     | bridge-410000  | jenkins | v1.32.0 | 22 Nov 23 10:53 PST | 22 Nov 23 10:53 PST |
	| start   | -p kubenet-410000                                    | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:53 PST |                     |
	|         | --memory=3072                                        |                |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                        |                |         |         |                     |                     |
	|         | --wait-timeout=15m                                   |                |         |         |                     |                     |
	|         | --network-plugin=kubenet                             |                |         |         |                     |                     |
	|         | --driver=qemu2                                       |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/nsswitch.conf                                   |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/hosts                                           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/resolv.conf                                     |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo crictl                        | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | pods                                                 |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo crictl                        | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | ps --all                                             |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo find                          | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/cni -type f -exec sh -c                         |                |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo ip a s                        | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	| ssh     | -p kubenet-410000 sudo ip r s                        | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | iptables-save                                        |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | iptables -t nat -L -n -v                             |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl status kubelet --all                       |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl cat kubelet                                |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | journalctl -xeu kubelet --all                        |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /var/lib/kubelet/config.yaml                         |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl status docker --all                        |                |         |         |                     |                     |
	|         | --full --no-pager                                    |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl cat docker                                 |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/docker/daemon.json                              |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo docker                        | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | system info                                          |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl status cri-docker                          |                |         |         |                     |                     |
	|         | --all --full --no-pager                              |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl cat cri-docker                             |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | cri-dockerd --version                                |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl status containerd                          |                |         |         |                     |                     |
	|         | --all --full --no-pager                              |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | systemctl cat containerd                             |                |         |         |                     |                     |
	|         | --no-pager                                           |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /lib/systemd/system/containerd.service               |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo cat                           | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | /etc/containerd/config.toml                          |                |         |         |                     |                     |
	| ssh     | -p kubenet-410000 sudo                               | kubenet-410000 | jenkins | v1.32.0 | 22 Nov 23 10:54 PST |                     |
	|         | containerd config dump                               |                |         |         |                     |                     |
	|---------|------------------------------------------------------|----------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/22 10:53:57
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.21.4 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1122 10:53:57.712232    3878 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:53:57.712369    3878 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:57.712372    3878 out.go:309] Setting ErrFile to fd 2...
	I1122 10:53:57.712375    3878 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:53:57.712501    3878 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:53:57.713561    3878 out.go:303] Setting JSON to false
	I1122 10:53:57.729158    3878 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1407,"bootTime":1700677830,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:53:57.729241    3878 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:53:57.732836    3878 out.go:177] * [kubenet-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:53:57.740727    3878 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:53:57.740802    3878 notify.go:220] Checking for updates...
	I1122 10:53:57.742428    3878 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:53:57.746781    3878 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:53:57.749763    3878 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:53:57.751178    3878 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:53:57.754710    3878 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:53:57.758124    3878 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:53:57.758170    3878 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:53:57.759868    3878 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:53:57.766708    3878 start.go:298] selected driver: qemu2
	I1122 10:53:57.766713    3878 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:53:57.766718    3878 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:53:57.768982    3878 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:53:57.771792    3878 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:53:57.775746    3878 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:53:57.775787    3878 cni.go:80] network plugin configured as "kubenet", returning disabled
	I1122 10:53:57.775791    3878 start_flags.go:323] config:
	{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHA
gentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:53:57.780130    3878 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:53:57.788750    3878 out.go:177] * Starting control plane node kubenet-410000 in cluster kubenet-410000
	I1122 10:53:57.792715    3878 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:53:57.792733    3878 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:53:57.792741    3878 cache.go:56] Caching tarball of preloaded images
	I1122 10:53:57.792800    3878 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:53:57.792806    3878 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:53:57.792875    3878 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubenet-410000/config.json ...
	I1122 10:53:57.792887    3878 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/kubenet-410000/config.json: {Name:mk634ac5d4d7373e4ed0123c01516b6f12d1a722 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:53:57.793090    3878 start.go:365] acquiring machines lock for kubenet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:53:57.793121    3878 start.go:369] acquired machines lock for "kubenet-410000" in 25.083µs
	I1122 10:53:57.793131    3878 start.go:93] Provisioning new machine with config: &{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:53:57.793166    3878 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:53:57.800732    3878 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:53:57.817754    3878 start.go:159] libmachine.API.Create for "kubenet-410000" (driver="qemu2")
	I1122 10:53:57.817779    3878 client.go:168] LocalClient.Create starting
	I1122 10:53:57.817826    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:53:57.817852    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:57.817863    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:57.817899    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:53:57.817920    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:53:57.817927    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:53:57.818259    3878 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:53:57.942597    3878 main.go:141] libmachine: Creating SSH key...
	I1122 10:53:58.061248    3878 main.go:141] libmachine: Creating Disk image...
	I1122 10:53:58.061254    3878 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:53:58.061438    3878 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.073719    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:53:58.073743    3878 main.go:141] libmachine: STDERR: 
	I1122 10:53:58.073795    3878 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2 +20000M
	I1122 10:53:58.084385    3878 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:53:58.084401    3878 main.go:141] libmachine: STDERR: 
	I1122 10:53:58.084421    3878 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.084426    3878 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:53:58.084460    3878 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:a4:68:ab:aa:28 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:53:58.086105    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:53:58.086121    3878 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:53:58.086146    3878 client.go:171] LocalClient.Create took 268.368042ms
	I1122 10:54:00.088285    3878 start.go:128] duration metric: createHost completed in 2.295137s
	I1122 10:54:00.088351    3878 start.go:83] releasing machines lock for "kubenet-410000", held for 2.295262459s
	W1122 10:54:00.088397    3878 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:00.101493    3878 out.go:177] * Deleting "kubenet-410000" in qemu2 ...
	W1122 10:54:00.124721    3878 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:00.124752    3878 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:05.126893    3878 start.go:365] acquiring machines lock for kubenet-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:05.127284    3878 start.go:369] acquired machines lock for "kubenet-410000" in 287.417µs
	I1122 10:54:05.127400    3878 start.go:93] Provisioning new machine with config: &{Name:kubenet-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:05.127635    3878 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:05.138118    3878 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:05.186087    3878 start.go:159] libmachine.API.Create for "kubenet-410000" (driver="qemu2")
	I1122 10:54:05.186141    3878 client.go:168] LocalClient.Create starting
	I1122 10:54:05.186266    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:05.186326    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:05.186341    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:05.186417    3878 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:05.186469    3878 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:05.186481    3878 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:05.187044    3878 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:05.323757    3878 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:05.642248    3878 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:05.642263    3878 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:05.642521    3878 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.655393    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:54:05.655417    3878 main.go:141] libmachine: STDERR: 
	I1122 10:54:05.655488    3878 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2 +20000M
	I1122 10:54:05.666334    3878 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:05.666347    3878 main.go:141] libmachine: STDERR: 
	I1122 10:54:05.666361    3878 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.666372    3878 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:05.666416    3878 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9a:8c:e9:ec:eb:2d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/kubenet-410000/disk.qcow2
	I1122 10:54:05.668130    3878 main.go:141] libmachine: STDOUT: 
	I1122 10:54:05.668142    3878 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:05.668159    3878 client.go:171] LocalClient.Create took 482.019ms
	I1122 10:54:07.670303    3878 start.go:128] duration metric: createHost completed in 2.542681375s
	I1122 10:54:07.670412    3878 start.go:83] releasing machines lock for "kubenet-410000", held for 2.543108833s
	W1122 10:54:07.670789    3878 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p kubenet-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:07.683416    3878 out.go:177] 
	W1122 10:54:07.687519    3878 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:07.687571    3878 out.go:239] * 
	W1122 10:54:07.690032    3878 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:07.702436    3878 out.go:177] 
	
	* 
	* Profile "stopped-upgrade-521000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p stopped-upgrade-521000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:221: `minikube logs` after upgrade to HEAD from v1.6.2 failed: exit status 85
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.10s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (9.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p custom-flannel-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p custom-flannel-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=qemu2 : exit status 80 (9.769893208s)

                                                
                                                
-- stdout --
	* [custom-flannel-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node custom-flannel-410000 in cluster custom-flannel-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "custom-flannel-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:10.029733    4007 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:10.029887    4007 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:10.029890    4007 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:10.029892    4007 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:10.030029    4007 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:10.031421    4007 out.go:303] Setting JSON to false
	I1122 10:54:10.050379    4007 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1420,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:10.050505    4007 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:10.054430    4007 out.go:177] * [custom-flannel-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:10.061333    4007 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:10.064436    4007 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:10.061370    4007 notify.go:220] Checking for updates...
	I1122 10:54:10.079475    4007 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:10.090491    4007 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:10.097469    4007 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:10.100500    4007 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:10.103786    4007 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:10.103840    4007 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:10.111422    4007 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:10.118462    4007 start.go:298] selected driver: qemu2
	I1122 10:54:10.118470    4007 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:10.118481    4007 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:10.120954    4007 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:10.125485    4007 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:10.137554    4007 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:10.137605    4007 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I1122 10:54:10.137616    4007 start_flags.go:318] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I1122 10:54:10.137625    4007 start_flags.go:323] config:
	{Name:custom-flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/sock
et_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:10.142414    4007 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:10.145484    4007 out.go:177] * Starting control plane node custom-flannel-410000 in cluster custom-flannel-410000
	I1122 10:54:10.153460    4007 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:10.153477    4007 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:10.153484    4007 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:10.153552    4007 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:10.153559    4007 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:10.153643    4007 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/custom-flannel-410000/config.json ...
	I1122 10:54:10.153655    4007 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/custom-flannel-410000/config.json: {Name:mk7defae6e500526869786e732ee0e93c1f2d3e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:10.153982    4007 start.go:365] acquiring machines lock for custom-flannel-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:10.154036    4007 start.go:369] acquired machines lock for "custom-flannel-410000" in 45.333µs
	I1122 10:54:10.154047    4007 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p200
0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:10.154089    4007 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:10.165428    4007 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:10.183105    4007 start.go:159] libmachine.API.Create for "custom-flannel-410000" (driver="qemu2")
	I1122 10:54:10.183129    4007 client.go:168] LocalClient.Create starting
	I1122 10:54:10.183183    4007 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:10.183212    4007 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:10.183221    4007 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:10.183261    4007 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:10.183284    4007 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:10.183291    4007 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:10.183618    4007 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:10.309224    4007 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:10.349438    4007 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:10.349443    4007 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:10.349617    4007 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:10.361927    4007 main.go:141] libmachine: STDOUT: 
	I1122 10:54:10.361944    4007 main.go:141] libmachine: STDERR: 
	I1122 10:54:10.362019    4007 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2 +20000M
	I1122 10:54:10.372483    4007 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:10.372501    4007 main.go:141] libmachine: STDERR: 
	I1122 10:54:10.372521    4007 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:10.372527    4007 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:10.372563    4007 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:10:d3:1b:c6:dd -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:10.374321    4007 main.go:141] libmachine: STDOUT: 
	I1122 10:54:10.374335    4007 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:10.374353    4007 client.go:171] LocalClient.Create took 191.22275ms
	I1122 10:54:12.376502    4007 start.go:128] duration metric: createHost completed in 2.222430959s
	I1122 10:54:12.376576    4007 start.go:83] releasing machines lock for "custom-flannel-410000", held for 2.222569375s
	W1122 10:54:12.376643    4007 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:12.402730    4007 out.go:177] * Deleting "custom-flannel-410000" in qemu2 ...
	W1122 10:54:12.421783    4007 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:12.421802    4007 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:17.424026    4007 start.go:365] acquiring machines lock for custom-flannel-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:17.424486    4007 start.go:369] acquired machines lock for "custom-flannel-410000" in 331.083µs
	I1122 10:54:17.424632    4007 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p200
0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:17.424893    4007 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:17.431640    4007 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:17.479439    4007 start.go:159] libmachine.API.Create for "custom-flannel-410000" (driver="qemu2")
	I1122 10:54:17.479490    4007 client.go:168] LocalClient.Create starting
	I1122 10:54:17.479590    4007 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:17.479648    4007 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:17.479664    4007 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:17.479726    4007 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:17.479767    4007 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:17.479778    4007 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:17.480291    4007 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:17.618664    4007 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:17.693813    4007 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:17.693819    4007 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:17.693992    4007 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:17.706198    4007 main.go:141] libmachine: STDOUT: 
	I1122 10:54:17.706217    4007 main.go:141] libmachine: STDERR: 
	I1122 10:54:17.706273    4007 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2 +20000M
	I1122 10:54:17.716644    4007 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:17.716665    4007 main.go:141] libmachine: STDERR: 
	I1122 10:54:17.716681    4007 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:17.716686    4007 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:17.716719    4007 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:aa:7f:57:59:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/custom-flannel-410000/disk.qcow2
	I1122 10:54:17.718418    4007 main.go:141] libmachine: STDOUT: 
	I1122 10:54:17.718448    4007 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:17.718471    4007 client.go:171] LocalClient.Create took 238.97925ms
	I1122 10:54:19.720658    4007 start.go:128] duration metric: createHost completed in 2.295764292s
	I1122 10:54:19.720713    4007 start.go:83] releasing machines lock for "custom-flannel-410000", held for 2.296238667s
	W1122 10:54:19.721108    4007 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p custom-flannel-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:19.733709    4007 out.go:177] 
	W1122 10:54:19.738663    4007 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:19.738706    4007 out.go:239] * 
	* 
	W1122 10:54:19.741515    4007 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:19.753679    4007 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (9.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (12.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p calico-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p calico-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=qemu2 : exit status 80 (12.205939667s)

                                                
                                                
-- stdout --
	* [calico-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node calico-410000 in cluster calico-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "calico-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:10.047664    4008 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:10.047830    4008 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:10.047835    4008 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:10.047838    4008 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:10.047965    4008 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:10.049049    4008 out.go:303] Setting JSON to false
	I1122 10:54:10.065483    4008 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1420,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:10.065563    4008 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:10.072494    4008 out.go:177] * [calico-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:10.087435    4008 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:10.083514    4008 notify.go:220] Checking for updates...
	I1122 10:54:10.097464    4008 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:10.100503    4008 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:10.103440    4008 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:10.111421    4008 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:10.118478    4008 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:10.121955    4008 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:10.122001    4008 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:10.129443    4008 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:10.141488    4008 start.go:298] selected driver: qemu2
	I1122 10:54:10.141496    4008 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:10.141502    4008 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:10.143742    4008 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:10.153461    4008 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:10.157568    4008 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:10.157630    4008 cni.go:84] Creating CNI manager for "calico"
	I1122 10:54:10.157635    4008 start_flags.go:318] Found "Calico" CNI - setting NetworkPlugin=cni
	I1122 10:54:10.157643    4008 start_flags.go:323] config:
	{Name:calico-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:calico-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR
ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHA
gentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:10.162243    4008 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:10.172402    4008 out.go:177] * Starting control plane node calico-410000 in cluster calico-410000
	I1122 10:54:10.175426    4008 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:10.175442    4008 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:10.175453    4008 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:10.175505    4008 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:10.175511    4008 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:10.175579    4008 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/calico-410000/config.json ...
	I1122 10:54:10.175590    4008 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/calico-410000/config.json: {Name:mka45f85330eaad58681b19ba39bae0a33152dea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:10.175868    4008 start.go:365] acquiring machines lock for calico-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:12.376814    4008 start.go:369] acquired machines lock for "calico-410000" in 2.20096375s
	I1122 10:54:12.376907    4008 start.go:93] Provisioning new machine with config: &{Name:calico-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:calico-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:12.377161    4008 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:12.390744    4008 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:12.436565    4008 start.go:159] libmachine.API.Create for "calico-410000" (driver="qemu2")
	I1122 10:54:12.436610    4008 client.go:168] LocalClient.Create starting
	I1122 10:54:12.436733    4008 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:12.436790    4008 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:12.436806    4008 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:12.436874    4008 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:12.436915    4008 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:12.436932    4008 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:12.437531    4008 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:12.583409    4008 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:12.716921    4008 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:12.716927    4008 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:12.717106    4008 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:12.729509    4008 main.go:141] libmachine: STDOUT: 
	I1122 10:54:12.729529    4008 main.go:141] libmachine: STDERR: 
	I1122 10:54:12.729578    4008 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2 +20000M
	I1122 10:54:12.740010    4008 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:12.740033    4008 main.go:141] libmachine: STDERR: 
	I1122 10:54:12.740045    4008 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:12.740050    4008 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:12.740081    4008 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:bb:43:d5:96:85 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:12.741805    4008 main.go:141] libmachine: STDOUT: 
	I1122 10:54:12.741820    4008 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:12.741848    4008 client.go:171] LocalClient.Create took 305.235917ms
	I1122 10:54:14.743991    4008 start.go:128] duration metric: createHost completed in 2.366840291s
	I1122 10:54:14.744055    4008 start.go:83] releasing machines lock for "calico-410000", held for 2.367241833s
	W1122 10:54:14.744140    4008 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:14.755458    4008 out.go:177] * Deleting "calico-410000" in qemu2 ...
	W1122 10:54:14.788658    4008 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:14.788694    4008 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:19.790772    4008 start.go:365] acquiring machines lock for calico-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:19.790948    4008 start.go:369] acquired machines lock for "calico-410000" in 130.125µs
	I1122 10:54:19.791021    4008 start.go:93] Provisioning new machine with config: &{Name:calico-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:calico-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:19.791163    4008 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:19.799491    4008 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:19.826864    4008 start.go:159] libmachine.API.Create for "calico-410000" (driver="qemu2")
	I1122 10:54:19.826900    4008 client.go:168] LocalClient.Create starting
	I1122 10:54:19.826967    4008 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:19.826997    4008 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:19.827008    4008 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:19.827054    4008 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:19.827087    4008 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:19.827100    4008 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:19.827503    4008 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:19.964610    4008 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:20.144313    4008 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:20.144324    4008 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:20.144571    4008 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:20.158118    4008 main.go:141] libmachine: STDOUT: 
	I1122 10:54:20.158162    4008 main.go:141] libmachine: STDERR: 
	I1122 10:54:20.158223    4008 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2 +20000M
	I1122 10:54:20.172669    4008 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:20.172689    4008 main.go:141] libmachine: STDERR: 
	I1122 10:54:20.172720    4008 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:20.172725    4008 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:20.172773    4008 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6e:c8:93:6e:ac:45 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/calico-410000/disk.qcow2
	I1122 10:54:20.174549    4008 main.go:141] libmachine: STDOUT: 
	I1122 10:54:20.174566    4008 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:20.174582    4008 client.go:171] LocalClient.Create took 347.683209ms
	I1122 10:54:22.176604    4008 start.go:128] duration metric: createHost completed in 2.385461833s
	I1122 10:54:22.176614    4008 start.go:83] releasing machines lock for "calico-410000", held for 2.385697167s
	W1122 10:54:22.176692    4008 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p calico-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p calico-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:22.185235    4008 out.go:177] 
	W1122 10:54:22.189418    4008 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:22.189424    4008 out.go:239] * 
	* 
	W1122 10:54:22.189923    4008 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:22.207512    4008 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (12.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (9.84s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-arm64 start -p false-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p false-410000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=qemu2 : exit status 80 (9.833695875s)

                                                
                                                
-- stdout --
	* [false-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node false-410000 in cluster false-410000
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "false-410000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:22.263170    4140 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:22.263335    4140 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:22.263337    4140 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:22.263340    4140 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:22.263517    4140 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:22.264703    4140 out.go:303] Setting JSON to false
	I1122 10:54:22.282222    4140 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1432,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:22.282328    4140 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:22.287191    4140 out.go:177] * [false-410000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:22.290297    4140 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:22.290336    4140 notify.go:220] Checking for updates...
	I1122 10:54:22.300292    4140 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:22.304281    4140 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:22.312237    4140 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:22.315266    4140 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:22.318286    4140 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:22.322589    4140 config.go:182] Loaded profile config "calico-410000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:22.322658    4140 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:22.322706    4140 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:22.324085    4140 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:22.331239    4140 start.go:298] selected driver: qemu2
	I1122 10:54:22.331244    4140 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:22.331250    4140 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:22.333664    4140 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:22.338109    4140 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:22.341288    4140 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:22.341326    4140 cni.go:84] Creating CNI manager for "false"
	I1122 10:54:22.341331    4140 start_flags.go:323] config:
	{Name:false-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:false-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRIS
ocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPI
D:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:22.345880    4140 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:22.354282    4140 out.go:177] * Starting control plane node false-410000 in cluster false-410000
	I1122 10:54:22.358269    4140 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:22.358292    4140 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:22.358298    4140 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:22.358372    4140 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:22.358378    4140 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:22.358442    4140 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/false-410000/config.json ...
	I1122 10:54:22.358463    4140 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/false-410000/config.json: {Name:mk586d40ea39204aa32e7392adb0e3e791f062ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:22.358664    4140 start.go:365] acquiring machines lock for false-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:22.358694    4140 start.go:369] acquired machines lock for "false-410000" in 25.209µs
	I1122 10:54:22.358703    4140 start.go:93] Provisioning new machine with config: &{Name:false-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:false-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:22.358733    4140 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:22.363223    4140 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:22.378164    4140 start.go:159] libmachine.API.Create for "false-410000" (driver="qemu2")
	I1122 10:54:22.378191    4140 client.go:168] LocalClient.Create starting
	I1122 10:54:22.378257    4140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:22.378287    4140 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:22.378296    4140 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:22.378334    4140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:22.378355    4140 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:22.378361    4140 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:22.378700    4140 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:22.507395    4140 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:22.634056    4140 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:22.634064    4140 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:22.634221    4140 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:22.646606    4140 main.go:141] libmachine: STDOUT: 
	I1122 10:54:22.646632    4140 main.go:141] libmachine: STDERR: 
	I1122 10:54:22.646699    4140 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2 +20000M
	I1122 10:54:22.658232    4140 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:22.658263    4140 main.go:141] libmachine: STDERR: 
	I1122 10:54:22.658282    4140 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:22.658289    4140 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:22.658332    4140 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:75:09:bd:25:ab -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:22.660243    4140 main.go:141] libmachine: STDOUT: 
	I1122 10:54:22.660279    4140 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:22.660298    4140 client.go:171] LocalClient.Create took 282.1075ms
	I1122 10:54:24.660852    4140 start.go:128] duration metric: createHost completed in 2.302153083s
	I1122 10:54:24.660864    4140 start.go:83] releasing machines lock for "false-410000", held for 2.302206792s
	W1122 10:54:24.660875    4140 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:24.669706    4140 out.go:177] * Deleting "false-410000" in qemu2 ...
	W1122 10:54:24.688876    4140 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:24.688882    4140 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:29.691092    4140 start.go:365] acquiring machines lock for false-410000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:29.691499    4140 start.go:369] acquired machines lock for "false-410000" in 285.25µs
	I1122 10:54:29.691656    4140 start.go:93] Provisioning new machine with config: &{Name:false-410000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:false-410000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:29.691934    4140 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:29.703324    4140 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1122 10:54:29.752291    4140 start.go:159] libmachine.API.Create for "false-410000" (driver="qemu2")
	I1122 10:54:29.752348    4140 client.go:168] LocalClient.Create starting
	I1122 10:54:29.752458    4140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:29.752520    4140 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:29.752534    4140 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:29.752598    4140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:29.752638    4140 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:29.752654    4140 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:29.757707    4140 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:29.906779    4140 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:29.989372    4140 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:29.989381    4140 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:29.989554    4140 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:30.001426    4140 main.go:141] libmachine: STDOUT: 
	I1122 10:54:30.001452    4140 main.go:141] libmachine: STDERR: 
	I1122 10:54:30.001514    4140 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2 +20000M
	I1122 10:54:30.011768    4140 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:30.011790    4140 main.go:141] libmachine: STDERR: 
	I1122 10:54:30.011812    4140 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:30.011819    4140 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:30.011860    4140 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 3072 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:f9:bf:7f:51:e5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/false-410000/disk.qcow2
	I1122 10:54:30.013478    4140 main.go:141] libmachine: STDOUT: 
	I1122 10:54:30.013503    4140 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:30.013525    4140 client.go:171] LocalClient.Create took 261.175167ms
	I1122 10:54:32.015662    4140 start.go:128] duration metric: createHost completed in 2.323736083s
	I1122 10:54:32.015733    4140 start.go:83] releasing machines lock for "false-410000", held for 2.324248625s
	W1122 10:54:32.016137    4140 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p false-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p false-410000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:32.031896    4140 out.go:177] 
	W1122 10:54:32.035879    4140 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:32.035907    4140 out.go:239] * 
	* 
	W1122 10:54:32.038459    4140 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:32.049787    4140 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/false/Start (9.84s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (9.91s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0
E1122 10:54:25.295774    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/functional-902000/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0: exit status 80 (9.875928583s)

                                                
                                                
-- stdout --
	* [old-k8s-version-714000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node old-k8s-version-714000 in cluster old-k8s-version-714000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "old-k8s-version-714000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:24.653098    4253 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:24.653238    4253 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:24.653241    4253 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:24.653248    4253 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:24.653373    4253 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:24.654370    4253 out.go:303] Setting JSON to false
	I1122 10:54:24.670424    4253 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1434,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:24.670495    4253 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:24.677755    4253 out.go:177] * [old-k8s-version-714000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:24.693677    4253 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:24.687781    4253 notify.go:220] Checking for updates...
	I1122 10:54:24.710873    4253 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:24.714891    4253 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:24.717771    4253 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:24.722731    4253 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:24.726733    4253 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:24.731066    4253 config.go:182] Loaded profile config "false-410000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:24.731137    4253 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:24.731187    4253 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:24.735791    4253 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:24.743753    4253 start.go:298] selected driver: qemu2
	I1122 10:54:24.743758    4253 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:24.743765    4253 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:24.746341    4253 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:24.750793    4253 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:24.753842    4253 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:24.753895    4253 cni.go:84] Creating CNI manager for ""
	I1122 10:54:24.753903    4253 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:54:24.753915    4253 start_flags.go:323] config:
	{Name:old-k8s-version-714000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-714000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSoc
k: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:24.758719    4253 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:24.766766    4253 out.go:177] * Starting control plane node old-k8s-version-714000 in cluster old-k8s-version-714000
	I1122 10:54:24.770765    4253 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:54:24.770787    4253 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:54:24.770795    4253 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:24.770864    4253 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:24.770870    4253 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1122 10:54:24.770957    4253 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/old-k8s-version-714000/config.json ...
	I1122 10:54:24.770967    4253 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/old-k8s-version-714000/config.json: {Name:mk3134639e8d1cbf7d16455db0306314f0022337 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:24.771182    4253 start.go:365] acquiring machines lock for old-k8s-version-714000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:24.771219    4253 start.go:369] acquired machines lock for "old-k8s-version-714000" in 27.083µs
	I1122 10:54:24.771230    4253 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-714000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-714000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP:
MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:24.771273    4253 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:24.778718    4253 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:24.797021    4253 start.go:159] libmachine.API.Create for "old-k8s-version-714000" (driver="qemu2")
	I1122 10:54:24.797060    4253 client.go:168] LocalClient.Create starting
	I1122 10:54:24.797155    4253 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:24.797189    4253 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:24.797201    4253 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:24.797243    4253 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:24.797270    4253 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:24.797279    4253 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:24.797655    4253 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:24.924171    4253 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:25.131511    4253 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:25.131532    4253 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:25.131737    4253 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:25.144215    4253 main.go:141] libmachine: STDOUT: 
	I1122 10:54:25.144236    4253 main.go:141] libmachine: STDERR: 
	I1122 10:54:25.144317    4253 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2 +20000M
	I1122 10:54:25.154878    4253 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:25.154893    4253 main.go:141] libmachine: STDERR: 
	I1122 10:54:25.154922    4253 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:25.154937    4253 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:25.154979    4253 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5a:42:21:82:9b:ed -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:25.156651    4253 main.go:141] libmachine: STDOUT: 
	I1122 10:54:25.156666    4253 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:25.156685    4253 client.go:171] LocalClient.Create took 359.623958ms
	I1122 10:54:27.158860    4253 start.go:128] duration metric: createHost completed in 2.387600125s
	I1122 10:54:27.158942    4253 start.go:83] releasing machines lock for "old-k8s-version-714000", held for 2.387755334s
	W1122 10:54:27.159051    4253 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:27.168420    4253 out.go:177] * Deleting "old-k8s-version-714000" in qemu2 ...
	W1122 10:54:27.191938    4253 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:27.191963    4253 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:32.193816    4253 start.go:365] acquiring machines lock for old-k8s-version-714000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:32.193889    4253 start.go:369] acquired machines lock for "old-k8s-version-714000" in 47.792µs
	I1122 10:54:32.193915    4253 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-714000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-714000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP:
MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:32.193961    4253 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:32.197263    4253 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:32.212384    4253 start.go:159] libmachine.API.Create for "old-k8s-version-714000" (driver="qemu2")
	I1122 10:54:32.212410    4253 client.go:168] LocalClient.Create starting
	I1122 10:54:32.212470    4253 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:32.212493    4253 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:32.212509    4253 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:32.212543    4253 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:32.212558    4253 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:32.212564    4253 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:32.212857    4253 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:32.348221    4253 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:32.439705    4253 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:32.439715    4253 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:32.439921    4253 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:32.453215    4253 main.go:141] libmachine: STDOUT: 
	I1122 10:54:32.453248    4253 main.go:141] libmachine: STDERR: 
	I1122 10:54:32.453314    4253 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2 +20000M
	I1122 10:54:32.465475    4253 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:32.465491    4253 main.go:141] libmachine: STDERR: 
	I1122 10:54:32.465506    4253 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:32.465512    4253 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:32.465547    4253 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:62:94:79:1f:2e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:32.467304    4253 main.go:141] libmachine: STDOUT: 
	I1122 10:54:32.467320    4253 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:32.467348    4253 client.go:171] LocalClient.Create took 254.925208ms
	I1122 10:54:34.467670    4253 start.go:128] duration metric: createHost completed in 2.273742709s
	I1122 10:54:34.467683    4253 start.go:83] releasing machines lock for "old-k8s-version-714000", held for 2.273829916s
	W1122 10:54:34.467770    4253 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-714000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-714000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:34.476449    4253 out.go:177] 
	W1122 10:54:34.479441    4253 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:34.479457    4253 out.go:239] * 
	* 
	W1122 10:54:34.479960    4253 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:34.491379    4253 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (33.776583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (9.91s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-714000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-714000 create -f testdata/busybox.yaml: exit status 1 (27.37275ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-714000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (33.038792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (37.09275ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (9.94s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (9.88705475s)

                                                
                                                
-- stdout --
	* [no-preload-301000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node no-preload-301000 in cluster no-preload-301000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "no-preload-301000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:34.584472    4386 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:34.584677    4386 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:34.584682    4386 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:34.584685    4386 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:34.584823    4386 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:34.586358    4386 out.go:303] Setting JSON to false
	I1122 10:54:34.604536    4386 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1444,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:34.604628    4386 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:34.609478    4386 out.go:177] * [no-preload-301000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:34.617487    4386 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:34.617531    4386 notify.go:220] Checking for updates...
	I1122 10:54:34.625361    4386 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:34.635344    4386 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:34.640571    4386 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:34.644342    4386 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:34.648408    4386 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:34.652798    4386 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:34.652885    4386 config.go:182] Loaded profile config "old-k8s-version-714000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1122 10:54:34.652932    4386 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:34.657406    4386 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:34.664345    4386 start.go:298] selected driver: qemu2
	I1122 10:54:34.664350    4386 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:34.664354    4386 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:34.666514    4386 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:34.673319    4386 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:34.680522    4386 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:34.680561    4386 cni.go:84] Creating CNI manager for ""
	I1122 10:54:34.680567    4386 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:54:34.680574    4386 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:54:34.680578    4386 start_flags.go:323] config:
	{Name:no-preload-301000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:no-preload-301000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSH
AgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:34.684701    4386 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.693385    4386 out.go:177] * Starting control plane node no-preload-301000 in cluster no-preload-301000
	I1122 10:54:34.697417    4386 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:34.697546    4386 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/no-preload-301000/config.json ...
	I1122 10:54:34.697562    4386 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/no-preload-301000/config.json: {Name:mkd688e43d1ef8476d1a1fb97c7997c22148368a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:34.697561    4386 cache.go:107] acquiring lock: {Name:mk0f6cdb8005d4a570d795f2da365a2399b596a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697580    4386 cache.go:107] acquiring lock: {Name:mkcb3364aabfa5a6859fb58542a6afa922cdf103 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697618    4386 cache.go:107] acquiring lock: {Name:mk85402b4e279676d0575caa6700220cb1a8eb25 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697640    4386 cache.go:107] acquiring lock: {Name:mk416650525de2fd342a20d6123879f1dc897daa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697628    4386 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1122 10:54:34.697682    4386 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 113.291µs
	I1122 10:54:34.697698    4386 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1122 10:54:34.697561    4386 cache.go:107] acquiring lock: {Name:mk7620ae8be9d937797c83db8534d9b7a06a414b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697699    4386 cache.go:107] acquiring lock: {Name:mk39b7ee45ed7b4b67028e6ae8926ced9c04ba17 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697762    4386 cache.go:107] acquiring lock: {Name:mkebbdd1d741da23870fb06c09d24f986652ad28 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697768    4386 cache.go:107] acquiring lock: {Name:mkd91a21ac588943357300ca163e0cbbabe9b288 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:34.697885    4386 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.28.4
	I1122 10:54:34.697881    4386 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.28.4
	I1122 10:54:34.697987    4386 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.28.4
	I1122 10:54:34.698010    4386 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.28.4
	I1122 10:54:34.698027    4386 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.9-0
	I1122 10:54:34.698010    4386 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.10.1
	I1122 10:54:34.698056    4386 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I1122 10:54:34.698155    4386 start.go:365] acquiring machines lock for no-preload-301000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:34.698190    4386 start.go:369] acquired machines lock for "no-preload-301000" in 25.542µs
	I1122 10:54:34.698202    4386 start.go:93] Provisioning new machine with config: &{Name:no-preload-301000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:no-preload-301000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:34.698258    4386 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:34.706207    4386 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:34.706929    4386 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.9-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.9-0
	I1122 10:54:34.712544    4386 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.28.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.28.4
	I1122 10:54:34.712657    4386 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.10.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.10.1
	I1122 10:54:34.712677    4386 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.28.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.28.4
	I1122 10:54:34.715684    4386 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I1122 10:54:34.715708    4386 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.28.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.28.4
	I1122 10:54:34.715801    4386 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.28.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.28.4
	I1122 10:54:34.722354    4386 start.go:159] libmachine.API.Create for "no-preload-301000" (driver="qemu2")
	I1122 10:54:34.722373    4386 client.go:168] LocalClient.Create starting
	I1122 10:54:34.722438    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:34.722465    4386 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:34.722477    4386 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:34.722508    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:34.722529    4386 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:34.722536    4386 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:34.722898    4386 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:34.904729    4386 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:34.975912    4386 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:34.976042    4386 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:34.976285    4386 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:34.989941    4386 main.go:141] libmachine: STDOUT: 
	I1122 10:54:34.989969    4386 main.go:141] libmachine: STDERR: 
	I1122 10:54:34.990017    4386 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2 +20000M
	I1122 10:54:35.001959    4386 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:35.001976    4386 main.go:141] libmachine: STDERR: 
	I1122 10:54:35.001988    4386 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:35.001995    4386 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:35.002021    4386 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/qemu.pid -device virtio-net-pci,netdev=net0,mac=9a:8e:ff:f2:11:9e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:35.003918    4386 main.go:141] libmachine: STDOUT: 
	I1122 10:54:35.003943    4386 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:35.003961    4386 client.go:171] LocalClient.Create took 281.58725ms
	I1122 10:54:35.093888    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0
	I1122 10:54:35.123715    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4
	I1122 10:54:35.126466    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1
	I1122 10:54:35.135786    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9
	I1122 10:54:35.141847    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4
	I1122 10:54:35.169580    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4
	I1122 10:54:35.183487    4386 cache.go:162] opening:  /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4
	I1122 10:54:35.285836    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
	I1122 10:54:35.285873    4386 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 588.1995ms
	I1122 10:54:35.285896    4386 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
	I1122 10:54:37.004139    4386 start.go:128] duration metric: createHost completed in 2.30589625s
	I1122 10:54:37.004192    4386 start.go:83] releasing machines lock for "no-preload-301000", held for 2.3060325s
	W1122 10:54:37.004279    4386 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:37.020887    4386 out.go:177] * Deleting "no-preload-301000" in qemu2 ...
	W1122 10:54:37.053681    4386 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:37.053711    4386 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:37.964004    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4 exists
	I1122 10:54:37.964050    4386 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4" took 3.266348041s
	I1122 10:54:37.964077    4386 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4 succeeded
	I1122 10:54:38.191212    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4 exists
	I1122 10:54:38.191275    4386 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4" took 3.493773208s
	I1122 10:54:38.191306    4386 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4 succeeded
	I1122 10:54:38.677911    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1 exists
	I1122 10:54:38.677962    4386 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.10.1" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1" took 3.980318333s
	I1122 10:54:38.677989    4386 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.10.1 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1 succeeded
	I1122 10:54:39.251970    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4 exists
	I1122 10:54:39.252029    4386 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4" took 4.554499875s
	I1122 10:54:39.252110    4386 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4 succeeded
	I1122 10:54:39.773885    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4 exists
	I1122 10:54:39.773926    4386 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4" took 5.076431833s
	I1122 10:54:39.773958    4386 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4 succeeded
	I1122 10:54:42.058306    4386 start.go:365] acquiring machines lock for no-preload-301000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:42.068773    4386 start.go:369] acquired machines lock for "no-preload-301000" in 10.4105ms
	I1122 10:54:42.068839    4386 start.go:93] Provisioning new machine with config: &{Name:no-preload-301000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:no-preload-301000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:42.069060    4386 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:42.079031    4386 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:42.124935    4386 start.go:159] libmachine.API.Create for "no-preload-301000" (driver="qemu2")
	I1122 10:54:42.125035    4386 client.go:168] LocalClient.Create starting
	I1122 10:54:42.125133    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:42.125193    4386 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:42.125217    4386 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:42.125287    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:42.125328    4386 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:42.125369    4386 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:42.125885    4386 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:42.267265    4386 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:42.365485    4386 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:42.365495    4386 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:42.365692    4386 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:42.379195    4386 main.go:141] libmachine: STDOUT: 
	I1122 10:54:42.379229    4386 main.go:141] libmachine: STDERR: 
	I1122 10:54:42.379287    4386 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2 +20000M
	I1122 10:54:42.392835    4386 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:42.392949    4386 main.go:141] libmachine: STDERR: 
	I1122 10:54:42.392968    4386 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:42.392973    4386 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:42.393033    4386 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/qemu.pid -device virtio-net-pci,netdev=net0,mac=aa:9a:d4:11:e8:62 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:42.395169    4386 main.go:141] libmachine: STDOUT: 
	I1122 10:54:42.395194    4386 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:42.395207    4386 client.go:171] LocalClient.Create took 270.171334ms
	I1122 10:54:43.422892    4386 cache.go:157] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0 exists
	I1122 10:54:43.422985    4386 cache.go:96] cache image "registry.k8s.io/etcd:3.5.9-0" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0" took 8.725494667s
	I1122 10:54:43.423016    4386 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.9-0 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0 succeeded
	I1122 10:54:43.423069    4386 cache.go:87] Successfully saved all images to host disk.
	I1122 10:54:44.397370    4386 start.go:128] duration metric: createHost completed in 2.328314208s
	I1122 10:54:44.397450    4386 start.go:83] releasing machines lock for "no-preload-301000", held for 2.328662833s
	W1122 10:54:44.397824    4386 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-301000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-301000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:44.410289    4386 out.go:177] 
	W1122 10:54:44.415429    4386 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:44.415476    4386 out.go:239] * 
	* 
	W1122 10:54:44.418156    4386 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:44.428350    4386 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (53.558667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (9.94s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.15s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p old-k8s-version-714000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-714000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-714000 describe deploy/metrics-server -n kube-system: exit status 1 (30.148625ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-714000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-714000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (36.189084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.15s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (7.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0: exit status 80 (7.142729167s)

                                                
                                                
-- stdout --
	* [old-k8s-version-714000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	* Using the qemu2 driver based on existing profile
	* Starting control plane node old-k8s-version-714000 in cluster old-k8s-version-714000
	* Restarting existing qemu2 VM for "old-k8s-version-714000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "old-k8s-version-714000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:34.996000    4434 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:34.996198    4434 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:34.996201    4434 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:34.996204    4434 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:34.996338    4434 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:34.997376    4434 out.go:303] Setting JSON to false
	I1122 10:54:35.014249    4434 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1445,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:35.014316    4434 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:35.019413    4434 out.go:177] * [old-k8s-version-714000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:35.025302    4434 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:35.025359    4434 notify.go:220] Checking for updates...
	I1122 10:54:35.034450    4434 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:35.041437    4434 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:35.045461    4434 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:35.048414    4434 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:35.052385    4434 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:35.056415    4434 config.go:182] Loaded profile config "old-k8s-version-714000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1122 10:54:35.059398    4434 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	I1122 10:54:35.062347    4434 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:35.066222    4434 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:54:35.073378    4434 start.go:298] selected driver: qemu2
	I1122 10:54:35.073382    4434 start.go:902] validating driver "qemu2" against &{Name:old-k8s-version-714000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes
Config:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-714000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequ
ested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:35.073430    4434 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:35.075840    4434 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:35.075893    4434 cni.go:84] Creating CNI manager for ""
	I1122 10:54:35.075899    4434 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:54:35.075906    4434 start_flags.go:323] config:
	{Name:old-k8s-version-714000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-714000 Namespace:
default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Use
rs:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:35.080214    4434 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:35.087394    4434 out.go:177] * Starting control plane node old-k8s-version-714000 in cluster old-k8s-version-714000
	I1122 10:54:35.092183    4434 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:54:35.092200    4434 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:54:35.092212    4434 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:35.092277    4434 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:35.092282    4434 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1122 10:54:35.092339    4434 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/old-k8s-version-714000/config.json ...
	I1122 10:54:35.092835    4434 start.go:365] acquiring machines lock for old-k8s-version-714000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:37.004339    4434 start.go:369] acquired machines lock for "old-k8s-version-714000" in 1.9114765s
	I1122 10:54:37.004492    4434 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:54:37.004573    4434 fix.go:54] fixHost starting: 
	I1122 10:54:37.005297    4434 fix.go:102] recreateIfNeeded on old-k8s-version-714000: state=Stopped err=<nil>
	W1122 10:54:37.005341    4434 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:54:37.015967    4434 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-714000" ...
	I1122 10:54:37.027966    4434 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:62:94:79:1f:2e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:37.039956    4434 main.go:141] libmachine: STDOUT: 
	I1122 10:54:37.040031    4434 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:37.040154    4434 fix.go:56] fixHost completed within 35.578125ms
	I1122 10:54:37.040177    4434 start.go:83] releasing machines lock for "old-k8s-version-714000", held for 35.801875ms
	W1122 10:54:37.040218    4434 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:37.040670    4434 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:37.040686    4434 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:42.042866    4434 start.go:365] acquiring machines lock for old-k8s-version-714000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:42.043425    4434 start.go:369] acquired machines lock for "old-k8s-version-714000" in 409.834µs
	I1122 10:54:42.043582    4434 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:54:42.043603    4434 fix.go:54] fixHost starting: 
	I1122 10:54:42.044372    4434 fix.go:102] recreateIfNeeded on old-k8s-version-714000: state=Stopped err=<nil>
	W1122 10:54:42.044400    4434 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:54:42.053994    4434 out.go:177] * Restarting existing qemu2 VM for "old-k8s-version-714000" ...
	I1122 10:54:42.058133    4434 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:62:94:79:1f:2e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/old-k8s-version-714000/disk.qcow2
	I1122 10:54:42.068448    4434 main.go:141] libmachine: STDOUT: 
	I1122 10:54:42.068531    4434 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:42.068661    4434 fix.go:56] fixHost completed within 25.058625ms
	I1122 10:54:42.068682    4434 start.go:83] releasing machines lock for "old-k8s-version-714000", held for 25.213875ms
	W1122 10:54:42.068914    4434 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-714000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p old-k8s-version-714000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:42.082007    4434 out.go:177] 
	W1122 10:54:42.086344    4434 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:42.086370    4434 out.go:239] * 
	* 
	W1122 10:54:42.088841    4434 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:42.097984    4434 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p old-k8s-version-714000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=qemu2  --kubernetes-version=v1.16.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (51.385958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (7.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-714000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (36.550625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-714000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-714000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-714000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (29.345125ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-714000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-714000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (35.627084ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 ssh -p old-k8s-version-714000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p old-k8s-version-714000 "sudo crictl images -o json": exit status 89 (56.433083ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p old-k8s-version-714000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-arm64 ssh -p old-k8s-version-714000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p old-k8s-version-714000"
start_stop_delete_test.go:304: v1.16.0 images missing (-want +got):
  []string{
- 	"k8s.gcr.io/coredns:1.6.2",
- 	"k8s.gcr.io/etcd:3.3.15-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.16.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.16.0",
- 	"k8s.gcr.io/kube-proxy:v1.16.0",
- 	"k8s.gcr.io/kube-scheduler:v1.16.0",
- 	"k8s.gcr.io/pause:3.1",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (31.652875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.09s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p old-k8s-version-714000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p old-k8s-version-714000 --alsologtostderr -v=1: exit status 89 (41.937417ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p old-k8s-version-714000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:42.380890    4461 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:42.381050    4461 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:42.381053    4461 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:42.381056    4461 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:42.381172    4461 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:42.381408    4461 out.go:303] Setting JSON to false
	I1122 10:54:42.381418    4461 mustload.go:65] Loading cluster: old-k8s-version-714000
	I1122 10:54:42.381636    4461 config.go:182] Loaded profile config "old-k8s-version-714000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1122 10:54:42.385927    4461 out.go:177] * The control plane node must be running for this command
	I1122 10:54:42.389039    4461 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-714000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p old-k8s-version-714000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (30.422875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (31.261916ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-714000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.41s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (11.35972675s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-650000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node default-k8s-diff-port-650000 in cluster default-k8s-diff-port-650000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "default-k8s-diff-port-650000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:42.846677    4487 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:42.846820    4487 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:42.846823    4487 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:42.846826    4487 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:42.846947    4487 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:42.848042    4487 out.go:303] Setting JSON to false
	I1122 10:54:42.864070    4487 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1452,"bootTime":1700677830,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:42.864152    4487 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:42.868619    4487 out.go:177] * [default-k8s-diff-port-650000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:42.875508    4487 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:42.871559    4487 notify.go:220] Checking for updates...
	I1122 10:54:42.883545    4487 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:42.886546    4487 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:42.893354    4487 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:42.901501    4487 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:42.904497    4487 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:42.907874    4487 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:42.907940    4487 config.go:182] Loaded profile config "no-preload-301000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:42.907986    4487 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:42.912517    4487 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:42.919529    4487 start.go:298] selected driver: qemu2
	I1122 10:54:42.919534    4487 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:42.919539    4487 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:42.921907    4487 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:54:42.926565    4487 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:42.930630    4487 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:42.930668    4487 cni.go:84] Creating CNI manager for ""
	I1122 10:54:42.930675    4487 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:54:42.930679    4487 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:54:42.930684    4487 start_flags.go:323] config:
	{Name:default-k8s-diff-port-650000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-650000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Stat
icIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:42.935291    4487 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:42.943387    4487 out.go:177] * Starting control plane node default-k8s-diff-port-650000 in cluster default-k8s-diff-port-650000
	I1122 10:54:42.947675    4487 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:42.947689    4487 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:42.947697    4487 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:42.947757    4487 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:42.947762    4487 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:42.947832    4487 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/default-k8s-diff-port-650000/config.json ...
	I1122 10:54:42.947844    4487 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/default-k8s-diff-port-650000/config.json: {Name:mk58e24ff661396bba20a6eec31ce79511e58360 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:42.948073    4487 start.go:365] acquiring machines lock for default-k8s-diff-port-650000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:44.397604    4487 start.go:369] acquired machines lock for "default-k8s-diff-port-650000" in 1.449529208s
	I1122 10:54:44.397796    4487 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-650000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-650000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:
docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:44.398013    4487 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:44.407324    4487 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:44.457132    4487 start.go:159] libmachine.API.Create for "default-k8s-diff-port-650000" (driver="qemu2")
	I1122 10:54:44.457179    4487 client.go:168] LocalClient.Create starting
	I1122 10:54:44.457282    4487 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:44.457339    4487 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:44.457355    4487 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:44.457417    4487 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:44.457459    4487 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:44.457473    4487 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:44.458105    4487 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:44.603287    4487 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:44.645712    4487 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:44.645720    4487 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:44.645884    4487 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:44.661369    4487 main.go:141] libmachine: STDOUT: 
	I1122 10:54:44.661401    4487 main.go:141] libmachine: STDERR: 
	I1122 10:54:44.661462    4487 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2 +20000M
	I1122 10:54:44.673097    4487 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:44.673114    4487 main.go:141] libmachine: STDERR: 
	I1122 10:54:44.673154    4487 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:44.673160    4487 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:44.673187    4487 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a6:7d:36:0c:07:15 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:44.675213    4487 main.go:141] libmachine: STDOUT: 
	I1122 10:54:44.675231    4487 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:44.675265    4487 client.go:171] LocalClient.Create took 218.082916ms
	I1122 10:54:46.677423    4487 start.go:128] duration metric: createHost completed in 2.279417209s
	I1122 10:54:46.677476    4487 start.go:83] releasing machines lock for "default-k8s-diff-port-650000", held for 2.279841166s
	W1122 10:54:46.677553    4487 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:46.695069    4487 out.go:177] * Deleting "default-k8s-diff-port-650000" in qemu2 ...
	W1122 10:54:46.723818    4487 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:46.723850    4487 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:51.725923    4487 start.go:365] acquiring machines lock for default-k8s-diff-port-650000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:51.737317    4487 start.go:369] acquired machines lock for "default-k8s-diff-port-650000" in 11.315334ms
	I1122 10:54:51.737365    4487 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-650000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-650000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:
docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:51.737661    4487 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:51.749252    4487 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:51.794240    4487 start.go:159] libmachine.API.Create for "default-k8s-diff-port-650000" (driver="qemu2")
	I1122 10:54:51.794286    4487 client.go:168] LocalClient.Create starting
	I1122 10:54:51.794385    4487 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:51.794448    4487 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:51.794482    4487 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:51.794545    4487 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:51.794591    4487 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:51.794603    4487 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:51.795127    4487 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:51.940979    4487 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:52.102686    4487 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:52.102702    4487 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:52.102910    4487 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:52.116087    4487 main.go:141] libmachine: STDOUT: 
	I1122 10:54:52.116126    4487 main.go:141] libmachine: STDERR: 
	I1122 10:54:52.116203    4487 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2 +20000M
	I1122 10:54:52.128130    4487 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:52.128164    4487 main.go:141] libmachine: STDERR: 
	I1122 10:54:52.128184    4487 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:52.128196    4487 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:52.128235    4487 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:73:25:ed:99:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:52.130301    4487 main.go:141] libmachine: STDOUT: 
	I1122 10:54:52.130320    4487 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:52.130342    4487 client.go:171] LocalClient.Create took 336.048167ms
	I1122 10:54:54.132629    4487 start.go:128] duration metric: createHost completed in 2.394963208s
	I1122 10:54:54.132717    4487 start.go:83] releasing machines lock for "default-k8s-diff-port-650000", held for 2.395418584s
	W1122 10:54:54.133069    4487 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-650000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-650000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:54.145644    4487 out.go:177] 
	W1122 10:54:54.153859    4487 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:54.153918    4487 out.go:239] * 
	* 
	W1122 10:54:54.155903    4487 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:54.166667    4487 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (51.374ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.41s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-301000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-301000 create -f testdata/busybox.yaml: exit status 1 (30.098333ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-301000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (35.047292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (35.173583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p no-preload-301000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-301000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-301000 describe deploy/metrics-server -n kube-system: exit status 1 (26.702042ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-301000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-301000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (31.134667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (6.94s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (6.890115375s)

                                                
                                                
-- stdout --
	* [no-preload-301000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node no-preload-301000 in cluster no-preload-301000
	* Restarting existing qemu2 VM for "no-preload-301000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "no-preload-301000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:44.915132    4515 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:44.915261    4515 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:44.915264    4515 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:44.915266    4515 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:44.915400    4515 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:44.916395    4515 out.go:303] Setting JSON to false
	I1122 10:54:44.932513    4515 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1454,"bootTime":1700677830,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:44.932602    4515 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:44.937329    4515 out.go:177] * [no-preload-301000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:44.944157    4515 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:44.948263    4515 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:44.944223    4515 notify.go:220] Checking for updates...
	I1122 10:54:44.952309    4515 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:44.955270    4515 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:44.958313    4515 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:44.961316    4515 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:44.963195    4515 config.go:182] Loaded profile config "no-preload-301000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:44.963457    4515 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:44.968283    4515 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:54:44.975145    4515 start.go:298] selected driver: qemu2
	I1122 10:54:44.975152    4515 start.go:902] validating driver "qemu2" against &{Name:no-preload-301000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:no-preload-301000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:
false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:44.975211    4515 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:44.977501    4515 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:44.977546    4515 cni.go:84] Creating CNI manager for ""
	I1122 10:54:44.977553    4515 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:54:44.977560    4515 start_flags.go:323] config:
	{Name:no-preload-301000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:no-preload-301000 Namespace:default A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/mi
nikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:44.981686    4515 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.988271    4515 out.go:177] * Starting control plane node no-preload-301000 in cluster no-preload-301000
	I1122 10:54:44.991224    4515 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:44.991301    4515 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/no-preload-301000/config.json ...
	I1122 10:54:44.991296    4515 cache.go:107] acquiring lock: {Name:mk0f6cdb8005d4a570d795f2da365a2399b596a6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991296    4515 cache.go:107] acquiring lock: {Name:mk85402b4e279676d0575caa6700220cb1a8eb25 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991323    4515 cache.go:107] acquiring lock: {Name:mk39b7ee45ed7b4b67028e6ae8926ced9c04ba17 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991366    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4 exists
	I1122 10:54:44.991375    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 exists
	I1122 10:54:44.991298    4515 cache.go:107] acquiring lock: {Name:mkcb3364aabfa5a6859fb58542a6afa922cdf103 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991380    4515 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9" took 57.75µs
	I1122 10:54:44.991392    4515 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/pause_3.9 succeeded
	I1122 10:54:44.991374    4515 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4" took 80.458µs
	I1122 10:54:44.991396    4515 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.28.4 succeeded
	I1122 10:54:44.991401    4515 cache.go:107] acquiring lock: {Name:mkd91a21ac588943357300ca163e0cbbabe9b288 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991410    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4 exists
	I1122 10:54:44.991408    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1122 10:54:44.991413    4515 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4" took 120.042µs
	I1122 10:54:44.991442    4515 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 148.5µs
	I1122 10:54:44.991443    4515 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.28.4 succeeded
	I1122 10:54:44.991448    4515 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1122 10:54:44.991433    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4 exists
	I1122 10:54:44.991450    4515 cache.go:107] acquiring lock: {Name:mk7620ae8be9d937797c83db8534d9b7a06a414b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991458    4515 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4" took 57.583µs
	I1122 10:54:44.991465    4515 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.28.4 succeeded
	I1122 10:54:44.991415    4515 cache.go:107] acquiring lock: {Name:mk416650525de2fd342a20d6123879f1dc897daa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991480    4515 cache.go:107] acquiring lock: {Name:mkebbdd1d741da23870fb06c09d24f986652ad28 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:44.991503    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0 exists
	I1122 10:54:44.991509    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4 exists
	I1122 10:54:44.991510    4515 cache.go:96] cache image "registry.k8s.io/etcd:3.5.9-0" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0" took 126.25µs
	I1122 10:54:44.991515    4515 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.9-0 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.9-0 succeeded
	I1122 10:54:44.991514    4515 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.28.4" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4" took 104.75µs
	I1122 10:54:44.991522    4515 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.28.4 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.28.4 succeeded
	I1122 10:54:44.991524    4515 cache.go:115] /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1 exists
	I1122 10:54:44.991529    4515 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.10.1" -> "/Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1" took 71.25µs
	I1122 10:54:44.991536    4515 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.10.1 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.10.1 succeeded
	I1122 10:54:44.991544    4515 cache.go:87] Successfully saved all images to host disk.
	I1122 10:54:44.991673    4515 start.go:365] acquiring machines lock for no-preload-301000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:46.677590    4515 start.go:369] acquired machines lock for "no-preload-301000" in 1.685922375s
	I1122 10:54:46.677752    4515 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:54:46.677794    4515 fix.go:54] fixHost starting: 
	I1122 10:54:46.678453    4515 fix.go:102] recreateIfNeeded on no-preload-301000: state=Stopped err=<nil>
	W1122 10:54:46.678499    4515 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:54:46.686093    4515 out.go:177] * Restarting existing qemu2 VM for "no-preload-301000" ...
	I1122 10:54:46.699172    4515 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/qemu.pid -device virtio-net-pci,netdev=net0,mac=aa:9a:d4:11:e8:62 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:46.709836    4515 main.go:141] libmachine: STDOUT: 
	I1122 10:54:46.709900    4515 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:46.710021    4515 fix.go:56] fixHost completed within 32.223125ms
	I1122 10:54:46.710038    4515 start.go:83] releasing machines lock for "no-preload-301000", held for 32.384042ms
	W1122 10:54:46.710077    4515 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:46.710236    4515 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:46.710251    4515 start.go:706] Will try again in 5 seconds ...
	I1122 10:54:51.712440    4515 start.go:365] acquiring machines lock for no-preload-301000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:51.712752    4515 start.go:369] acquired machines lock for "no-preload-301000" in 234.292µs
	I1122 10:54:51.712889    4515 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:54:51.712910    4515 fix.go:54] fixHost starting: 
	I1122 10:54:51.713690    4515 fix.go:102] recreateIfNeeded on no-preload-301000: state=Stopped err=<nil>
	W1122 10:54:51.713720    4515 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:54:51.719075    4515 out.go:177] * Restarting existing qemu2 VM for "no-preload-301000" ...
	I1122 10:54:51.727500    4515 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/qemu.pid -device virtio-net-pci,netdev=net0,mac=aa:9a:d4:11:e8:62 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/no-preload-301000/disk.qcow2
	I1122 10:54:51.737073    4515 main.go:141] libmachine: STDOUT: 
	I1122 10:54:51.737135    4515 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:51.737226    4515 fix.go:56] fixHost completed within 24.319ms
	I1122 10:54:51.737242    4515 start.go:83] releasing machines lock for "no-preload-301000", held for 24.472291ms
	W1122 10:54:51.737423    4515 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p no-preload-301000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p no-preload-301000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:51.753201    4515 out.go:177] 
	W1122 10:54:51.757301    4515 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:51.757359    4515 out.go:239] * 
	* 
	W1122 10:54:51.759520    4515 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:54:51.765701    4515 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p no-preload-301000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (53.057459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (6.94s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-301000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (36.158834ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-301000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-301000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-301000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (29.321583ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-301000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-301000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (36.242083ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 ssh -p no-preload-301000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p no-preload-301000 "sudo crictl images -o json": exit status 89 (47.488084ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p no-preload-301000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-arm64 ssh -p no-preload-301000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p no-preload-301000"
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (32.384ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p no-preload-301000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p no-preload-301000 --alsologtostderr -v=1: exit status 89 (42.199916ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p no-preload-301000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:52.043475    4537 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:52.043646    4537 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:52.043649    4537 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:52.043652    4537 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:52.043786    4537 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:52.044033    4537 out.go:303] Setting JSON to false
	I1122 10:54:52.044046    4537 mustload.go:65] Loading cluster: no-preload-301000
	I1122 10:54:52.044265    4537 config.go:182] Loaded profile config "no-preload-301000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:52.048193    4537 out.go:177] * The control plane node must be running for this command
	I1122 10:54:52.051174    4537 out.go:177]   To start a cluster, run: "minikube start -p no-preload-301000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p no-preload-301000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (31.559458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (32.301917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (11.61s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (11.551241208s)

                                                
                                                
-- stdout --
	* [newest-cni-496000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node newest-cni-496000 in cluster newest-cni-496000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "newest-cni-496000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:52.507518    4563 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:52.507667    4563 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:52.507671    4563 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:52.507673    4563 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:52.507797    4563 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:52.508846    4563 out.go:303] Setting JSON to false
	I1122 10:54:52.524877    4563 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1462,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:52.524970    4563 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:52.530159    4563 out.go:177] * [newest-cni-496000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:52.537327    4563 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:52.541258    4563 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:52.537388    4563 notify.go:220] Checking for updates...
	I1122 10:54:52.548231    4563 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:52.551279    4563 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:52.554282    4563 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:52.557277    4563 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:52.560628    4563 config.go:182] Loaded profile config "default-k8s-diff-port-650000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:52.560700    4563 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:52.560747    4563 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:52.565265    4563 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:54:52.571205    4563 start.go:298] selected driver: qemu2
	I1122 10:54:52.571211    4563 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:54:52.571216    4563 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:52.573685    4563 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	W1122 10:54:52.573714    4563 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I1122 10:54:52.578252    4563 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:54:52.584278    4563 start_flags.go:950] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1122 10:54:52.584313    4563 cni.go:84] Creating CNI manager for ""
	I1122 10:54:52.584320    4563 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:54:52.584328    4563 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:54:52.584339    4563 start_flags.go:323] config:
	{Name:newest-cni-496000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:newest-cni-496000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/s
ocket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:52.588674    4563 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:52.596290    4563 out.go:177] * Starting control plane node newest-cni-496000 in cluster newest-cni-496000
	I1122 10:54:52.600248    4563 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:52.600265    4563 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:52.600275    4563 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:52.600337    4563 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:52.600344    4563 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:52.600409    4563 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/newest-cni-496000/config.json ...
	I1122 10:54:52.600420    4563 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/newest-cni-496000/config.json: {Name:mk63447ca3c14eb65bc1211361433a700373b5db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:54:52.600640    4563 start.go:365] acquiring machines lock for newest-cni-496000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:54.132845    4563 start.go:369] acquired machines lock for "newest-cni-496000" in 1.532183875s
	I1122 10:54:54.132997    4563 start.go:93] Provisioning new machine with config: &{Name:newest-cni-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:newest-cni-496000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountS
tring:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:54:54.133181    4563 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:54:54.142523    4563 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:54:54.190168    4563 start.go:159] libmachine.API.Create for "newest-cni-496000" (driver="qemu2")
	I1122 10:54:54.190212    4563 client.go:168] LocalClient.Create starting
	I1122 10:54:54.190409    4563 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:54:54.190503    4563 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:54.190523    4563 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:54.190606    4563 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:54:54.190649    4563 main.go:141] libmachine: Decoding PEM data...
	I1122 10:54:54.190662    4563 main.go:141] libmachine: Parsing certificate...
	I1122 10:54:54.191313    4563 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:54:54.333716    4563 main.go:141] libmachine: Creating SSH key...
	I1122 10:54:54.395950    4563 main.go:141] libmachine: Creating Disk image...
	I1122 10:54:54.395958    4563 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:54:54.396152    4563 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:54:54.408951    4563 main.go:141] libmachine: STDOUT: 
	I1122 10:54:54.408975    4563 main.go:141] libmachine: STDERR: 
	I1122 10:54:54.409036    4563 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2 +20000M
	I1122 10:54:54.420707    4563 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:54:54.420728    4563 main.go:141] libmachine: STDERR: 
	I1122 10:54:54.420748    4563 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:54:54.420753    4563 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:54:54.420788    4563 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:76:5e:35:e4:a1 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:54:54.422864    4563 main.go:141] libmachine: STDOUT: 
	I1122 10:54:54.422884    4563 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:54.422904    4563 client.go:171] LocalClient.Create took 232.676292ms
	I1122 10:54:56.425299    4563 start.go:128] duration metric: createHost completed in 2.292056208s
	I1122 10:54:56.425388    4563 start.go:83] releasing machines lock for "newest-cni-496000", held for 2.292538875s
	W1122 10:54:56.425443    4563 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:56.442897    4563 out.go:177] * Deleting "newest-cni-496000" in qemu2 ...
	W1122 10:54:56.467370    4563 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:56.467393    4563 start.go:706] Will try again in 5 seconds ...
	I1122 10:55:01.468424    4563 start.go:365] acquiring machines lock for newest-cni-496000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:01.482281    4563 start.go:369] acquired machines lock for "newest-cni-496000" in 13.776666ms
	I1122 10:55:01.482343    4563 start.go:93] Provisioning new machine with config: &{Name:newest-cni-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:newest-cni-496000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountS
tring:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:55:01.482581    4563 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:55:01.490249    4563 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:55:01.535461    4563 start.go:159] libmachine.API.Create for "newest-cni-496000" (driver="qemu2")
	I1122 10:55:01.535509    4563 client.go:168] LocalClient.Create starting
	I1122 10:55:01.535614    4563 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:55:01.535674    4563 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:01.535690    4563 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:01.535757    4563 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:55:01.535806    4563 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:01.535819    4563 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:01.536349    4563 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:55:01.676387    4563 main.go:141] libmachine: Creating SSH key...
	I1122 10:55:01.953392    4563 main.go:141] libmachine: Creating Disk image...
	I1122 10:55:01.953402    4563 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:55:01.953564    4563 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:55:01.971098    4563 main.go:141] libmachine: STDOUT: 
	I1122 10:55:01.971122    4563 main.go:141] libmachine: STDERR: 
	I1122 10:55:01.971188    4563 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2 +20000M
	I1122 10:55:01.982906    4563 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:55:01.982924    4563 main.go:141] libmachine: STDERR: 
	I1122 10:55:01.982940    4563 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:55:01.982946    4563 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:55:01.982999    4563 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:37:d0:83:cd:d2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:55:01.984983    4563 main.go:141] libmachine: STDOUT: 
	I1122 10:55:01.984999    4563 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:01.985010    4563 client.go:171] LocalClient.Create took 449.504125ms
	I1122 10:55:03.987267    4563 start.go:128] duration metric: createHost completed in 2.504694083s
	I1122 10:55:03.987319    4563 start.go:83] releasing machines lock for "newest-cni-496000", held for 2.505054541s
	W1122 10:55:03.987627    4563 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-496000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-496000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:04.003267    4563 out.go:177] 
	W1122 10:55:04.007389    4563 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:04.007434    4563 out.go:239] * 
	* 
	W1122 10:55:04.009717    4563 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:55:04.019293    4563 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (53.214917ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (11.61s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-650000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-650000 create -f testdata/busybox.yaml: exit status 1 (31.8305ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-650000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (36.172833ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (35.823167ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p default-k8s-diff-port-650000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-650000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-650000 describe deploy/metrics-server -n kube-system: exit status 1 (26.898375ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-650000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-650000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (31.605375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.96s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (6.900715375s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-650000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node default-k8s-diff-port-650000 in cluster default-k8s-diff-port-650000
	* Restarting existing qemu2 VM for "default-k8s-diff-port-650000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "default-k8s-diff-port-650000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:54:54.647191    4592 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:54:54.647331    4592 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:54.647334    4592 out.go:309] Setting ErrFile to fd 2...
	I1122 10:54:54.647337    4592 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:54:54.647475    4592 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:54:54.648482    4592 out.go:303] Setting JSON to false
	I1122 10:54:54.664326    4592 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1464,"bootTime":1700677830,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:54:54.664395    4592 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:54:54.667704    4592 out.go:177] * [default-k8s-diff-port-650000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:54:54.673696    4592 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:54:54.676564    4592 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:54:54.673747    4592 notify.go:220] Checking for updates...
	I1122 10:54:54.680669    4592 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:54:54.684657    4592 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:54:54.688631    4592 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:54:54.691688    4592 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:54:54.695035    4592 config.go:182] Loaded profile config "default-k8s-diff-port-650000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:54:54.695294    4592 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:54:54.698607    4592 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:54:54.705733    4592 start.go:298] selected driver: qemu2
	I1122 10:54:54.705740    4592 start.go:902] validating driver "qemu2" against &{Name:default-k8s-diff-port-650000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub
ernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-650000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subne
t: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:54.705802    4592 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:54:54.708124    4592 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:54:54.708170    4592 cni.go:84] Creating CNI manager for ""
	I1122 10:54:54.708176    4592 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:54:54.708182    4592 start_flags.go:323] config:
	{Name:default-k8s-diff-port-650000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-6500
00 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false
MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:54:54.712322    4592 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:54:54.720628    4592 out.go:177] * Starting control plane node default-k8s-diff-port-650000 in cluster default-k8s-diff-port-650000
	I1122 10:54:54.724620    4592 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:54:54.724633    4592 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:54:54.724646    4592 cache.go:56] Caching tarball of preloaded images
	I1122 10:54:54.724701    4592 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:54:54.724707    4592 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:54:54.724754    4592 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/default-k8s-diff-port-650000/config.json ...
	I1122 10:54:54.725216    4592 start.go:365] acquiring machines lock for default-k8s-diff-port-650000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:54:56.425489    4592 start.go:369] acquired machines lock for "default-k8s-diff-port-650000" in 1.700279166s
	I1122 10:54:56.425638    4592 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:54:56.425692    4592 fix.go:54] fixHost starting: 
	I1122 10:54:56.426325    4592 fix.go:102] recreateIfNeeded on default-k8s-diff-port-650000: state=Stopped err=<nil>
	W1122 10:54:56.426379    4592 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:54:56.434886    4592 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-650000" ...
	I1122 10:54:56.444733    4592 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:73:25:ed:99:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:54:56.454819    4592 main.go:141] libmachine: STDOUT: 
	I1122 10:54:56.454888    4592 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:54:56.455012    4592 fix.go:56] fixHost completed within 29.337209ms
	I1122 10:54:56.455029    4592 start.go:83] releasing machines lock for "default-k8s-diff-port-650000", held for 29.482958ms
	W1122 10:54:56.455067    4592 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:54:56.455243    4592 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:54:56.455260    4592 start.go:706] Will try again in 5 seconds ...
	I1122 10:55:01.457383    4592 start.go:365] acquiring machines lock for default-k8s-diff-port-650000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:01.457818    4592 start.go:369] acquired machines lock for "default-k8s-diff-port-650000" in 307.917µs
	I1122 10:55:01.457944    4592 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:55:01.457965    4592 fix.go:54] fixHost starting: 
	I1122 10:55:01.458712    4592 fix.go:102] recreateIfNeeded on default-k8s-diff-port-650000: state=Stopped err=<nil>
	W1122 10:55:01.458740    4592 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:55:01.468172    4592 out.go:177] * Restarting existing qemu2 VM for "default-k8s-diff-port-650000" ...
	I1122 10:55:01.471711    4592 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/qemu.pid -device virtio-net-pci,netdev=net0,mac=82:73:25:ed:99:5e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/default-k8s-diff-port-650000/disk.qcow2
	I1122 10:55:01.482033    4592 main.go:141] libmachine: STDOUT: 
	I1122 10:55:01.482103    4592 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:01.482186    4592 fix.go:56] fixHost completed within 24.213292ms
	I1122 10:55:01.482206    4592 start.go:83] releasing machines lock for "default-k8s-diff-port-650000", held for 24.364042ms
	W1122 10:55:01.482458    4592 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-650000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p default-k8s-diff-port-650000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:01.493288    4592 out.go:177] 
	W1122 10:55:01.497309    4592 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:01.497343    4592 out.go:239] * 
	* 
	W1122 10:55:01.498996    4592 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:55:01.508194    4592 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p default-k8s-diff-port-650000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (53.296042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.96s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-650000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (36.26ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.04s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-650000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-650000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-650000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (29.906291ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-650000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-650000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (37.239584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 ssh -p default-k8s-diff-port-650000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p default-k8s-diff-port-650000 "sudo crictl images -o json": exit status 89 (43.782167ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-650000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-arm64 ssh -p default-k8s-diff-port-650000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p default-k8s-diff-port-650000"
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (31.887375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p default-k8s-diff-port-650000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-650000 --alsologtostderr -v=1: exit status 89 (45.755125ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-650000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:01.784087    4612 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:01.784273    4612 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:01.784275    4612 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:01.784278    4612 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:01.784397    4612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:01.784637    4612 out.go:303] Setting JSON to false
	I1122 10:55:01.784646    4612 mustload.go:65] Loading cluster: default-k8s-diff-port-650000
	I1122 10:55:01.784844    4612 config.go:182] Loaded profile config "default-k8s-diff-port-650000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:01.788225    4612 out.go:177] * The control plane node must be running for this command
	I1122 10:55:01.792308    4612 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-650000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p default-k8s-diff-port-650000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (31.85775ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (32.289792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-650000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (11.68s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (11.605379959s)

                                                
                                                
-- stdout --
	* [embed-certs-958000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on user configuration
	* Automatically selected the socket_vmnet network
	* Starting control plane node embed-certs-958000 in cluster embed-certs-958000
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Deleting "embed-certs-958000" in qemu2 ...
	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:02.255590    4638 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:02.255715    4638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:02.255719    4638 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:02.255721    4638 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:02.255850    4638 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:02.256913    4638 out.go:303] Setting JSON to false
	I1122 10:55:02.272721    4638 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1472,"bootTime":1700677830,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:55:02.272803    4638 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:55:02.277712    4638 out.go:177] * [embed-certs-958000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:55:02.280723    4638 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:55:02.284676    4638 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:55:02.280816    4638 notify.go:220] Checking for updates...
	I1122 10:55:02.291113    4638 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:55:02.294712    4638 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:55:02.297704    4638 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:55:02.300666    4638 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:55:02.304037    4638 config.go:182] Loaded profile config "multinode-722000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:02.304100    4638 config.go:182] Loaded profile config "newest-cni-496000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:02.304138    4638 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:55:02.308668    4638 out.go:177] * Using the qemu2 driver based on user configuration
	I1122 10:55:02.314581    4638 start.go:298] selected driver: qemu2
	I1122 10:55:02.314586    4638 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:55:02.314591    4638 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:55:02.316813    4638 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:55:02.320735    4638 out.go:177] * Automatically selected the socket_vmnet network
	I1122 10:55:02.322410    4638 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:55:02.322459    4638 cni.go:84] Creating CNI manager for ""
	I1122 10:55:02.322467    4638 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:55:02.322473    4638 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1122 10:55:02.322478    4638 start_flags.go:323] config:
	{Name:embed-certs-958000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-958000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SS
HAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:55:02.326961    4638 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:55:02.334678    4638 out.go:177] * Starting control plane node embed-certs-958000 in cluster embed-certs-958000
	I1122 10:55:02.338656    4638 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:55:02.338675    4638 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:55:02.338682    4638 cache.go:56] Caching tarball of preloaded images
	I1122 10:55:02.338745    4638 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:55:02.338750    4638 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:55:02.338833    4638 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/embed-certs-958000/config.json ...
	I1122 10:55:02.338845    4638 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/embed-certs-958000/config.json: {Name:mkca947b7128284a838c9411c042fe0fd37fcadc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:55:02.339065    4638 start.go:365] acquiring machines lock for embed-certs-958000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:03.987515    4638 start.go:369] acquired machines lock for "embed-certs-958000" in 1.648416167s
	I1122 10:55:03.987685    4638 start.go:93] Provisioning new machine with config: &{Name:embed-certs-958000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-958000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mount
MSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:55:03.987929    4638 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:55:03.998339    4638 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:55:04.046023    4638 start.go:159] libmachine.API.Create for "embed-certs-958000" (driver="qemu2")
	I1122 10:55:04.046076    4638 client.go:168] LocalClient.Create starting
	I1122 10:55:04.046221    4638 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:55:04.046282    4638 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:04.046301    4638 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:04.046369    4638 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:55:04.046410    4638 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:04.046423    4638 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:04.047052    4638 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:55:04.249081    4638 main.go:141] libmachine: Creating SSH key...
	I1122 10:55:04.377932    4638 main.go:141] libmachine: Creating Disk image...
	I1122 10:55:04.377940    4638 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:55:04.378121    4638 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:04.390219    4638 main.go:141] libmachine: STDOUT: 
	I1122 10:55:04.390252    4638 main.go:141] libmachine: STDERR: 
	I1122 10:55:04.390324    4638 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2 +20000M
	I1122 10:55:04.406737    4638 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:55:04.406755    4638 main.go:141] libmachine: STDERR: 
	I1122 10:55:04.406778    4638 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:04.406784    4638 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:55:04.406810    4638 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:48:99:b3:0c:24 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:04.408506    4638 main.go:141] libmachine: STDOUT: 
	I1122 10:55:04.408521    4638 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:04.408538    4638 client.go:171] LocalClient.Create took 362.4585ms
	I1122 10:55:06.410707    4638 start.go:128] duration metric: createHost completed in 2.422788542s
	I1122 10:55:06.410770    4638 start.go:83] releasing machines lock for "embed-certs-958000", held for 2.423238334s
	W1122 10:55:06.410973    4638 start.go:691] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:06.425344    4638 out.go:177] * Deleting "embed-certs-958000" in qemu2 ...
	W1122 10:55:06.454605    4638 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:06.454637    4638 start.go:706] Will try again in 5 seconds ...
	I1122 10:55:11.455387    4638 start.go:365] acquiring machines lock for embed-certs-958000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:11.465213    4638 start.go:369] acquired machines lock for "embed-certs-958000" in 9.7125ms
	I1122 10:55:11.465266    4638 start.go:93] Provisioning new machine with config: &{Name:embed-certs-958000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-958000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mount
MSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1122 10:55:11.465485    4638 start.go:125] createHost starting for "" (driver="qemu2")
	I1122 10:55:11.474940    4638 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1122 10:55:11.520510    4638 start.go:159] libmachine.API.Create for "embed-certs-958000" (driver="qemu2")
	I1122 10:55:11.520558    4638 client.go:168] LocalClient.Create starting
	I1122 10:55:11.520716    4638 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/ca.pem
	I1122 10:55:11.520786    4638 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:11.520801    4638 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:11.520847    4638 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17658-941/.minikube/certs/cert.pem
	I1122 10:55:11.520888    4638 main.go:141] libmachine: Decoding PEM data...
	I1122 10:55:11.520903    4638 main.go:141] libmachine: Parsing certificate...
	I1122 10:55:11.521438    4638 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/17658-941/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso...
	I1122 10:55:11.688082    4638 main.go:141] libmachine: Creating SSH key...
	I1122 10:55:11.757997    4638 main.go:141] libmachine: Creating Disk image...
	I1122 10:55:11.758011    4638 main.go:141] libmachine: Creating 20000 MB hard disk image...
	I1122 10:55:11.758204    4638 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2.raw /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:11.771660    4638 main.go:141] libmachine: STDOUT: 
	I1122 10:55:11.771680    4638 main.go:141] libmachine: STDERR: 
	I1122 10:55:11.771741    4638 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2 +20000M
	I1122 10:55:11.783618    4638 main.go:141] libmachine: STDOUT: Image resized.
	
	I1122 10:55:11.783641    4638 main.go:141] libmachine: STDERR: 
	I1122 10:55:11.783655    4638 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2.raw and /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:11.783662    4638 main.go:141] libmachine: Starting QEMU VM...
	I1122 10:55:11.783698    4638 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:7c:08:a9:36:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:11.785651    4638 main.go:141] libmachine: STDOUT: 
	I1122 10:55:11.785667    4638 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:11.785683    4638 client.go:171] LocalClient.Create took 265.124709ms
	I1122 10:55:13.787927    4638 start.go:128] duration metric: createHost completed in 2.3224135s
	I1122 10:55:13.788011    4638 start.go:83] releasing machines lock for "embed-certs-958000", held for 2.322816083s
	W1122 10:55:13.788444    4638 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-958000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-958000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:13.799121    4638 out.go:177] 
	W1122 10:55:13.803221    4638 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:13.803262    4638 out.go:239] * 
	* 
	W1122 10:55:13.805993    4638 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:55:13.816987    4638 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (70.272ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (11.68s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (7.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (7.156589958s)

                                                
                                                
-- stdout --
	* [newest-cni-496000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node newest-cni-496000 in cluster newest-cni-496000
	* Restarting existing qemu2 VM for "newest-cni-496000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "newest-cni-496000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:04.373392    4655 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:04.373553    4655 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:04.373555    4655 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:04.373565    4655 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:04.373708    4655 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:04.374734    4655 out.go:303] Setting JSON to false
	I1122 10:55:04.391460    4655 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1474,"bootTime":1700677830,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:55:04.391574    4655 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:55:04.396286    4655 out.go:177] * [newest-cni-496000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:55:04.409230    4655 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:55:04.405279    4655 notify.go:220] Checking for updates...
	I1122 10:55:04.415661    4655 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:55:04.420263    4655 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:55:04.423247    4655 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:55:04.424675    4655 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:55:04.428253    4655 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:55:04.431598    4655 config.go:182] Loaded profile config "newest-cni-496000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:04.431851    4655 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:55:04.436074    4655 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:55:04.443230    4655 start.go:298] selected driver: qemu2
	I1122 10:55:04.443237    4655 start.go:902] validating driver "qemu2" against &{Name:newest-cni-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:newest-cni-496000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<n
il> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:55:04.443287    4655 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:55:04.445568    4655 start_flags.go:950] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1122 10:55:04.445613    4655 cni.go:84] Creating CNI manager for ""
	I1122 10:55:04.445621    4655 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:55:04.445625    4655 start_flags.go:323] config:
	{Name:newest-cni-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:newest-cni-496000 Namespace:default A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeReques
ted:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:55:04.449730    4655 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:55:04.458267    4655 out.go:177] * Starting control plane node newest-cni-496000 in cluster newest-cni-496000
	I1122 10:55:04.462291    4655 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:55:04.462304    4655 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:55:04.462311    4655 cache.go:56] Caching tarball of preloaded images
	I1122 10:55:04.462356    4655 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:55:04.462361    4655 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:55:04.462422    4655 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/newest-cni-496000/config.json ...
	I1122 10:55:04.462916    4655 start.go:365] acquiring machines lock for newest-cni-496000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:06.410935    4655 start.go:369] acquired machines lock for "newest-cni-496000" in 1.947994458s
	I1122 10:55:06.411131    4655 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:55:06.411180    4655 fix.go:54] fixHost starting: 
	I1122 10:55:06.411832    4655 fix.go:102] recreateIfNeeded on newest-cni-496000: state=Stopped err=<nil>
	W1122 10:55:06.411880    4655 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:55:06.417195    4655 out.go:177] * Restarting existing qemu2 VM for "newest-cni-496000" ...
	I1122 10:55:06.429522    4655 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:37:d0:83:cd:d2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:55:06.440599    4655 main.go:141] libmachine: STDOUT: 
	I1122 10:55:06.440689    4655 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:06.440810    4655 fix.go:56] fixHost completed within 29.64125ms
	I1122 10:55:06.440824    4655 start.go:83] releasing machines lock for "newest-cni-496000", held for 29.85875ms
	W1122 10:55:06.440851    4655 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:06.441031    4655 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:06.441048    4655 start.go:706] Will try again in 5 seconds ...
	I1122 10:55:11.443233    4655 start.go:365] acquiring machines lock for newest-cni-496000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:11.443610    4655 start.go:369] acquired machines lock for "newest-cni-496000" in 263.708µs
	I1122 10:55:11.443724    4655 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:55:11.443746    4655 fix.go:54] fixHost starting: 
	I1122 10:55:11.444486    4655 fix.go:102] recreateIfNeeded on newest-cni-496000: state=Stopped err=<nil>
	W1122 10:55:11.444512    4655 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:55:11.450082    4655 out.go:177] * Restarting existing qemu2 VM for "newest-cni-496000" ...
	I1122 10:55:11.455176    4655 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:37:d0:83:cd:d2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/newest-cni-496000/disk.qcow2
	I1122 10:55:11.464935    4655 main.go:141] libmachine: STDOUT: 
	I1122 10:55:11.464990    4655 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:11.465116    4655 fix.go:56] fixHost completed within 21.365833ms
	I1122 10:55:11.465129    4655 start.go:83] releasing machines lock for "newest-cni-496000", held for 21.499166ms
	W1122 10:55:11.465335    4655 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p newest-cni-496000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p newest-cni-496000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:11.474940    4655 out.go:177] 
	W1122 10:55:11.479097    4655 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:11.479163    4655 out.go:239] * 
	* 
	W1122 10:55:11.481775    4655 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:55:11.490057    4655 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p newest-cni-496000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (53.260375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (7.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 ssh -p newest-cni-496000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p newest-cni-496000 "sudo crictl images -o json": exit status 89 (60.705209ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p newest-cni-496000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-arm64 ssh -p newest-cni-496000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p newest-cni-496000"
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (35.328ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.10s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p newest-cni-496000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p newest-cni-496000 --alsologtostderr -v=1: exit status 89 (60.109375ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p newest-cni-496000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:11.685413    4673 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:11.685614    4673 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:11.685617    4673 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:11.685620    4673 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:11.685766    4673 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:11.686011    4673 out.go:303] Setting JSON to false
	I1122 10:55:11.686022    4673 mustload.go:65] Loading cluster: newest-cni-496000
	I1122 10:55:11.686246    4673 config.go:182] Loaded profile config "newest-cni-496000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:11.703018    4673 out.go:177] * The control plane node must be running for this command
	I1122 10:55:11.707046    4673 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-496000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p newest-cni-496000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (32.444375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-496000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (32.092042ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.13s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-958000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-958000 create -f testdata/busybox.yaml: exit status 1 (27.523ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-958000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (31.061666ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (30.606ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p embed-certs-958000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-958000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-958000 describe deploy/metrics-server -n kube-system: exit status 1 (25.831959ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-958000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-958000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (31.700417ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.12s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (5.26s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4: exit status 80 (5.18945325s)

                                                
                                                
-- stdout --
	* [embed-certs-958000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	* Starting control plane node embed-certs-958000 in cluster embed-certs-958000
	* Restarting existing qemu2 VM for "embed-certs-958000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	* Restarting existing qemu2 VM for "embed-certs-958000" ...
	OUTPUT: 
	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:14.305518    4719 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:14.305679    4719 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:14.305682    4719 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:14.305685    4719 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:14.305822    4719 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:14.306829    4719 out.go:303] Setting JSON to false
	I1122 10:55:14.322852    4719 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1484,"bootTime":1700677830,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:55:14.322930    4719 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:55:14.327646    4719 out.go:177] * [embed-certs-958000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:55:14.334757    4719 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:55:14.334805    4719 notify.go:220] Checking for updates...
	I1122 10:55:14.338680    4719 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:55:14.342661    4719 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:55:14.345700    4719 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:55:14.348658    4719 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:55:14.351655    4719 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:55:14.354958    4719 config.go:182] Loaded profile config "embed-certs-958000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:14.355212    4719 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:55:14.358673    4719 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:55:14.365684    4719 start.go:298] selected driver: qemu2
	I1122 10:55:14.365690    4719 start.go:902] validating driver "qemu2" against &{Name:embed-certs-958000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-958000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested
:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:55:14.365741    4719 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:55:14.368007    4719 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1122 10:55:14.368055    4719 cni.go:84] Creating CNI manager for ""
	I1122 10:55:14.368063    4719 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:55:14.368071    4719 start_flags.go:323] config:
	{Name:embed-certs-958000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-958000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:55:14.372286    4719 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:55:14.379637    4719 out.go:177] * Starting control plane node embed-certs-958000 in cluster embed-certs-958000
	I1122 10:55:14.383696    4719 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:55:14.383711    4719 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:55:14.383724    4719 cache.go:56] Caching tarball of preloaded images
	I1122 10:55:14.383785    4719 preload.go:174] Found /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I1122 10:55:14.383791    4719 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:55:14.383855    4719 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/embed-certs-958000/config.json ...
	I1122 10:55:14.384407    4719 start.go:365] acquiring machines lock for embed-certs-958000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:14.384439    4719 start.go:369] acquired machines lock for "embed-certs-958000" in 26.375µs
	I1122 10:55:14.384448    4719 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:55:14.384454    4719 fix.go:54] fixHost starting: 
	I1122 10:55:14.384572    4719 fix.go:102] recreateIfNeeded on embed-certs-958000: state=Stopped err=<nil>
	W1122 10:55:14.384580    4719 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:55:14.393692    4719 out.go:177] * Restarting existing qemu2 VM for "embed-certs-958000" ...
	I1122 10:55:14.397718    4719 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:7c:08:a9:36:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:14.399831    4719 main.go:141] libmachine: STDOUT: 
	I1122 10:55:14.399853    4719 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:14.399895    4719 fix.go:56] fixHost completed within 15.431042ms
	I1122 10:55:14.399900    4719 start.go:83] releasing machines lock for "embed-certs-958000", held for 15.45625ms
	W1122 10:55:14.399907    4719 start.go:691] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:14.399957    4719 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:14.399962    4719 start.go:706] Will try again in 5 seconds ...
	I1122 10:55:19.402131    4719 start.go:365] acquiring machines lock for embed-certs-958000: {Name:mk85735a2b261d3e7727409fa308f7c4451a8604 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1122 10:55:19.402542    4719 start.go:369] acquired machines lock for "embed-certs-958000" in 290.417µs
	I1122 10:55:19.402671    4719 start.go:96] Skipping create...Using existing machine configuration
	I1122 10:55:19.402692    4719 fix.go:54] fixHost starting: 
	I1122 10:55:19.403493    4719 fix.go:102] recreateIfNeeded on embed-certs-958000: state=Stopped err=<nil>
	W1122 10:55:19.403521    4719 fix.go:128] unexpected machine state, will restart: <nil>
	I1122 10:55:19.411950    4719 out.go:177] * Restarting existing qemu2 VM for "embed-certs-958000" ...
	I1122 10:55:19.417124    4719 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:7c:08:a9:36:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/17658-941/.minikube/machines/embed-certs-958000/disk.qcow2
	I1122 10:55:19.427046    4719 main.go:141] libmachine: STDOUT: 
	I1122 10:55:19.427115    4719 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused
	
	I1122 10:55:19.427196    4719 fix.go:56] fixHost completed within 24.504042ms
	I1122 10:55:19.427213    4719 start.go:83] releasing machines lock for "embed-certs-958000", held for 24.644625ms
	W1122 10:55:19.427372    4719 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p embed-certs-958000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	* Failed to start qemu2 VM. Running "minikube delete -p embed-certs-958000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	I1122 10:55:19.433882    4719 out.go:177] 
	W1122 10:55:19.438001    4719 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1
	W1122 10:55:19.438024    4719 out.go:239] * 
	* 
	W1122 10:55:19.440661    4719 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:55:19.449903    4719 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-arm64 start -p embed-certs-958000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=qemu2  --kubernetes-version=v1.28.4": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (69.790125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (5.26s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-958000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (34.433791ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-958000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-958000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-958000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (25.728917ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-958000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-958000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (32.46975ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-arm64 ssh -p embed-certs-958000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p embed-certs-958000 "sudo crictl images -o json": exit status 89 (42.664333ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p embed-certs-958000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-arm64 ssh -p embed-certs-958000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p embed-certs-958000"
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (32.135542ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.08s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-arm64 pause -p embed-certs-958000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p embed-certs-958000 --alsologtostderr -v=1: exit status 89 (44.295958ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p embed-certs-958000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:55:19.734727    4740 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:55:19.734902    4740 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:19.734905    4740 out.go:309] Setting ErrFile to fd 2...
	I1122 10:55:19.734908    4740 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:55:19.735040    4740 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:55:19.735281    4740 out.go:303] Setting JSON to false
	I1122 10:55:19.735289    4740 mustload.go:65] Loading cluster: embed-certs-958000
	I1122 10:55:19.735508    4740 config.go:182] Loaded profile config "embed-certs-958000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:55:19.739928    4740 out.go:177] * The control plane node must be running for this command
	I1122 10:55:19.744095    4740 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-958000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-arm64 pause -p embed-certs-958000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (31.656458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (32.105625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-958000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.11s)

                                                
                                    

Test pass (141/254)

Order passed test Duration
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.1
10 TestDownloadOnly/v1.28.4/json-events 41.69
11 TestDownloadOnly/v1.28.4/preload-exists 0
14 TestDownloadOnly/v1.28.4/kubectl 0
15 TestDownloadOnly/v1.28.4/LogsDuration 0.08
16 TestDownloadOnly/DeleteAll 0.23
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.23
19 TestBinaryMirror 0.35
23 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.06
24 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.06
25 TestAddons/Setup 125.74
27 TestAddons/parallel/Registry 14.05
29 TestAddons/parallel/InspektorGadget 10.22
30 TestAddons/parallel/MetricsServer 5.33
33 TestAddons/parallel/CSI 53.78
34 TestAddons/parallel/Headlamp 11.56
35 TestAddons/parallel/CloudSpanner 5.17
36 TestAddons/parallel/LocalPath 39.92
37 TestAddons/parallel/NvidiaDevicePlugin 5.16
40 TestAddons/serial/GCPAuth/Namespaces 0.07
41 TestAddons/StoppedEnableDisable 12.29
49 TestHyperKitDriverInstallOrUpdate 8.23
52 TestErrorSpam/setup 30.9
53 TestErrorSpam/start 0.36
54 TestErrorSpam/status 0.26
55 TestErrorSpam/pause 0.67
56 TestErrorSpam/unpause 0.58
57 TestErrorSpam/stop 3.24
60 TestFunctional/serial/CopySyncFile 0
61 TestFunctional/serial/StartWithProxy 46.15
62 TestFunctional/serial/AuditLog 0
63 TestFunctional/serial/SoftStart 35.28
64 TestFunctional/serial/KubeContext 0.03
65 TestFunctional/serial/KubectlGetPods 0.05
68 TestFunctional/serial/CacheCmd/cache/add_remote 2.55
69 TestFunctional/serial/CacheCmd/cache/add_local 1.16
70 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.04
71 TestFunctional/serial/CacheCmd/cache/list 0.04
72 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.08
73 TestFunctional/serial/CacheCmd/cache/cache_reload 0.7
74 TestFunctional/serial/CacheCmd/cache/delete 0.08
75 TestFunctional/serial/MinikubeKubectlCmd 0.42
76 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.59
77 TestFunctional/serial/ExtraConfig 36.21
78 TestFunctional/serial/ComponentHealth 0.04
79 TestFunctional/serial/LogsCmd 0.65
80 TestFunctional/serial/LogsFileCmd 0.66
81 TestFunctional/serial/InvalidService 3.98
83 TestFunctional/parallel/ConfigCmd 0.23
84 TestFunctional/parallel/DashboardCmd 6.36
85 TestFunctional/parallel/DryRun 0.26
86 TestFunctional/parallel/InternationalLanguage 0.12
87 TestFunctional/parallel/StatusCmd 0.25
92 TestFunctional/parallel/AddonsCmd 0.12
93 TestFunctional/parallel/PersistentVolumeClaim 23.31
95 TestFunctional/parallel/SSHCmd 0.13
96 TestFunctional/parallel/CpCmd 0.29
98 TestFunctional/parallel/FileSync 0.08
99 TestFunctional/parallel/CertSync 0.42
103 TestFunctional/parallel/NodeLabels 0.04
105 TestFunctional/parallel/NonActiveRuntimeDisabled 0.06
107 TestFunctional/parallel/License 0.33
108 TestFunctional/parallel/Version/short 0.04
109 TestFunctional/parallel/Version/components 0.18
110 TestFunctional/parallel/ImageCommands/ImageListShort 0.07
111 TestFunctional/parallel/ImageCommands/ImageListTable 0.07
112 TestFunctional/parallel/ImageCommands/ImageListJson 0.07
113 TestFunctional/parallel/ImageCommands/ImageListYaml 0.08
114 TestFunctional/parallel/ImageCommands/ImageBuild 1.98
115 TestFunctional/parallel/ImageCommands/Setup 1.54
116 TestFunctional/parallel/DockerEnv/bash 0.38
117 TestFunctional/parallel/UpdateContextCmd/no_changes 0.05
118 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.06
119 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.06
120 TestFunctional/parallel/ServiceCmd/DeployApp 17.1
121 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 2.13
122 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.49
123 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 3.44
124 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.54
125 TestFunctional/parallel/ImageCommands/ImageRemove 0.16
126 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.61
127 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.64
129 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 1.34
130 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.01
132 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 9.12
133 TestFunctional/parallel/ServiceCmd/List 0.09
134 TestFunctional/parallel/ServiceCmd/JSONOutput 0.09
135 TestFunctional/parallel/ServiceCmd/HTTPS 0.1
136 TestFunctional/parallel/ServiceCmd/Format 0.1
137 TestFunctional/parallel/ServiceCmd/URL 0.1
138 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.04
139 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0.01
140 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 0.02
141 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 0.02
142 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 0.01
143 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.12
144 TestFunctional/parallel/ProfileCmd/profile_not_create 0.19
145 TestFunctional/parallel/ProfileCmd/profile_list 0.15
146 TestFunctional/parallel/ProfileCmd/profile_json_output 0.15
147 TestFunctional/parallel/MountCmd/any-port 5.12
148 TestFunctional/parallel/MountCmd/specific-port 1.03
149 TestFunctional/parallel/MountCmd/VerifyCleanup 1.05
150 TestFunctional/delete_addon-resizer_images 0.12
151 TestFunctional/delete_my-image_image 0.04
152 TestFunctional/delete_minikube_cached_images 0.04
161 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.05
166 TestJSONOutput/start/Audit 0
168 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
169 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
172 TestJSONOutput/pause/Audit 0
174 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
175 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
178 TestJSONOutput/unpause/Audit 0
180 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
181 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
183 TestJSONOutput/stop/Command 0.05
184 TestJSONOutput/stop/Audit 0
186 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
188 TestErrorJSONOutput 0.33
193 TestMainNoArgs 0.04
250 TestNoKubernetes/serial/StartNoK8sWithVersion 0.1
254 TestNoKubernetes/serial/VerifyK8sNotRunning 0.05
255 TestNoKubernetes/serial/ProfileList 0.15
256 TestNoKubernetes/serial/Stop 0.06
258 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.04
276 TestStartStop/group/old-k8s-version/serial/Stop 0.08
277 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.11
287 TestStartStop/group/no-preload/serial/Stop 0.07
288 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.1
298 TestStartStop/group/default-k8s-diff-port/serial/Stop 0.07
299 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.1
307 TestStartStop/group/newest-cni/serial/DeployApp 0
308 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.08
309 TestStartStop/group/newest-cni/serial/Stop 0.08
310 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.1
312 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
313 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
318 TestStartStop/group/embed-certs/serial/Stop 0.06
319 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.1
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.1s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-183000
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-183000: exit status 85 (95.059167ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:35 PST |          |
	|         | -p download-only-183000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=qemu2                 |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/22 10:35:51
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.21.4 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1122 10:35:51.424526    1440 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:35:51.424722    1440 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:35:51.424726    1440 out.go:309] Setting ErrFile to fd 2...
	I1122 10:35:51.424728    1440 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:35:51.424864    1440 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	W1122 10:35:51.424949    1440 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: no such file or directory
	I1122 10:35:51.426147    1440 out.go:303] Setting JSON to true
	I1122 10:35:51.443060    1440 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":321,"bootTime":1700677830,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:35:51.443136    1440 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:35:51.452134    1440 out.go:97] [download-only-183000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:35:51.456049    1440 out.go:169] MINIKUBE_LOCATION=17658
	I1122 10:35:51.452276    1440 notify.go:220] Checking for updates...
	W1122 10:35:51.452320    1440 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball: no such file or directory
	I1122 10:35:51.466054    1440 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:35:51.470120    1440 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:35:51.474074    1440 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:35:51.478066    1440 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	W1122 10:35:51.484064    1440 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1122 10:35:51.484292    1440 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:35:51.489968    1440 out.go:97] Using the qemu2 driver based on user configuration
	I1122 10:35:51.489977    1440 start.go:298] selected driver: qemu2
	I1122 10:35:51.489980    1440 start.go:902] validating driver "qemu2" against <nil>
	I1122 10:35:51.490064    1440 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1122 10:35:51.494022    1440 out.go:169] Automatically selected the socket_vmnet network
	I1122 10:35:51.500936    1440 start_flags.go:394] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB
	I1122 10:35:51.501020    1440 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I1122 10:35:51.501128    1440 cni.go:84] Creating CNI manager for ""
	I1122 10:35:51.501145    1440 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1122 10:35:51.501152    1440 start_flags.go:323] config:
	{Name:download-only-183000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-183000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:35:51.506782    1440 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:35:51.511014    1440 out.go:97] Downloading VM boot image ...
	I1122 10:35:51.511032    1440 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/iso/arm64/minikube-v1.32.1-1700142131-17634-arm64.iso
	I1122 10:35:59.315555    1440 out.go:97] Starting control plane node download-only-183000 in cluster download-only-183000
	I1122 10:35:59.315573    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:35:59.373387    1440 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:35:59.373396    1440 cache.go:56] Caching tarball of preloaded images
	I1122 10:35:59.373532    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:35:59.378680    1440 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I1122 10:35:59.378687    1440 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:35:59.454201    1440 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I1122 10:36:08.360678    1440 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:08.360822    1440 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:09.001849    1440 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1122 10:36:09.002049    1440 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/download-only-183000/config.json ...
	I1122 10:36:09.002065    1440 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/download-only-183000/config.json: {Name:mk51ce9bef7aa2af158da6d000f5447dbbce4d81 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1122 10:36:09.002275    1440 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1122 10:36:09.002439    1440 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl
	I1122 10:36:09.860132    1440 out.go:169] 
	W1122 10:36:09.864257    1440 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80 0x108d80a80] Decompressors:map[bz2:0x14000918ea0 gz:0x14000918ea8 tar:0x14000918e50 tar.bz2:0x14000918e60 tar.gz:0x14000918e70 tar.xz:0x14000918e80 tar.zst:0x14000918e90 tbz2:0x14000918e60 tgz:0x14000918e70 txz:0x14000918e80 tzst:0x14000918e90 xz:0x14000918ed0 zip:0x14000918ee0 zst:0x14000918ed8] Getters:map[file:0x1400080c8a0 http:0x1400017e550 https:0x1400017e5a0] Dir:false ProgressListener:
<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404
	W1122 10:36:09.864284    1440 out_reason.go:110] 
	W1122 10:36:09.872211    1440 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1122 10:36:09.876209    1440 out.go:169] 
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-183000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.10s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (41.69s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-183000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=qemu2 
aaa_download_only_test.go:69: (dbg) Done: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-183000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=qemu2 : (41.693217583s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (41.69s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
--- PASS: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-darwin-arm64 logs -p download-only-183000
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-darwin-arm64 logs -p download-only-183000: exit status 85 (78.74875ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:35 PST |          |
	|         | -p download-only-183000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=qemu2                 |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-183000 | jenkins | v1.32.0 | 22 Nov 23 10:36 PST |          |
	|         | -p download-only-183000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=qemu2                 |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/11/22 10:36:10
	Running on machine: MacOS-M1-Agent-1
	Binary: Built with gc go1.21.4 for darwin/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1122 10:36:10.062868    1468 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:36:10.063005    1468 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:36:10.063008    1468 out.go:309] Setting ErrFile to fd 2...
	I1122 10:36:10.063011    1468 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:36:10.063125    1468 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	W1122 10:36:10.063185    1468 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17658-941/.minikube/config/config.json: no such file or directory
	I1122 10:36:10.064135    1468 out.go:303] Setting JSON to true
	I1122 10:36:10.080030    1468 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":340,"bootTime":1700677830,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:36:10.080109    1468 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:36:10.084723    1468 out.go:97] [download-only-183000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:36:10.087777    1468 out.go:169] MINIKUBE_LOCATION=17658
	I1122 10:36:10.084854    1468 notify.go:220] Checking for updates...
	I1122 10:36:10.095712    1468 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:36:10.133828    1468 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:36:10.141766    1468 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:36:10.149736    1468 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	W1122 10:36:10.156748    1468 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1122 10:36:10.157085    1468 config.go:182] Loaded profile config "download-only-183000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W1122 10:36:10.157126    1468 start.go:810] api.Load failed for download-only-183000: filestore "download-only-183000": Docker machine "download-only-183000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1122 10:36:10.157182    1468 driver.go:378] Setting default libvirt URI to qemu:///system
	W1122 10:36:10.157202    1468 start.go:810] api.Load failed for download-only-183000: filestore "download-only-183000": Docker machine "download-only-183000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1122 10:36:10.161744    1468 out.go:97] Using the qemu2 driver based on existing profile
	I1122 10:36:10.161752    1468 start.go:298] selected driver: qemu2
	I1122 10:36:10.161759    1468 start.go:902] validating driver "qemu2" against &{Name:download-only-183000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-183000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binar
yMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:36:10.164466    1468 cni.go:84] Creating CNI manager for ""
	I1122 10:36:10.164483    1468 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1122 10:36:10.164491    1468 start_flags.go:323] config:
	{Name:download-only-183000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-183000 Namespace:def
ault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath
: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:36:10.169396    1468 iso.go:125] acquiring lock: {Name:mk1223c4c7245b4c90cf73a815a1c76497db66ce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1122 10:36:10.173649    1468 out.go:97] Starting control plane node download-only-183000 in cluster download-only-183000
	I1122 10:36:10.173661    1468 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:36:10.227029    1468 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:36:10.227060    1468 cache.go:56] Caching tarball of preloaded images
	I1122 10:36:10.227284    1468 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:36:10.232516    1468 out.go:97] Downloading Kubernetes v1.28.4 preload ...
	I1122 10:36:10.232527    1468 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:10.314320    1468 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4?checksum=md5:6fb922d1d9dc01a9d3c0b965ed219613 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4
	I1122 10:36:17.309172    1468 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:17.309319    1468 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17658-941/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-arm64.tar.lz4 ...
	I1122 10:36:17.889759    1468 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker
	I1122 10:36:17.889828    1468 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/download-only-183000/config.json ...
	I1122 10:36:17.890090    1468 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I1122 10:36:17.890236    1468 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17658-941/.minikube/cache/darwin/arm64/v1.28.4/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-183000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:190: (dbg) Run:  out/minikube-darwin-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.23s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:202: (dbg) Run:  out/minikube-darwin-arm64 delete -p download-only-183000
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.23s)

                                                
                                    
x
+
TestBinaryMirror (0.35s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:307: (dbg) Run:  out/minikube-darwin-arm64 start --download-only -p binary-mirror-708000 --alsologtostderr --binary-mirror http://127.0.0.1:49313 --driver=qemu2 
helpers_test.go:175: Cleaning up "binary-mirror-708000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p binary-mirror-708000
--- PASS: TestBinaryMirror (0.35s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:927: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p addons-024000
addons_test.go:927: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons enable dashboard -p addons-024000: exit status 85 (61.134417ms)

                                                
                                                
-- stdout --
	* Profile "addons-024000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-024000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:938: (dbg) Run:  out/minikube-darwin-arm64 addons disable dashboard -p addons-024000
addons_test.go:938: (dbg) Non-zero exit: out/minikube-darwin-arm64 addons disable dashboard -p addons-024000: exit status 85 (57.165542ms)

                                                
                                                
-- stdout --
	* Profile "addons-024000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-024000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)

                                                
                                    
x
+
TestAddons/Setup (125.74s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-arm64 start -p addons-024000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=qemu2  --addons=ingress --addons=ingress-dns
addons_test.go:109: (dbg) Done: out/minikube-darwin-arm64 start -p addons-024000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=qemu2  --addons=ingress --addons=ingress-dns: (2m5.740913166s)
--- PASS: TestAddons/Setup (125.74s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.05s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:329: registry stabilized in 7.270541ms
addons_test.go:331: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-cgcwp" [3cf4bb31-30c7-487a-ac73-f369cfd3dd18] Running
addons_test.go:331: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.010318583s
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-d46zm" [ffcad2ec-3d5f-4431-b99f-fd620adb6eea] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.007714584s
addons_test.go:339: (dbg) Run:  kubectl --context addons-024000 delete po -l run=registry-test --now
addons_test.go:344: (dbg) Run:  kubectl --context addons-024000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:344: (dbg) Done: kubectl --context addons-024000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.679608292s)
addons_test.go:358: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 ip
2023/11/22 10:39:12 [DEBUG] GET http://192.168.105.2:5000
addons_test.go:387: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.05s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.22s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-5bb5b" [b975d9a8-2e55-4bf0-b23f-b7e7e11db923] Running
addons_test.go:837: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.006569125s
addons_test.go:840: (dbg) Run:  out/minikube-darwin-arm64 addons disable inspektor-gadget -p addons-024000
addons_test.go:840: (dbg) Done: out/minikube-darwin-arm64 addons disable inspektor-gadget -p addons-024000: (5.211267375s)
--- PASS: TestAddons/parallel/InspektorGadget (10.22s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.33s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:406: metrics-server stabilized in 1.9315ms
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7c66d45ddc-89rpj" [8416ab4d-98f1-4bc6-a944-a26a2f22a4e6] Running
addons_test.go:408: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.007777375s
addons_test.go:414: (dbg) Run:  kubectl --context addons-024000 top pods -n kube-system
addons_test.go:431: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.33s)

                                                
                                    
x
+
TestAddons/parallel/CSI (53.78s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:560: csi-hostpath-driver pods stabilized in 8.082917ms
addons_test.go:563: (dbg) Run:  kubectl --context addons-024000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:568: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:573: (dbg) Run:  kubectl --context addons-024000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:578: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [3584a7e7-79a7-4d8a-9402-6ce864d30a99] Pending
helpers_test.go:344: "task-pv-pod" [3584a7e7-79a7-4d8a-9402-6ce864d30a99] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [3584a7e7-79a7-4d8a-9402-6ce864d30a99] Running
addons_test.go:578: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 13.005776334s
addons_test.go:583: (dbg) Run:  kubectl --context addons-024000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:588: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-024000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:427: TestAddons/parallel/CSI: WARNING: volume snapshot get for "default" "new-snapshot-demo" returned: 
helpers_test.go:419: (dbg) Run:  kubectl --context addons-024000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-024000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:593: (dbg) Run:  kubectl --context addons-024000 delete pod task-pv-pod
addons_test.go:599: (dbg) Run:  kubectl --context addons-024000 delete pvc hpvc
addons_test.go:605: (dbg) Run:  kubectl --context addons-024000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:610: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:615: (dbg) Run:  kubectl --context addons-024000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:620: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [4d83e591-7114-4089-818e-6584a2a8ae7a] Pending
helpers_test.go:344: "task-pv-pod-restore" [4d83e591-7114-4089-818e-6584a2a8ae7a] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [4d83e591-7114-4089-818e-6584a2a8ae7a] Running
addons_test.go:620: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.010654792s
addons_test.go:625: (dbg) Run:  kubectl --context addons-024000 delete pod task-pv-pod-restore
addons_test.go:629: (dbg) Run:  kubectl --context addons-024000 delete pvc hpvc-restore
addons_test.go:633: (dbg) Run:  kubectl --context addons-024000 delete volumesnapshot new-snapshot-demo
addons_test.go:637: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:637: (dbg) Done: out/minikube-darwin-arm64 -p addons-024000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.109107792s)
addons_test.go:641: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (53.78s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (11.56s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:823: (dbg) Run:  out/minikube-darwin-arm64 addons enable headlamp -p addons-024000 --alsologtostderr -v=1
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-777fd4b855-llj7s" [055ab76e-2060-415a-8357-9a5ea1512a45] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-777fd4b855-llj7s" [055ab76e-2060-415a-8357-9a5ea1512a45] Running
addons_test.go:828: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 11.00877875s
--- PASS: TestAddons/parallel/Headlamp (11.56s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.17s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-5649c69bf6-jtgm4" [43d88514-f4f6-42f2-8dd4-9e6efc832aa6] Running
addons_test.go:856: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.006725959s
addons_test.go:859: (dbg) Run:  out/minikube-darwin-arm64 addons disable cloud-spanner -p addons-024000
--- PASS: TestAddons/parallel/CloudSpanner (5.17s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (39.92s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:872: (dbg) Run:  kubectl --context addons-024000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:878: (dbg) Run:  kubectl --context addons-024000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:882: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [72449dcd-482e-4995-93cd-15ad7ba5ac9b] Pending
helpers_test.go:344: "test-local-path" [72449dcd-482e-4995-93cd-15ad7ba5ac9b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [72449dcd-482e-4995-93cd-15ad7ba5ac9b] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [72449dcd-482e-4995-93cd-15ad7ba5ac9b] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:885: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.005825292s
addons_test.go:890: (dbg) Run:  kubectl --context addons-024000 get pvc test-pvc -o=json
addons_test.go:899: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 ssh "cat /opt/local-path-provisioner/pvc-ab0c1180-d1bc-4ef7-abe0-4bb5895a3607_default_test-pvc/file1"
addons_test.go:911: (dbg) Run:  kubectl --context addons-024000 delete pod test-local-path
addons_test.go:915: (dbg) Run:  kubectl --context addons-024000 delete pvc test-pvc
addons_test.go:919: (dbg) Run:  out/minikube-darwin-arm64 -p addons-024000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:919: (dbg) Done: out/minikube-darwin-arm64 -p addons-024000 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (31.352491083s)
--- PASS: TestAddons/parallel/LocalPath (39.92s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.16s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-ckwws" [f778363d-23ff-4a02-ae33-ff69c57e17db] Running
addons_test.go:951: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.010385542s
addons_test.go:954: (dbg) Run:  out/minikube-darwin-arm64 addons disable nvidia-device-plugin -p addons-024000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.16s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.07s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:649: (dbg) Run:  kubectl --context addons-024000 create ns new-namespace
addons_test.go:663: (dbg) Run:  kubectl --context addons-024000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.07s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.29s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 stop -p addons-024000
addons_test.go:171: (dbg) Done: out/minikube-darwin-arm64 stop -p addons-024000: (12.094732083s)
addons_test.go:175: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p addons-024000
addons_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 addons disable dashboard -p addons-024000
addons_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 addons disable gvisor -p addons-024000
--- PASS: TestAddons/StoppedEnableDisable (12.29s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (8.23s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
--- PASS: TestHyperKitDriverInstallOrUpdate (8.23s)

                                                
                                    
x
+
TestErrorSpam/setup (30.9s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -p nospam-627000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 --driver=qemu2 
error_spam_test.go:81: (dbg) Done: out/minikube-darwin-arm64 start -p nospam-627000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 --driver=qemu2 : (30.896634583s)
--- PASS: TestErrorSpam/setup (30.90s)

                                                
                                    
x
+
TestErrorSpam/start (0.36s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 start --dry-run
--- PASS: TestErrorSpam/start (0.36s)

                                                
                                    
x
+
TestErrorSpam/status (0.26s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 status
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 status
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 status
--- PASS: TestErrorSpam/status (0.26s)

                                                
                                    
x
+
TestErrorSpam/pause (0.67s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 pause
--- PASS: TestErrorSpam/pause (0.67s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.58s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 unpause
--- PASS: TestErrorSpam/unpause (0.58s)

                                                
                                    
x
+
TestErrorSpam/stop (3.24s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 stop: (3.079112917s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-arm64 -p nospam-627000 --log_dir /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/nospam-627000 stop
--- PASS: TestErrorSpam/stop (3.24s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/17658-941/.minikube/files/etc/test/nested/copy/1438/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (46.15s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 
functional_test.go:2230: (dbg) Done: out/minikube-darwin-arm64 start -p functional-902000 --memory=4000 --apiserver-port=8441 --wait=all --driver=qemu2 : (46.145908083s)
--- PASS: TestFunctional/serial/StartWithProxy (46.15s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (35.28s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-darwin-arm64 start -p functional-902000 --alsologtostderr -v=8: (35.284102958s)
functional_test.go:659: soft start took 35.284511375s for "functional-902000" cluster.
--- PASS: TestFunctional/serial/SoftStart (35.28s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.03s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.03s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-902000 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (2.55s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.55s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.16s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalserialCacheCmdcacheadd_local2610949546/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache add minikube-local-cache-test:functional-902000
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache delete minikube-local-cache-test:functional-902000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-902000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.16s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.7s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (76.774708ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (0.70s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.08s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.42s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 kubectl -- --context functional-902000 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.42s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.59s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-902000 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.59s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (36.21s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-darwin-arm64 start -p functional-902000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (36.207354667s)
functional_test.go:757: restart took 36.207472584s for "functional-902000" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (36.21s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-902000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.04s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.65s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 logs
--- PASS: TestFunctional/serial/LogsCmd (0.65s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.66s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 logs --file /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalserialLogsFileCmd3926456057/001/logs.txt
--- PASS: TestFunctional/serial/LogsFileCmd (0.66s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (3.98s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-902000 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-darwin-arm64 service invalid-svc -p functional-902000
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-darwin-arm64 service invalid-svc -p functional-902000: exit status 115 (110.063125ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|----------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL             |
	|-----------|-------------|-------------|----------------------------|
	| default   | invalid-svc |          80 | http://192.168.105.4:31287 |
	|-----------|-------------|-------------|----------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                            │
	│    * If the above advice does not help, please let us know:                                                                │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                              │
	│                                                                                                                            │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                   │
	│    * Please also attach the following file to the GitHub issue:                                                            │
	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log    │
	│                                                                                                                            │
	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-902000 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.98s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 config get cpus: exit status 14 (35.633792ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 config get cpus: exit status 14 (32.607958ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (6.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-902000 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-darwin-arm64 dashboard --url --port 36195 -p functional-902000 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 2263: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (6.36s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-902000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (140.150708ms)

                                                
                                                
-- stdout --
	* [functional-902000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the qemu2 driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:44:46.528267    2239 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:44:46.528419    2239 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.528422    2239 out.go:309] Setting ErrFile to fd 2...
	I1122 10:44:46.528425    2239 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.528553    2239 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:44:46.529668    2239 out.go:303] Setting JSON to false
	I1122 10:44:46.549101    2239 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":856,"bootTime":1700677830,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:44:46.549213    2239 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:44:46.554876    2239 out.go:177] * [functional-902000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	I1122 10:44:46.563825    2239 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:44:46.567822    2239 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:44:46.563902    2239 notify.go:220] Checking for updates...
	I1122 10:44:46.575617    2239 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:44:46.582778    2239 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:44:46.590798    2239 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:44:46.594823    2239 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:44:46.598052    2239 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:44:46.598302    2239 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:44:46.602822    2239 out.go:177] * Using the qemu2 driver based on existing profile
	I1122 10:44:46.609774    2239 start.go:298] selected driver: qemu2
	I1122 10:44:46.609780    2239 start.go:902] validating driver "qemu2" against &{Name:functional-902000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:functional-902000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:44:46.609823    2239 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:44:46.616803    2239 out.go:177] 
	W1122 10:44:46.620819    2239 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1122 10:44:46.624796    2239 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --dry-run --alsologtostderr -v=1 --driver=qemu2 
--- PASS: TestFunctional/parallel/DryRun (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-arm64 start -p functional-902000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-902000 --dry-run --memory 250MB --alsologtostderr --driver=qemu2 : exit status 23 (115.8925ms)

                                                
                                                
-- stdout --
	* [functional-902000] minikube v1.32.0 sur Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote qemu2 basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1122 10:44:46.786814    2251 out.go:296] Setting OutFile to fd 1 ...
	I1122 10:44:46.786976    2251 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.786980    2251 out.go:309] Setting ErrFile to fd 2...
	I1122 10:44:46.786982    2251 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1122 10:44:46.787126    2251 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
	I1122 10:44:46.788471    2251 out.go:303] Setting JSON to false
	I1122 10:44:46.806802    2251 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":856,"bootTime":1700677830,"procs":452,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.1","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
	W1122 10:44:46.806894    2251 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1122 10:44:46.809900    2251 out.go:177] * [functional-902000] minikube v1.32.0 sur Darwin 14.1.1 (arm64)
	I1122 10:44:46.817245    2251 out.go:177]   - MINIKUBE_LOCATION=17658
	I1122 10:44:46.817372    2251 notify.go:220] Checking for updates...
	I1122 10:44:46.824735    2251 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	I1122 10:44:46.827795    2251 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64
	I1122 10:44:46.833770    2251 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1122 10:44:46.837768    2251 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	I1122 10:44:46.840821    2251 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1122 10:44:46.844066    2251 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I1122 10:44:46.844315    2251 driver.go:378] Setting default libvirt URI to qemu:///system
	I1122 10:44:46.848749    2251 out.go:177] * Utilisation du pilote qemu2 basé sur le profil existant
	I1122 10:44:46.854754    2251 start.go:298] selected driver: qemu2
	I1122 10:44:46.854761    2251 start.go:902] validating driver "qemu2" against &{Name:functional-902000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17634/minikube-v1.32.1-1700142131-17634-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1700142204-17634@sha256:b5ff7180d8eca5924b7e763cf222f5d9cfa39b21ab2c921f1394f3275e214b50 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.4 ClusterName:functional-902000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1122 10:44:46.854819    2251 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1122 10:44:46.861805    2251 out.go:177] 
	W1122 10:44:46.865845    2251 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1122 10:44:46.868808    2251 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 status
functional_test.go:856: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (23.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [e9d7e841-3a1c-4734-9dbd-82545744863f] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.006890083s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-902000 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-902000 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-902000 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-902000 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [3cb7bdd2-036d-4bcd-89e3-59c5cd225673] Pending
helpers_test.go:344: "sp-pod" [3cb7bdd2-036d-4bcd-89e3-59c5cd225673] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [3cb7bdd2-036d-4bcd-89e3-59c5cd225673] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 10.007524042s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-902000 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-902000 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-902000 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [273ed82a-42ee-4247-9f7b-e766e1546630] Pending
helpers_test.go:344: "sp-pod" [273ed82a-42ee-4247-9f7b-e766e1546630] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [273ed82a-42ee-4247-9f7b-e766e1546630] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.008751125s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-902000 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (23.31s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh -n functional-902000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 cp functional-902000:/home/docker/cp-test.txt /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelCpCmd873118131/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh -n functional-902000 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1438/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /etc/test/nested/copy/1438/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1438.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /etc/ssl/certs/1438.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1438.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /usr/share/ca-certificates/1438.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/14382.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /etc/ssl/certs/14382.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/14382.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /usr/share/ca-certificates/14382.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-902000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh "sudo systemctl is-active crio": exit status 1 (63.985542ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-arm64 license
--- PASS: TestFunctional/parallel/License (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-902000 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.4
registry.k8s.io/kube-proxy:v1.28.4
registry.k8s.io/kube-controller-manager:v1.28.4
registry.k8s.io/kube-apiserver:v1.28.4
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-902000
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-902000
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-902000 image ls --format short --alsologtostderr:
I1122 10:44:48.444262    2278 out.go:296] Setting OutFile to fd 1 ...
I1122 10:44:48.444430    2278 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:48.444433    2278 out.go:309] Setting ErrFile to fd 2...
I1122 10:44:48.444436    2278 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:48.444575    2278 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:44:48.445013    2278 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:48.445090    2278 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:48.445995    2278 ssh_runner.go:195] Run: systemctl --version
I1122 10:44:48.446004    2278 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/functional-902000/id_rsa Username:docker}
I1122 10:44:48.472129    2278 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-902000 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| registry.k8s.io/kube-apiserver              | v1.28.4           | 04b4c447bb9d4 | 120MB  |
| docker.io/library/nginx                     | alpine            | aae348c9fbd40 | 48.4MB |
| gcr.io/k8s-minikube/busybox                 | latest            | 71a676dd070f4 | 1.41MB |
| docker.io/library/minikube-local-cache-test | functional-902000 | 634c21439b225 | 30B    |
| registry.k8s.io/kube-scheduler              | v1.28.4           | 05c284c929889 | 57.8MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| gcr.io/google-containers/addon-resizer      | functional-902000 | ffd4cfbbe753e | 32.9MB |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
| docker.io/localhost/my-image                | functional-902000 | cc6b214d4a478 | 1.41MB |
| registry.k8s.io/kube-controller-manager     | v1.28.4           | 9961cbceaf234 | 116MB  |
| registry.k8s.io/kube-proxy                  | v1.28.4           | 3ca3ca488cf13 | 68.4MB |
| registry.k8s.io/etcd                        | 3.5.9-0           | 9cdd6470f48c8 | 181MB  |
| registry.k8s.io/coredns/coredns             | v1.10.1           | 97e04611ad434 | 51.4MB |
| registry.k8s.io/pause                       | 3.9               | 829e9de338bd5 | 514kB  |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
| docker.io/library/nginx                     | latest            | 5628e5ea3c17f | 192MB  |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-902000 image ls --format table --alsologtostderr:
I1122 10:44:50.647171    2294 out.go:296] Setting OutFile to fd 1 ...
I1122 10:44:50.647349    2294 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.647353    2294 out.go:309] Setting ErrFile to fd 2...
I1122 10:44:50.647356    2294 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.647486    2294 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:44:50.647990    2294 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.648054    2294 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.648961    2294 ssh_runner.go:195] Run: systemctl --version
I1122 10:44:50.648971    2294 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/functional-902000/id_rsa Username:docker}
I1122 10:44:50.674984    2294 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
2023/11/22 10:44:53 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-902000 image ls --format json --alsologtostderr:
[{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-902000"],"size":"32900000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.4"],"size":"120000000"},{"id":"9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.4"],"size":"116000000"},{"id":"3ca3ca488cf
13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.28.4"],"size":"68400000"},{"id":"71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:latest"],"size":"1410000"},{"id":"aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"48400000"},{"id":"9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"181000000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"},{"id":"634c21439b2255a0755fc4f3e2e78f6d4ce920f72faa1a1e5b75ede5b65ffed3","repoDigests":[],"repoTags":["docker.io/libr
ary/minikube-local-cache-test:functional-902000"],"size":"30"},{"id":"05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.4"],"size":"57800000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"cc6b214d4a4780504acdf649ba94aa56d4ce2f2b30379d4cb24377f627ba71d0","repoDigests":[],"repoTags":["docker.io/localhost/my-image:functional-902000"],"size":"1410000"},{"id":"5628e5ea3c17fa1cbf49692edf41d5a1cdf198922898e6ffb29c19768dca8fd3","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"51400000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-902000 image ls --format json --alsologtostderr:
I1122 10:44:50.572573    2292 out.go:296] Setting OutFile to fd 1 ...
I1122 10:44:50.572760    2292 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.572763    2292 out.go:309] Setting ErrFile to fd 2...
I1122 10:44:50.572766    2292 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.572903    2292 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:44:50.573333    2292 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.573394    2292 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.574358    2292 ssh_runner.go:195] Run: systemctl --version
I1122 10:44:50.574367    2292 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/functional-902000/id_rsa Username:docker}
I1122 10:44:50.599915    2292 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-902000 image ls --format yaml --alsologtostderr:
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: cc6b214d4a4780504acdf649ba94aa56d4ce2f2b30379d4cb24377f627ba71d0
repoDigests: []
repoTags:
- docker.io/localhost/my-image:functional-902000
size: "1410000"
- id: 05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.4
size: "57800000"
- id: aae348c9fbd40035f9fc24e2c9ccb9ac0a8977a3f3441a997bb40f6011d45e9b
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "48400000"
- id: 9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "181000000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"
- id: 04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.4
size: "120000000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: 71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:latest
size: "1410000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-902000
size: "32900000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 634c21439b2255a0755fc4f3e2e78f6d4ce920f72faa1a1e5b75ede5b65ffed3
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-902000
size: "30"
- id: 5628e5ea3c17fa1cbf49692edf41d5a1cdf198922898e6ffb29c19768dca8fd3
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.4
size: "116000000"
- id: 3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.28.4
size: "68400000"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-902000 image ls --format yaml --alsologtostderr:
I1122 10:44:50.496095    2290 out.go:296] Setting OutFile to fd 1 ...
I1122 10:44:50.496283    2290 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.496286    2290 out.go:309] Setting ErrFile to fd 2...
I1122 10:44:50.496289    2290 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:50.496415    2290 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:44:50.496845    2290 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.496903    2290 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:50.497965    2290 ssh_runner.go:195] Run: systemctl --version
I1122 10:44:50.497974    2290 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/functional-902000/id_rsa Username:docker}
I1122 10:44:50.524022    2290 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (1.98s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh pgrep buildkitd: exit status 1 (60.482833ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image build -t localhost/my-image:functional-902000 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-darwin-arm64 -p functional-902000 image build -t localhost/my-image:functional-902000 testdata/build --alsologtostderr: (1.842023583s)
functional_test.go:319: (dbg) Stdout: out/minikube-darwin-arm64 -p functional-902000 image build -t localhost/my-image:functional-902000 testdata/build --alsologtostderr:
Sending build context to Docker daemon  3.072kB

Step 1/3 : FROM gcr.io/k8s-minikube/busybox
latest: Pulling from k8s-minikube/busybox
a01966dde7f8: Pulling fs layer
a01966dde7f8: Verifying Checksum
a01966dde7f8: Download complete
a01966dde7f8: Pull complete
Digest: sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
Status: Downloaded newer image for gcr.io/k8s-minikube/busybox:latest
---> 71a676dd070f
Step 2/3 : RUN true
---> Running in 07620ef86686
Removing intermediate container 07620ef86686
---> 0855c8747ed8
Step 3/3 : ADD content.txt /
---> cc6b214d4a47
Successfully built cc6b214d4a47
Successfully tagged localhost/my-image:functional-902000
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-arm64 -p functional-902000 image build -t localhost/my-image:functional-902000 testdata/build --alsologtostderr:
I1122 10:44:48.576250    2283 out.go:296] Setting OutFile to fd 1 ...
I1122 10:44:48.576504    2283 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:48.576508    2283 out.go:309] Setting ErrFile to fd 2...
I1122 10:44:48.576510    2283 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1122 10:44:48.576662    2283 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17658-941/.minikube/bin
I1122 10:44:48.577077    2283 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:48.577712    2283 config.go:182] Loaded profile config "functional-902000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1122 10:44:48.578632    2283 ssh_runner.go:195] Run: systemctl --version
I1122 10:44:48.578641    2283 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17658-941/.minikube/machines/functional-902000/id_rsa Username:docker}
I1122 10:44:48.604813    2283 build_images.go:151] Building image from path: /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/build.3277959918.tar
I1122 10:44:48.604866    2283 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1122 10:44:48.608331    2283 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3277959918.tar
I1122 10:44:48.609780    2283 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3277959918.tar: stat -c "%s %y" /var/lib/minikube/build/build.3277959918.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3277959918.tar': No such file or directory
I1122 10:44:48.609792    2283 ssh_runner.go:362] scp /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/build.3277959918.tar --> /var/lib/minikube/build/build.3277959918.tar (3072 bytes)
I1122 10:44:48.617036    2283 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3277959918
I1122 10:44:48.620287    2283 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3277959918 -xf /var/lib/minikube/build/build.3277959918.tar
I1122 10:44:48.623722    2283 docker.go:346] Building image: /var/lib/minikube/build/build.3277959918
I1122 10:44:48.623764    2283 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-902000 /var/lib/minikube/build/build.3277959918
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/

                                                
                                                
I1122 10:44:50.367811    2283 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-902000 /var/lib/minikube/build/build.3277959918: (1.744047792s)
I1122 10:44:50.367870    2283 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3277959918
I1122 10:44:50.371269    2283 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3277959918.tar
I1122 10:44:50.374150    2283 build_images.go:207] Built localhost/my-image:functional-902000 from /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/build.3277959918.tar
I1122 10:44:50.374163    2283 build_images.go:123] succeeded building to: functional-902000
I1122 10:44:50.374165    2283 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (1.98s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.487433125s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-902000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.54s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-902000 docker-env) && out/minikube-darwin-arm64 status -p functional-902000"
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-arm64 -p functional-902000 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (17.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-902000 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-902000 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-759d89bdcc-mlp4x" [7edfeba7-ad58-469e-a929-33745170f4cd] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-759d89bdcc-mlp4x" [7edfeba7-ad58-469e-a929-33745170f4cd] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
E1122 10:44:08.900409    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 17.011568583s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (17.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr
E1122 10:43:58.646456    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.653226    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.665273    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.687358    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.727565    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.809668    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:58.971747    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:59.293862    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
E1122 10:43:59.935969    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
functional_test.go:354: (dbg) Done: out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr: (2.050602792s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.13s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr
E1122 10:44:01.218014    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
functional_test.go:364: (dbg) Done: out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr: (1.415421583s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.49s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.369301584s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-902000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr
E1122 10:44:03.778304    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
functional_test.go:244: (dbg) Done: out/minikube-darwin-arm64 -p functional-902000 image load --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr: (1.953813792s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.44s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image save gcr.io/google-containers/addon-resizer:functional-902000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image rm gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-902000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 image save --daemon gcr.io/google-containers/addon-resizer:functional-902000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-902000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (1.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 2097: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (1.34s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-902000 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [2a9470f0-b748-4370-b542-8575e81809bb] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [2a9470f0-b748-4370-b542-8575e81809bb] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.010463167s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.12s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service list -o json
functional_test.go:1493: Took "92.543542ms" to run "out/minikube-darwin-arm64 -p functional-902000 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.105.4:31802
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.105.4:31802
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-902000 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.111.136.125 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
functional_test_tunnel_test.go:327: DNS resolution by dig for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:424: tunnel at http://nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.01s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-arm64 -p functional-902000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-darwin-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-darwin-arm64 profile list
functional_test.go:1314: Took "116.164375ms" to run "out/minikube-darwin-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-darwin-arm64 profile list -l
functional_test.go:1328: Took "35.524792ms" to run "out/minikube-darwin-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json
functional_test.go:1365: Took "114.392916ms" to run "out/minikube-darwin-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-darwin-arm64 profile list -o json --light
functional_test.go:1378: Took "39.61125ms" to run "out/minikube-darwin-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (5.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1700678679292187000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1700678679292187000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1700678679292187000" to /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001/test-1700678679292187000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (67.287ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
E1122 10:44:39.623032    1438 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17658-941/.minikube/profiles/addons-024000/client.crt: no such file or directory
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Nov 22 18:44 created-by-test
-rw-r--r-- 1 docker docker 24 Nov 22 18:44 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Nov 22 18:44 test-1700678679292187000
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh cat /mount-9p/test-1700678679292187000
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-902000 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [a5e6e23d-7b67-42b4-af50-078b877fcf21] Pending
helpers_test.go:344: "busybox-mount" [a5e6e23d-7b67-42b4-af50-078b877fcf21] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [a5e6e23d-7b67-42b4-af50-078b877fcf21] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [a5e6e23d-7b67-42b4-af50-078b877fcf21] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.007716s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-902000 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3603656825/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (5.12s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port589573059/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (68.512041ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port589573059/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh "sudo umount -f /mount-9p": exit status 1 (63.91675ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-darwin-arm64 -p functional-902000 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdspecific-port589573059/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.03s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T" /mount1: exit status 1 (75.842458ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-arm64 -p functional-902000 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-darwin-arm64 mount -p functional-902000 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-arm64 mount -p functional-902000 /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2461402946/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.05s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.12s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-902000
--- PASS: TestFunctional/delete_addon-resizer_images (0.12s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-902000
--- PASS: TestFunctional/delete_my-image_image (0.04s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-902000
--- PASS: TestFunctional/delete_minikube_cached_images (0.04s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.05s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-389000 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (0.05s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 stop -p json-output-763000 --output=json --user=testUser
--- PASS: TestJSONOutput/stop/Command (0.05s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.33s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-error-202000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-error-202000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (95.876334ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"e315203a-ecd7-4e17-9139-3afa980719b2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-202000] minikube v1.32.0 on Darwin 14.1.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"b5f38b0a-3b7d-4353-b2f6-84a321f6fc18","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17658"}}
	{"specversion":"1.0","id":"42f46803-6296-43b7-bd8c-b78ee7bfbad3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig"}}
	{"specversion":"1.0","id":"3b6ec9cf-e40f-46c1-8173-d5a953006716","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}
	{"specversion":"1.0","id":"2c0c1ea0-b808-42e1-933c-6ff4a6bfabe2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"c2eb5cbb-d92e-40f9-8abf-dbc95276e850","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube"}}
	{"specversion":"1.0","id":"f685dbdd-dff1-4904-8df7-dd7c7aa69167","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"c5d96eec-8105-4840-afbf-0f67f0f5471c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-202000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p json-output-error-202000
--- PASS: TestErrorJSONOutput (0.33s)

                                                
                                    
x
+
TestMainNoArgs (0.04s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-arm64
--- PASS: TestMainNoArgs (0.04s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p NoKubernetes-675000 --no-kubernetes --kubernetes-version=1.20 --driver=qemu2 : exit status 14 (99.570333ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-675000] minikube v1.32.0 on Darwin 14.1.1 (arm64)
	  - MINIKUBE_LOCATION=17658
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17658-941/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-arm64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17658-941/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.05s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-675000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-675000 "sudo systemctl is-active --quiet service kubelet": exit status 89 (45.594708ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p NoKubernetes-675000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.05s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.15s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.15s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (0.06s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-arm64 stop -p NoKubernetes-675000
--- PASS: TestNoKubernetes/serial/Stop (0.06s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.04s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-arm64 ssh -p NoKubernetes-675000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p NoKubernetes-675000 "sudo systemctl is-active --quiet service kubelet": exit status 89 (43.667959ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p NoKubernetes-675000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.04s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p old-k8s-version-714000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (0.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p old-k8s-version-714000 -n old-k8s-version-714000: exit status 7 (37.996125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p old-k8s-version-714000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p no-preload-301000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/no-preload/serial/Stop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p no-preload-301000 -n no-preload-301000: exit status 7 (31.931625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p no-preload-301000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p default-k8s-diff-port-650000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p default-k8s-diff-port-650000 -n default-k8s-diff-port-650000: exit status 7 (31.747459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p default-k8s-diff-port-650000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-arm64 addons enable metrics-server -p newest-cni-496000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.08s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p newest-cni-496000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/newest-cni/serial/Stop (0.08s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p newest-cni-496000 -n newest-cni-496000: exit status 7 (32.81475ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p newest-cni-496000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (0.06s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 stop -p embed-certs-958000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/embed-certs/serial/Stop (0.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p embed-certs-958000 -n embed-certs-958000: exit status 7 (31.367458ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-arm64 addons enable dashboard -p embed-certs-958000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.10s)

                                                
                                    

Test skip (21/254)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:213: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:443: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:497: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:297: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (2.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:523: 
----------------------- debugLogs start: cilium-410000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-410000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-410000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-410000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-410000"

                                                
                                                
----------------------- debugLogs end: cilium-410000 [took: 2.205737292s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-410000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cilium-410000
--- SKIP: TestNetworkPlugins/group/cilium (2.43s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-538000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p disable-driver-mounts-538000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.25s)

                                                
                                    
Copied to clipboard