Test Report: Hyperkit_macOS 17527

                    
                      e4a17a129ff7b90db2cf05af39ada1ef78f6d52a:2023-10-30:31678
                    
                

Test fail (142/240)

Order failed test Duration
10 TestDownloadOnly/v1.28.3/json-events 7.39
14 TestDownloadOnly/v1.28.3/kubectl 0
19 TestBinaryMirror 1.14
20 TestOffline 12.15
25 TestAddons/Setup 11.65
26 TestCertOptions 13.92
27 TestCertExpiration 200.15
28 TestDockerFlags 14.94
29 TestForceSystemdFlag 12.15
30 TestForceSystemdEnv 16.51
36 TestErrorSpam/setup 11.13
45 TestFunctional/serial/StartWithProxy 11.31
47 TestFunctional/serial/SoftStart 5.83
48 TestFunctional/serial/KubeContext 0.1
49 TestFunctional/serial/KubectlGetPods 0.11
56 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.13
57 TestFunctional/serial/CacheCmd/cache/cache_reload 0.49
59 TestFunctional/serial/MinikubeKubectlCmd 0.12
60 TestFunctional/serial/MinikubeKubectlCmdDirectly 1.39
61 TestFunctional/serial/ExtraConfig 5.88
62 TestFunctional/serial/ComponentHealth 0.1
63 TestFunctional/serial/LogsCmd 0.32
64 TestFunctional/serial/LogsFileCmd 0.27
65 TestFunctional/serial/InvalidService 0.04
68 TestFunctional/parallel/DashboardCmd 0.34
71 TestFunctional/parallel/StatusCmd 0.27
75 TestFunctional/parallel/ServiceCmdConnect 0.21
77 TestFunctional/parallel/PersistentVolumeClaim 0.07
79 TestFunctional/parallel/SSHCmd 0.34
80 TestFunctional/parallel/CpCmd 0.71
81 TestFunctional/parallel/MySQL 0.16
82 TestFunctional/parallel/FileSync 0.27
83 TestFunctional/parallel/CertSync 0.97
87 TestFunctional/parallel/NodeLabels 0.1
89 TestFunctional/parallel/NonActiveRuntimeDisabled 0.17
92 TestFunctional/parallel/ImageCommands/ImageListShort 0.09
93 TestFunctional/parallel/ImageCommands/ImageListTable 0.09
94 TestFunctional/parallel/ImageCommands/ImageListJson 0.09
95 TestFunctional/parallel/ImageCommands/ImageListYaml 0.09
96 TestFunctional/parallel/ImageCommands/ImageBuild 0.39
98 TestFunctional/parallel/DockerEnv/bash 0.14
99 TestFunctional/parallel/UpdateContextCmd/no_changes 0.15
100 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.13
101 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
102 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.88
104 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.32
107 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
108 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 105.42
109 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.77
110 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 3.59
111 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.09
113 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.18
115 TestFunctional/parallel/ServiceCmd/DeployApp 0.03
116 TestFunctional/parallel/ServiceCmd/List 0.15
117 TestFunctional/parallel/ServiceCmd/JSONOutput 0.13
118 TestFunctional/parallel/ServiceCmd/HTTPS 0.13
119 TestFunctional/parallel/ServiceCmd/Format 0.13
120 TestFunctional/parallel/ServiceCmd/URL 0.13
128 TestFunctional/parallel/Version/components 0.13
129 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.07
131 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 37.89
139 TestImageBuild/serial/Setup 11.12
141 TestIngressAddonLegacy/StartLegacyK8sCluster 19.12
143 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 0.34
145 TestIngressAddonLegacy/serial/ValidateIngressAddons 0.07
148 TestJSONOutput/start/Command 10.98
151 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
152 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
154 TestJSONOutput/pause/Command 0.13
160 TestJSONOutput/unpause/Command 0.16
177 TestMinikubeProfile 11.9
180 TestMountStart/serial/StartWithMountFirst 11.22
183 TestMultiNode/serial/FreshStart2Nodes 11.35
184 TestMultiNode/serial/DeployApp2Nodes 89.07
185 TestMultiNode/serial/PingHostFrom2Pods 0.13
186 TestMultiNode/serial/AddNode 0.2
187 TestMultiNode/serial/ProfileList 0.2
188 TestMultiNode/serial/CopyFile 0.13
189 TestMultiNode/serial/StopNode 0.35
190 TestMultiNode/serial/StartAfterStop 0.28
191 TestMultiNode/serial/RestartKeepsNodes 6.23
192 TestMultiNode/serial/DeleteNode 0.27
193 TestMultiNode/serial/StopMultiNode 0.42
194 TestMultiNode/serial/RestartMultiNode 5.85
195 TestMultiNode/serial/ValidateNameConflict 22.88
199 TestPreload 11.42
201 TestScheduledStopUnix 11.59
202 TestSkaffold 13.87
205 TestRunningBinaryUpgrade 10.16
207 TestKubernetesUpgrade 17.57
223 TestStoppedBinaryUpgrade/Upgrade 6.06
224 TestStoppedBinaryUpgrade/MinikubeLogs 0.32
226 TestPause/serial/Start 11.32
236 TestNoKubernetes/serial/StartWithK8s 11.09
237 TestNoKubernetes/serial/StartWithStopK8s 5.92
238 TestNoKubernetes/serial/Start 5.97
242 TestNoKubernetes/serial/StartNoArgs 5.92
244 TestNetworkPlugins/group/auto/Start 11.32
245 TestNetworkPlugins/group/calico/Start 11.24
246 TestNetworkPlugins/group/custom-flannel/Start 11.14
247 TestNetworkPlugins/group/false/Start 11.17
248 TestNetworkPlugins/group/kindnet/Start 11.34
249 TestNetworkPlugins/group/flannel/Start 11.07
250 TestNetworkPlugins/group/enable-default-cni/Start 11.64
251 TestNetworkPlugins/group/bridge/Start 11.6
252 TestNetworkPlugins/group/kubenet/Start 11.88
254 TestStartStop/group/old-k8s-version/serial/FirstStart 11.7
255 TestStartStop/group/old-k8s-version/serial/DeployApp 0.2
256 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.39
259 TestStartStop/group/no-preload/serial/FirstStart 12.49
261 TestStartStop/group/old-k8s-version/serial/SecondStart 8.56
262 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.07
263 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.1
264 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.23
265 TestStartStop/group/old-k8s-version/serial/Pause 0.36
267 TestStartStop/group/embed-certs/serial/FirstStart 12.59
268 TestStartStop/group/no-preload/serial/DeployApp 0.17
269 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.32
272 TestStartStop/group/no-preload/serial/SecondStart 6.99
273 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.07
274 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.1
275 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.23
276 TestStartStop/group/no-preload/serial/Pause 0.27
278 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 12.21
279 TestStartStop/group/embed-certs/serial/DeployApp 0.17
280 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.32
283 TestStartStop/group/embed-certs/serial/SecondStart 6.95
284 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.07
285 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.1
286 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.21
287 TestStartStop/group/embed-certs/serial/Pause 0.27
289 TestStartStop/group/newest-cni/serial/FirstStart 12.85
290 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.17
291 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.31
294 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 7.2
295 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.07
296 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.1
297 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.23
298 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.3
303 TestStartStop/group/newest-cni/serial/SecondStart 5.86
306 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.22
307 TestStartStop/group/newest-cni/serial/Pause 0.27
x
+
TestDownloadOnly/v1.28.3/json-events (7.39s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-255000 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-255000 --force --alsologtostderr --kubernetes-version=v1.28.3 --container-runtime=docker --driver=hyperkit : exit status 40 (7.389971532s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4b4db4fb-fdbb-4613-ad47-d8ecad458ec6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-255000] minikube v1.32.0-beta.0 on Darwin 14.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"18ee330c-eef5-4724-9d6b-6054ee301c4c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17527"}}
	{"specversion":"1.0","id":"0fe98495-c0d1-453e-b00b-e578d59d0b7d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig"}}
	{"specversion":"1.0","id":"daa52f73-2893-4ace-b478-64a89cc4d1cf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"ce135f5a-6103-4662-b640-3e7022763277","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"331b70a4-fa2b-4dab-953d-75b141ca05b9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube"}}
	{"specversion":"1.0","id":"26b6cd29-565e-4d33-941a-7f6e9f1a3397","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}
	{"specversion":"1.0","id":"2378b608-28ca-499a-9db4-1330da4e0cd0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on existing profile","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"a3e3328c-75fd-4bd6-b618-af41cbfe4809","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node download-only-255000 in cluster download-only-255000","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"673d8727-0ff9-437f-bffd-8a3fdaf40743","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.28.3 preload ...","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"547f50c4-9631-42ba-a554-605087d78ea4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540] Decompressors:map[bz2:0xc00091b220 gz:0xc00091b228 tar:0xc00091b1d0 tar.bz2:0xc00091b1e0 tar.gz:0xc00091b1f0 tar.xz:0xc00091b200 tar.zst:0xc00091b210 tbz2:0xc00091b1e0 tgz:0xc00091b1f0 txz:0xc00091b2
00 tzst:0xc00091b210 xz:0xc00091b230 zip:0xc00091b240 zst:0xc00091b238] Getters:map[file:0xc00094a3c0 http:0xc0004e20f0 https:0xc0004e2280] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}
	{"specversion":"1.0","id":"7e0a37c1-200f-4071-99f5-0e0145f776f7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│
│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:03:17.999362    1494 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:03:17.999645    1494 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:17.999650    1494 out.go:309] Setting ErrFile to fd 2...
	I1030 16:03:17.999654    1494 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:17.999840    1494 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	W1030 16:03:17.999933    1494 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: no such file or directory
	I1030 16:03:18.001360    1494 out.go:303] Setting JSON to true
	I1030 16:03:18.023451    1494 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":173,"bootTime":1698706825,"procs":421,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:03:18.023556    1494 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:03:18.044722    1494 out.go:97] [download-only-255000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:03:18.065502    1494 out.go:169] MINIKUBE_LOCATION=17527
	I1030 16:03:18.044861    1494 notify.go:220] Checking for updates...
	I1030 16:03:18.107564    1494 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:03:18.128421    1494 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:03:18.149457    1494 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:03:18.170596    1494 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	W1030 16:03:18.212414    1494 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1030 16:03:18.213134    1494 config.go:182] Loaded profile config "download-only-255000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W1030 16:03:18.213215    1494 start.go:810] api.Load failed for download-only-255000: filestore "download-only-255000": Docker machine "download-only-255000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 16:03:18.213349    1494 driver.go:378] Setting default libvirt URI to qemu:///system
	W1030 16:03:18.213391    1494 start.go:810] api.Load failed for download-only-255000: filestore "download-only-255000": Docker machine "download-only-255000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 16:03:18.243538    1494 out.go:97] Using the hyperkit driver based on existing profile
	I1030 16:03:18.243629    1494 start.go:298] selected driver: hyperkit
	I1030 16:03:18.243642    1494 start.go:902] validating driver "hyperkit" against &{Name:download-only-255000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuber
netesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-255000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro
r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:18.244019    1494 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:18.244182    1494 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:03:18.253714    1494 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:03:18.257718    1494 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:18.257744    1494 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:03:18.260556    1494 cni.go:84] Creating CNI manager for ""
	I1030 16:03:18.260590    1494 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:03:18.260602    1494 start_flags.go:323] config:
	{Name:download-only-255000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:download-only-255000 Namespace:
default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketV
MnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:18.260746    1494 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:18.281494    1494 out.go:97] Starting control plane node download-only-255000 in cluster download-only-255000
	I1030 16:03:18.281524    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:18.332173    1494 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:03:18.332214    1494 cache.go:56] Caching tarball of preloaded images
	I1030 16:03:18.332610    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:18.356149    1494 out.go:97] Downloading Kubernetes v1.28.3 preload ...
	I1030 16:03:18.356193    1494 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:18.433566    1494 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4?checksum=md5:82104bbf889ff8b69d5c141ce86c05ac -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:03:24.132818    1494 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:24.133030    1494 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:24.744561    1494 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:03:24.744665    1494 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/download-only-255000/config.json ...
	I1030 16:03:24.745082    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:24.745337    1494 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl
	I1030 16:03:25.233587    1494 out.go:169] 
	W1030 16:03:25.255356    1494 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540] Decompressors:map[bz2:0xc00091b220 gz:0xc00091b228 tar:0xc00091b1d0 tar.bz2:0xc00091b1e0 tar.gz:0xc00091b1f0 tar.xz:0xc00091b200 tar.zst:0xc00091b210 tbz2:0xc00091b1e0 tgz:0xc00091b1f0 txz:0xc00091b200 tzst:0xc00091b210 xz:0xc00091b230 zip:0xc00091b240 zst:0xc00091b238] Getters:map[file:0xc00094a3c0 http:0xc0004e20f0 https:0xc0004e2280] Dir:false ProgressListener:<nil> Insecure:false Disabl
eSymlinks:false Options:[]}: bad response code: 404
	W1030 16:03:25.255399    1494 out_reason.go:110] 
	W1030 16:03:25.278512    1494 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1030 16:03:25.300325    1494 out.go:169] 

                                                
                                                
** /stderr **
aaa_download_only_test.go:71: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-255000" "--force" "--alsologtostderr" "--kubernetes-version=v1.28.3" "--container-runtime=docker" "--driver=hyperkit" ""] exit status 40
--- FAIL: TestDownloadOnly/v1.28.3/json-events (7.39s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/kubectl
aaa_download_only_test.go:163: expected the file for binary exist at "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl" but got error stat /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: no such file or directory
--- FAIL: TestDownloadOnly/v1.28.3/kubectl (0.00s)

                                                
                                    
x
+
TestBinaryMirror (1.14s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:288: Failed to download binary: bad response code: 404
getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x52aed80 0x52aed80 0x52aed80 0x52aed80 0x52aed80 0x52aed80 0x52aed80] Decompressors:map[bz2:0xc000545710 gz:0xc000545718 tar:0xc0005456c0 tar.bz2:0xc0005456d0 tar.gz:0xc0005456e0 tar.xz:0xc0005456f0 tar.zst:0xc000545700 tbz2:0xc0005456d0 tgz:0xc0005456e0 txz:0xc0005456f0 tzst:0xc000545700 xz:0xc000545720 zip:0xc000545730 zst:0xc000545728] Getters:map[file:0xc00050fa20 http:0xc0004e6af0 https:0xc0004e6b40] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}
k8s.io/minikube/pkg/minikube/download.download
	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/pkg/minikube/download/download.go:109
k8s.io/minikube/pkg/minikube/download.Binary
	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/pkg/minikube/download/binary.go:80
k8s.io/minikube/test/integration.TestBinaryMirror
	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/aaa_download_only_test.go:286
testing.tRunner
	/usr/local/go/src/testing/testing.go:1595
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1650
download failed: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256
k8s.io/minikube/pkg/minikube/download.Binary
	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/pkg/minikube/download/binary.go:81
k8s.io/minikube/test/integration.TestBinaryMirror
	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/aaa_download_only_test.go:286
testing.tRunner
	/usr/local/go/src/testing/testing.go:1595
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1650
aaa_download_only_test.go:298: Failed to move binary file: rename  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestBinaryMirror4159714303/001/v1.28.3/bin/darwin/amd64/kubectl: no such file or directory
aaa_download_only_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-500000 --alsologtostderr --binary-mirror http://127.0.0.1:49336 --driver=hyperkit 
helpers_test.go:175: Cleaning up "binary-mirror-500000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-500000
--- FAIL: TestBinaryMirror (1.14s)

                                                
                                    
x
+
TestOffline (12.15s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-325000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-325000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : exit status 60 (11.828519667s)

                                                
                                                
-- stdout --
	* [offline-docker-325000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node offline-docker-325000 in cluster offline-docker-325000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "offline-docker-325000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:11:19.242480    2879 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:11:19.242761    2879 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:19.242766    2879 out.go:309] Setting ErrFile to fd 2...
	I1030 16:11:19.242772    2879 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:19.242965    2879 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:11:19.244428    2879 out.go:303] Setting JSON to false
	I1030 16:11:19.267484    2879 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":654,"bootTime":1698706825,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:11:19.267611    2879 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:11:19.289262    2879 out.go:177] * [offline-docker-325000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:11:19.331206    2879 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:11:19.331270    2879 notify.go:220] Checking for updates...
	I1030 16:11:19.374005    2879 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:11:19.395162    2879 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:11:19.415949    2879 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:11:19.437079    2879 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:19.458135    2879 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:11:19.479610    2879 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:19.479694    2879 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:11:19.507978    2879 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:11:19.549680    2879 start.go:298] selected driver: hyperkit
	I1030 16:11:19.549696    2879 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:11:19.549704    2879 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:11:19.552487    2879 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:19.552601    2879 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:11:19.560538    2879 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:11:19.564578    2879 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:11:19.564600    2879 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:11:19.564627    2879 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:11:19.564835    2879 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:11:19.564907    2879 cni.go:84] Creating CNI manager for ""
	I1030 16:11:19.564922    2879 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:11:19.564934    2879 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:11:19.564944    2879 start_flags.go:323] config:
	{Name:offline-docker-325000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:offline-docker-325000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:11:19.565076    2879 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:19.586234    2879 out.go:177] * Starting control plane node offline-docker-325000 in cluster offline-docker-325000
	I1030 16:11:19.607053    2879 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:11:19.607134    2879 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:11:19.607159    2879 cache.go:56] Caching tarball of preloaded images
	I1030 16:11:19.607327    2879 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:11:19.607343    2879 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:11:19.607478    2879 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/offline-docker-325000/config.json ...
	I1030 16:11:19.607510    2879 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/offline-docker-325000/config.json: {Name:mkf456affbe9f4d15c55115d3e1cfbef5b677097 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:11:19.607974    2879 start.go:365] acquiring machines lock for offline-docker-325000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:19.608071    2879 start.go:369] acquired machines lock for "offline-docker-325000" in 75.794µs
	I1030 16:11:19.608117    2879 start.go:93] Provisioning new machine with config: &{Name:offline-docker-325000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.3 ClusterName:offline-docker-325000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:19.608210    2879 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:19.630116    2879 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:19.630576    2879 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:11:19.630654    2879 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:19.639686    2879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50045
	I1030 16:11:19.640072    2879 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:19.640497    2879 main.go:141] libmachine: Using API Version  1
	I1030 16:11:19.640508    2879 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:19.640741    2879 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:19.640866    2879 main.go:141] libmachine: (offline-docker-325000) Calling .GetMachineName
	I1030 16:11:19.640956    2879 main.go:141] libmachine: (offline-docker-325000) Calling .DriverName
	I1030 16:11:19.641073    2879 start.go:159] libmachine.API.Create for "offline-docker-325000" (driver="hyperkit")
	I1030 16:11:19.641102    2879 client.go:168] LocalClient.Create starting
	I1030 16:11:19.641133    2879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:19.641179    2879 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:19.641198    2879 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:19.641283    2879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:19.641318    2879 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:19.641332    2879 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:19.641344    2879 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:19.641354    2879 main.go:141] libmachine: (offline-docker-325000) Calling .PreCreateCheck
	I1030 16:11:19.641442    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:19.641622    2879 main.go:141] libmachine: (offline-docker-325000) Calling .GetConfigRaw
	I1030 16:11:19.673988    2879 main.go:141] libmachine: Creating machine...
	I1030 16:11:19.674016    2879 main.go:141] libmachine: (offline-docker-325000) Calling .Create
	I1030 16:11:19.674253    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:19.674573    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:19.674248    2899 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:19.674712    2879 main.go:141] libmachine: (offline-docker-325000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:20.098803    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:20.098707    2899 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/id_rsa...
	I1030 16:11:20.216660    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:20.216537    2899 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/offline-docker-325000.rawdisk...
	I1030 16:11:20.216690    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Writing magic tar header
	I1030 16:11:20.216723    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Writing SSH key tar header
	I1030 16:11:20.238021    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:20.237949    2899 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000 ...
	I1030 16:11:20.567877    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:20.567898    2879 main.go:141] libmachine: (offline-docker-325000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/hyperkit.pid
	I1030 16:11:20.567913    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Using UUID a282ed3e-7779-11ee-adc0-149d997fca88
	I1030 16:11:20.606019    2879 main.go:141] libmachine: (offline-docker-325000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:20.606104    2879 client.go:171] LocalClient.Create took 964.991046ms
	I1030 16:11:22.606432    2879 start.go:128] duration metric: createHost completed in 2.998198545s
	I1030 16:11:22.606461    2879 start.go:83] releasing machines lock for "offline-docker-325000", held for 2.998377163s
	W1030 16:11:22.606487    2879 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:11:22.607065    2879 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:11:22.607115    2879 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:22.616177    2879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50047
	I1030 16:11:22.616545    2879 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:22.616910    2879 main.go:141] libmachine: Using API Version  1
	I1030 16:11:22.616925    2879 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:22.617148    2879 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:22.617494    2879 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:11:22.617525    2879 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:22.625042    2879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50049
	I1030 16:11:22.625384    2879 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:22.625722    2879 main.go:141] libmachine: Using API Version  1
	I1030 16:11:22.625733    2879 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:22.625950    2879 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:22.626057    2879 main.go:141] libmachine: (offline-docker-325000) Calling .GetState
	I1030 16:11:22.626144    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:22.626165    2879 main.go:141] libmachine: (offline-docker-325000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/hyperkit.json: no such file or directory
	I1030 16:11:22.626173    2879 main.go:141] libmachine: (offline-docker-325000) DBG | hyperkit pid from json: 0
	I1030 16:11:22.626217    2879 main.go:141] libmachine: (offline-docker-325000) Calling .DriverName
	I1030 16:11:22.672270    2879 out.go:177] * Deleting "offline-docker-325000" in hyperkit ...
	I1030 16:11:22.693584    2879 main.go:141] libmachine: (offline-docker-325000) Calling .Remove
	I1030 16:11:22.693873    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:22.693892    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:22.693912    2879 main.go:141] libmachine: (offline-docker-325000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/hyperkit.json: no such file or directory
	I1030 16:11:22.693938    2879 main.go:141] libmachine: (offline-docker-325000) DBG | hyperkit pid from json: 0
	W1030 16:11:22.784599    2879 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:22.784627    2879 start.go:706] Will try again in 5 seconds ...
	I1030 16:11:27.785700    2879 start.go:365] acquiring machines lock for offline-docker-325000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:27.785786    2879 start.go:369] acquired machines lock for "offline-docker-325000" in 61.203µs
	I1030 16:11:27.785819    2879 start.go:93] Provisioning new machine with config: &{Name:offline-docker-325000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.3 ClusterName:offline-docker-325000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:27.785871    2879 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:27.816444    2879 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:27.816525    2879 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:11:27.816553    2879 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:27.824487    2879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50052
	I1030 16:11:27.824844    2879 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:27.825179    2879 main.go:141] libmachine: Using API Version  1
	I1030 16:11:27.825190    2879 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:27.825428    2879 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:27.825554    2879 main.go:141] libmachine: (offline-docker-325000) Calling .GetMachineName
	I1030 16:11:27.825652    2879 main.go:141] libmachine: (offline-docker-325000) Calling .DriverName
	I1030 16:11:27.825748    2879 start.go:159] libmachine.API.Create for "offline-docker-325000" (driver="hyperkit")
	I1030 16:11:27.825765    2879 client.go:168] LocalClient.Create starting
	I1030 16:11:27.825793    2879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:27.825845    2879 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:27.825855    2879 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:27.825893    2879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:27.825928    2879 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:27.825939    2879 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:27.825962    2879 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:27.825969    2879 main.go:141] libmachine: (offline-docker-325000) Calling .PreCreateCheck
	I1030 16:11:27.826043    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:27.826087    2879 main.go:141] libmachine: (offline-docker-325000) Calling .GetConfigRaw
	I1030 16:11:27.826500    2879 main.go:141] libmachine: Creating machine...
	I1030 16:11:27.826509    2879 main.go:141] libmachine: (offline-docker-325000) Calling .Create
	I1030 16:11:27.826581    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:27.826744    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:27.826585    3012 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:27.826795    2879 main.go:141] libmachine: (offline-docker-325000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:28.207880    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:28.207779    3012 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/id_rsa...
	I1030 16:11:28.273989    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:28.273912    3012 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/offline-docker-325000.rawdisk...
	I1030 16:11:28.274005    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Writing magic tar header
	I1030 16:11:28.274023    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Writing SSH key tar header
	I1030 16:11:28.276714    2879 main.go:141] libmachine: (offline-docker-325000) DBG | I1030 16:11:28.276670    3012 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000 ...
	I1030 16:11:28.661143    2879 main.go:141] libmachine: (offline-docker-325000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:11:28.661168    2879 main.go:141] libmachine: (offline-docker-325000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/offline-docker-325000/hyperkit.pid
	I1030 16:11:28.661202    2879 main.go:141] libmachine: (offline-docker-325000) DBG | Using UUID a7640e78-7779-11ee-adc0-149d997fca88
	I1030 16:11:28.844255    2879 main.go:141] libmachine: (offline-docker-325000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:28.844350    2879 client.go:171] LocalClient.Create took 1.018577356s
	I1030 16:11:30.844554    2879 start.go:128] duration metric: createHost completed in 3.058666593s
	I1030 16:11:30.844586    2879 start.go:83] releasing machines lock for "offline-docker-325000", held for 3.05878936s
	W1030 16:11:30.844742    2879 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p offline-docker-325000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p offline-docker-325000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:30.888055    2879 out.go:177] 
	W1030 16:11:30.909610    2879 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:11:30.909677    2879 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:11:30.909704    2879 out.go:239] * Related issues:
	* Related issues:
	W1030 16:11:30.909725    2879 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:11:30.909761    2879 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:11:30.952251    2879 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-325000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit  failed: exit status 60
panic.go:523: *** TestOffline FAILED at 2023-10-30 16:11:31.019019 -0700 PDT m=+510.552285957
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-325000 -n offline-docker-325000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-325000 -n offline-docker-325000: exit status 7 (65.861814ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-325000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-325000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-325000
--- FAIL: TestOffline (12.15s)

                                                
                                    
x
+
TestAddons/Setup (11.65s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-690000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p addons-690000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: exit status 60 (11.647447542s)

                                                
                                                
-- stdout --
	* [addons-690000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node addons-690000 in cluster addons-690000
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "addons-690000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:03:28.224938    1560 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:03:28.225143    1560 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:28.225148    1560 out.go:309] Setting ErrFile to fd 2...
	I1030 16:03:28.225152    1560 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:28.225328    1560 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:03:28.226743    1560 out.go:303] Setting JSON to false
	I1030 16:03:28.248467    1560 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":183,"bootTime":1698706825,"procs":418,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:03:28.248568    1560 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:03:28.270247    1560 out.go:177] * [addons-690000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:03:28.313011    1560 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:03:28.313077    1560 notify.go:220] Checking for updates...
	I1030 16:03:28.334907    1560 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:03:28.355748    1560 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:03:28.376669    1560 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:03:28.398049    1560 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:03:28.419933    1560 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:03:28.442114    1560 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:03:28.471780    1560 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:03:28.513738    1560 start.go:298] selected driver: hyperkit
	I1030 16:03:28.513766    1560 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:03:28.513784    1560 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:03:28.518202    1560 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:28.518355    1560 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:03:28.526646    1560 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:03:28.530765    1560 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:28.530797    1560 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:03:28.530830    1560 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:03:28.531088    1560 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:03:28.531181    1560 cni.go:84] Creating CNI manager for ""
	I1030 16:03:28.531193    1560 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:03:28.531201    1560 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:03:28.531210    1560 start_flags.go:323] config:
	{Name:addons-690000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:addons-690000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:28.531339    1560 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:28.573626    1560 out.go:177] * Starting control plane node addons-690000 in cluster addons-690000
	I1030 16:03:28.594785    1560 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:28.594860    1560 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:03:28.594894    1560 cache.go:56] Caching tarball of preloaded images
	I1030 16:03:28.595087    1560 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:03:28.595104    1560 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:03:28.595610    1560 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/addons-690000/config.json ...
	I1030 16:03:28.595651    1560 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/addons-690000/config.json: {Name:mk8a976889267c88a0d5ad5c870558c2dda28ad3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:03:28.596291    1560 start.go:365] acquiring machines lock for addons-690000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:03:28.596490    1560 start.go:369] acquired machines lock for "addons-690000" in 176.611µs
	I1030 16:03:28.596538    1560 start.go:93] Provisioning new machine with config: &{Name:addons-690000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:addons-690000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:03:28.596633    1560 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:03:28.638761    1560 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	I1030 16:03:28.639194    1560 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:28.639262    1560 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:03:28.648325    1560 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49349
	I1030 16:03:28.648661    1560 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:03:28.649058    1560 main.go:141] libmachine: Using API Version  1
	I1030 16:03:28.649069    1560 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:03:28.649277    1560 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:03:28.649383    1560 main.go:141] libmachine: (addons-690000) Calling .GetMachineName
	I1030 16:03:28.649472    1560 main.go:141] libmachine: (addons-690000) Calling .DriverName
	I1030 16:03:28.649570    1560 start.go:159] libmachine.API.Create for "addons-690000" (driver="hyperkit")
	I1030 16:03:28.649596    1560 client.go:168] LocalClient.Create starting
	I1030 16:03:28.649633    1560 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:03:28.807532    1560 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:03:28.943857    1560 main.go:141] libmachine: Running pre-create checks...
	I1030 16:03:28.943866    1560 main.go:141] libmachine: (addons-690000) Calling .PreCreateCheck
	I1030 16:03:28.944073    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:28.944265    1560 main.go:141] libmachine: (addons-690000) Calling .GetConfigRaw
	I1030 16:03:28.944747    1560 main.go:141] libmachine: Creating machine...
	I1030 16:03:28.944758    1560 main.go:141] libmachine: (addons-690000) Calling .Create
	I1030 16:03:28.944876    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:28.945135    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:28.944864    1568 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:03:28.945189    1560 main.go:141] libmachine: (addons-690000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:03:29.102088    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:29.101994    1568 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/id_rsa...
	I1030 16:03:29.411039    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:29.410918    1568 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/addons-690000.rawdisk...
	I1030 16:03:29.411053    1560 main.go:141] libmachine: (addons-690000) DBG | Writing magic tar header
	I1030 16:03:29.411062    1560 main.go:141] libmachine: (addons-690000) DBG | Writing SSH key tar header
	I1030 16:03:29.411852    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:29.411731    1568 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000 ...
	I1030 16:03:29.734506    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:29.734523    1560 main.go:141] libmachine: (addons-690000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/hyperkit.pid
	I1030 16:03:29.734536    1560 main.go:141] libmachine: (addons-690000) DBG | Using UUID 89c758d0-7778-11ee-bb4d-149d997fca88
	I1030 16:03:29.773011    1560 main.go:141] libmachine: (addons-690000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:03:29.773099    1560 client.go:171] LocalClient.Create took 1.12349283s
	I1030 16:03:31.774622    1560 start.go:128] duration metric: createHost completed in 3.17796773s
	I1030 16:03:31.774651    1560 start.go:83] releasing machines lock for "addons-690000", held for 3.178146369s
	W1030 16:03:31.774678    1560 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:03:31.775218    1560 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:31.775269    1560 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:03:31.784602    1560 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49351
	I1030 16:03:31.785210    1560 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:03:31.785718    1560 main.go:141] libmachine: Using API Version  1
	I1030 16:03:31.785754    1560 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:03:31.786023    1560 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:03:31.786359    1560 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:31.786380    1560 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:03:31.794120    1560 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49353
	I1030 16:03:31.794438    1560 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:03:31.794769    1560 main.go:141] libmachine: Using API Version  1
	I1030 16:03:31.794782    1560 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:03:31.795005    1560 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:03:31.795099    1560 main.go:141] libmachine: (addons-690000) Calling .GetState
	I1030 16:03:31.795179    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:31.795200    1560 main.go:141] libmachine: (addons-690000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/hyperkit.json: no such file or directory
	I1030 16:03:31.795211    1560 main.go:141] libmachine: (addons-690000) DBG | hyperkit pid from json: 0
	I1030 16:03:31.795250    1560 main.go:141] libmachine: (addons-690000) Calling .DriverName
	I1030 16:03:31.841835    1560 out.go:177] * Deleting "addons-690000" in hyperkit ...
	I1030 16:03:31.863915    1560 main.go:141] libmachine: (addons-690000) Calling .Remove
	I1030 16:03:31.864213    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:31.864231    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:31.864250    1560 main.go:141] libmachine: (addons-690000) DBG | hyperkit pid from json: 0
	I1030 16:03:31.864267    1560 main.go:141] libmachine: (addons-690000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/hyperkit.json: no such file or directory
	W1030 16:03:31.877144    1560 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:03:31.877157    1560 start.go:706] Will try again in 5 seconds ...
	I1030 16:03:36.878225    1560 start.go:365] acquiring machines lock for addons-690000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:03:36.878446    1560 start.go:369] acquired machines lock for "addons-690000" in 158.903µs
	I1030 16:03:36.878474    1560 start.go:93] Provisioning new machine with config: &{Name:addons-690000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:addons-690000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:03:36.878586    1560 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:03:36.901525    1560 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	I1030 16:03:36.901655    1560 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:36.901732    1560 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:03:36.911409    1560 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49355
	I1030 16:03:36.912036    1560 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:03:36.912538    1560 main.go:141] libmachine: Using API Version  1
	I1030 16:03:36.912552    1560 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:03:36.912877    1560 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:03:36.913006    1560 main.go:141] libmachine: (addons-690000) Calling .GetMachineName
	I1030 16:03:36.913121    1560 main.go:141] libmachine: (addons-690000) Calling .DriverName
	I1030 16:03:36.913235    1560 start.go:159] libmachine.API.Create for "addons-690000" (driver="hyperkit")
	I1030 16:03:36.913257    1560 client.go:168] LocalClient.Create starting
	I1030 16:03:36.913286    1560 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:03:36.913331    1560 main.go:141] libmachine: Decoding PEM data...
	I1030 16:03:36.913346    1560 main.go:141] libmachine: Parsing certificate...
	I1030 16:03:36.913409    1560 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:03:36.913452    1560 main.go:141] libmachine: Decoding PEM data...
	I1030 16:03:36.913466    1560 main.go:141] libmachine: Parsing certificate...
	I1030 16:03:36.913479    1560 main.go:141] libmachine: Running pre-create checks...
	I1030 16:03:36.913485    1560 main.go:141] libmachine: (addons-690000) Calling .PreCreateCheck
	I1030 16:03:36.913560    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:36.913611    1560 main.go:141] libmachine: (addons-690000) Calling .GetConfigRaw
	I1030 16:03:36.914058    1560 main.go:141] libmachine: Creating machine...
	I1030 16:03:36.914067    1560 main.go:141] libmachine: (addons-690000) Calling .Create
	I1030 16:03:36.914138    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:36.914296    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:36.914141    1574 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:03:36.914337    1560 main.go:141] libmachine: (addons-690000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:03:37.075945    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:37.075849    1574 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/id_rsa...
	I1030 16:03:37.255149    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:37.255092    1574 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/addons-690000.rawdisk...
	I1030 16:03:37.255167    1560 main.go:141] libmachine: (addons-690000) DBG | Writing magic tar header
	I1030 16:03:37.255177    1560 main.go:141] libmachine: (addons-690000) DBG | Writing SSH key tar header
	I1030 16:03:37.255729    1560 main.go:141] libmachine: (addons-690000) DBG | I1030 16:03:37.255693    1574 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000 ...
	I1030 16:03:37.580960    1560 main.go:141] libmachine: (addons-690000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:03:37.580975    1560 main.go:141] libmachine: (addons-690000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/addons-690000/hyperkit.pid
	I1030 16:03:37.581011    1560 main.go:141] libmachine: (addons-690000) DBG | Using UUID 8eb42508-7778-11ee-bb4d-149d997fca88
	I1030 16:03:37.619902    1560 main.go:141] libmachine: (addons-690000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:03:37.619976    1560 client.go:171] LocalClient.Create took 706.711236ms
	I1030 16:03:39.621539    1560 start.go:128] duration metric: createHost completed in 2.742906437s
	I1030 16:03:39.621594    1560 start.go:83] releasing machines lock for "addons-690000", held for 2.743111449s
	W1030 16:03:39.621694    1560 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p addons-690000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p addons-690000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:03:39.668250    1560 out.go:177] 
	W1030 16:03:39.690426    1560 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:03:39.690533    1560 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:03:39.690550    1560 out.go:239] * Related issues:
	* Related issues:
	W1030 16:03:39.690585    1560 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:03:39.690674    1560 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:03:39.734222    1560 out.go:177] 

                                                
                                                
** /stderr **
addons_test.go:111: out/minikube-darwin-amd64 start -p addons-690000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: exit status 60
--- FAIL: TestAddons/Setup (11.65s)

                                                
                                    
x
+
TestCertOptions (13.92s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-907000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-907000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : exit status 60 (13.296823178s)

                                                
                                                
-- stdout --
	* [cert-options-907000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node cert-options-907000 in cluster cert-options-907000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-options-907000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-options-907000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-907000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit " : exit status 60
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-907000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-907000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 89 (134.123493ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-907000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-907000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 89
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-907000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-907000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-907000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 89 (131.058052ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-907000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-907000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 89
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p cert-options-907000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2023-10-30 16:12:18.480867 -0700 PDT m=+558.014116107
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-907000 -n cert-options-907000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-907000 -n cert-options-907000: exit status 7 (65.540529ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-907000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-907000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-907000
--- FAIL: TestCertOptions (13.92s)

                                                
                                    
x
+
TestCertExpiration (200.15s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=3m --driver=hyperkit 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 60 (13.880530913s)

                                                
                                                
-- stdout --
	* [cert-expiration-249000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node cert-expiration-249000 in cluster cert-expiration-249000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-expiration-249000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-249000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 60
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : exit status 60 (5.791679258s)

                                                
                                                
-- stdout --
	* [cert-expiration-249000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node cert-expiration-249000 in cluster cert-expiration-249000
	* Restarting existing hyperkit VM for "cert-expiration-249000" ...
	* Restarting existing hyperkit VM for "cert-expiration-249000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-249000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-249000 --memory=2048 --cert-expiration=8760h --driver=hyperkit " : exit status 60
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-249000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node cert-expiration-249000 in cluster cert-expiration-249000
	* Restarting existing hyperkit VM for "cert-expiration-249000" ...
	* Restarting existing hyperkit VM for "cert-expiration-249000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-249000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2023-10-30 16:15:13.384074 -0700 PDT m=+732.917257093
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-249000 -n cert-expiration-249000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-249000 -n cert-expiration-249000: exit status 7 (88.140472ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-249000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-249000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-249000
--- FAIL: TestCertExpiration (200.15s)

                                                
                                    
x
+
TestDockerFlags (14.94s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-719000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-719000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (14.261408476s)

                                                
                                                
-- stdout --
	* [docker-flags-719000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node docker-flags-719000 in cluster docker-flags-719000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "docker-flags-719000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:11:49.997037    3102 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:11:49.997231    3102 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:49.997236    3102 out.go:309] Setting ErrFile to fd 2...
	I1030 16:11:49.997240    3102 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:49.997424    3102 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:11:49.998990    3102 out.go:303] Setting JSON to false
	I1030 16:11:50.022316    3102 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":685,"bootTime":1698706825,"procs":438,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:11:50.022432    3102 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:11:50.056054    3102 out.go:177] * [docker-flags-719000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:11:50.121294    3102 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:11:50.099270    3102 notify.go:220] Checking for updates...
	I1030 16:11:50.164212    3102 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:11:50.206147    3102 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:11:50.248265    3102 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:11:50.290982    3102 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:50.324166    3102 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:11:50.347079    3102 config.go:182] Loaded profile config "force-systemd-flag-731000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:50.347269    3102 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:50.347410    3102 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:11:50.382665    3102 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:11:50.424058    3102 start.go:298] selected driver: hyperkit
	I1030 16:11:50.424089    3102 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:11:50.424117    3102 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:11:50.428044    3102 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:50.428152    3102 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:11:50.436328    3102 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:11:50.440399    3102 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:50.440421    3102 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:11:50.440454    3102 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:11:50.440652    3102 start_flags.go:929] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I1030 16:11:50.440713    3102 cni.go:84] Creating CNI manager for ""
	I1030 16:11:50.440733    3102 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:11:50.440743    3102 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:11:50.440753    3102 start_flags.go:323] config:
	{Name:docker-flags-719000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:docker-flags-719000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDom
ain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1
m0s GPUs:}
	I1030 16:11:50.440918    3102 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:50.490257    3102 out.go:177] * Starting control plane node docker-flags-719000 in cluster docker-flags-719000
	I1030 16:11:50.511990    3102 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:11:50.512067    3102 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:11:50.512099    3102 cache.go:56] Caching tarball of preloaded images
	I1030 16:11:50.512306    3102 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:11:50.512325    3102 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:11:50.512482    3102 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/docker-flags-719000/config.json ...
	I1030 16:11:50.512519    3102 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/docker-flags-719000/config.json: {Name:mk9fe1f5c9c14132fffd891c3d40b8ab87480b30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:11:50.513112    3102 start.go:365] acquiring machines lock for docker-flags-719000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:52.992758    3102 start.go:369] acquired machines lock for "docker-flags-719000" in 2.479605683s
	I1030 16:11:52.992854    3102 start.go:93] Provisioning new machine with config: &{Name:docker-flags-719000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:r
oot SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:docker-flags-719000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L
MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:52.992968    3102 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:53.060399    3102 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:53.060887    3102 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:53.060961    3102 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:53.070613    3102 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50130
	I1030 16:11:53.071183    3102 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:53.071781    3102 main.go:141] libmachine: Using API Version  1
	I1030 16:11:53.071793    3102 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:53.072184    3102 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:53.072364    3102 main.go:141] libmachine: (docker-flags-719000) Calling .GetMachineName
	I1030 16:11:53.072482    3102 main.go:141] libmachine: (docker-flags-719000) Calling .DriverName
	I1030 16:11:53.072585    3102 start.go:159] libmachine.API.Create for "docker-flags-719000" (driver="hyperkit")
	I1030 16:11:53.072613    3102 client.go:168] LocalClient.Create starting
	I1030 16:11:53.072645    3102 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:53.072696    3102 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:53.072715    3102 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:53.072769    3102 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:53.072805    3102 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:53.072817    3102 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:53.072835    3102 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:53.072846    3102 main.go:141] libmachine: (docker-flags-719000) Calling .PreCreateCheck
	I1030 16:11:53.072918    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:53.073084    3102 main.go:141] libmachine: (docker-flags-719000) Calling .GetConfigRaw
	I1030 16:11:53.105204    3102 main.go:141] libmachine: Creating machine...
	I1030 16:11:53.105272    3102 main.go:141] libmachine: (docker-flags-719000) Calling .Create
	I1030 16:11:53.105515    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:53.105735    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:11:53.105506    3111 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:53.105861    3102 main.go:141] libmachine: (docker-flags-719000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:53.460278    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:11:53.460217    3111 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/id_rsa...
	I1030 16:11:53.611928    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:11:53.611805    3111 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/docker-flags-719000.rawdisk...
	I1030 16:11:53.611960    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Writing magic tar header
	I1030 16:11:53.611986    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Writing SSH key tar header
	I1030 16:11:53.612721    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:11:53.612602    3111 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000 ...
	I1030 16:11:54.101812    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:54.101846    3102 main.go:141] libmachine: (docker-flags-719000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/hyperkit.pid
	I1030 16:11:54.101936    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Using UUID b66ffb0c-7779-11ee-8bcd-149d997fca88
	I1030 16:11:54.217253    3102 main.go:141] libmachine: (docker-flags-719000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:54.217359    3102 client.go:171] LocalClient.Create took 1.144732158s
	I1030 16:11:56.219560    3102 start.go:128] duration metric: createHost completed in 3.226550988s
	I1030 16:11:56.219589    3102 start.go:83] releasing machines lock for "docker-flags-719000", held for 3.226809614s
	W1030 16:11:56.219615    3102 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:11:56.220238    3102 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:56.220297    3102 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:56.229693    3102 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50142
	I1030 16:11:56.230291    3102 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:56.230703    3102 main.go:141] libmachine: Using API Version  1
	I1030 16:11:56.230715    3102 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:56.231147    3102 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:56.231493    3102 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:56.231527    3102 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:56.239385    3102 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50144
	I1030 16:11:56.239837    3102 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:56.240269    3102 main.go:141] libmachine: Using API Version  1
	I1030 16:11:56.240280    3102 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:56.240557    3102 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:56.240682    3102 main.go:141] libmachine: (docker-flags-719000) Calling .GetState
	I1030 16:11:56.240768    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:56.240805    3102 main.go:141] libmachine: (docker-flags-719000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/hyperkit.json: no such file or directory
	I1030 16:11:56.240813    3102 main.go:141] libmachine: (docker-flags-719000) DBG | hyperkit pid from json: 0
	I1030 16:11:56.240849    3102 main.go:141] libmachine: (docker-flags-719000) Calling .DriverName
	I1030 16:11:56.306514    3102 out.go:177] * Deleting "docker-flags-719000" in hyperkit ...
	I1030 16:11:56.328433    3102 main.go:141] libmachine: (docker-flags-719000) Calling .Remove
	I1030 16:11:56.328752    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:56.328801    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:56.328824    3102 main.go:141] libmachine: (docker-flags-719000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/hyperkit.json: no such file or directory
	I1030 16:11:56.328863    3102 main.go:141] libmachine: (docker-flags-719000) DBG | hyperkit pid from json: 0
	W1030 16:11:56.346968    3102 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:56.346985    3102 start.go:706] Will try again in 5 seconds ...
	I1030 16:12:01.349201    3102 start.go:365] acquiring machines lock for docker-flags-719000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:01.349422    3102 start.go:369] acquired machines lock for "docker-flags-719000" in 141.643µs
	I1030 16:12:01.349466    3102 start.go:93] Provisioning new machine with config: &{Name:docker-flags-719000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:r
oot SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:docker-flags-719000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L
MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:12:01.349585    3102 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:12:01.371415    3102 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:12:01.371607    3102 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:01.371653    3102 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:01.380613    3102 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50152
	I1030 16:12:01.380938    3102 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:01.381309    3102 main.go:141] libmachine: Using API Version  1
	I1030 16:12:01.381324    3102 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:01.381521    3102 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:01.381637    3102 main.go:141] libmachine: (docker-flags-719000) Calling .GetMachineName
	I1030 16:12:01.381714    3102 main.go:141] libmachine: (docker-flags-719000) Calling .DriverName
	I1030 16:12:01.381810    3102 start.go:159] libmachine.API.Create for "docker-flags-719000" (driver="hyperkit")
	I1030 16:12:01.381830    3102 client.go:168] LocalClient.Create starting
	I1030 16:12:01.381854    3102 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:12:01.381901    3102 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:01.381912    3102 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:01.381949    3102 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:12:01.381990    3102 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:01.382001    3102 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:01.382015    3102 main.go:141] libmachine: Running pre-create checks...
	I1030 16:12:01.382021    3102 main.go:141] libmachine: (docker-flags-719000) Calling .PreCreateCheck
	I1030 16:12:01.382099    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:01.382144    3102 main.go:141] libmachine: (docker-flags-719000) Calling .GetConfigRaw
	I1030 16:12:01.382692    3102 main.go:141] libmachine: Creating machine...
	I1030 16:12:01.382701    3102 main.go:141] libmachine: (docker-flags-719000) Calling .Create
	I1030 16:12:01.382779    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:01.382927    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:12:01.382776    3139 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:01.382976    3102 main.go:141] libmachine: (docker-flags-719000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:12:01.541762    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:12:01.541599    3139 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/id_rsa...
	I1030 16:12:01.633694    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:12:01.633626    3139 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/docker-flags-719000.rawdisk...
	I1030 16:12:01.633705    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Writing magic tar header
	I1030 16:12:01.633736    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Writing SSH key tar header
	I1030 16:12:01.634588    3102 main.go:141] libmachine: (docker-flags-719000) DBG | I1030 16:12:01.634464    3139 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000 ...
	I1030 16:12:01.964754    3102 main.go:141] libmachine: (docker-flags-719000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:01.964777    3102 main.go:141] libmachine: (docker-flags-719000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/docker-flags-719000/hyperkit.pid
	I1030 16:12:01.964790    3102 main.go:141] libmachine: (docker-flags-719000) DBG | Using UUID bb64241c-7779-11ee-8bcd-149d997fca88
	I1030 16:12:02.001852    3102 main.go:141] libmachine: (docker-flags-719000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:02.001933    3102 client.go:171] LocalClient.Create took 620.095984ms
	I1030 16:12:04.004149    3102 start.go:128] duration metric: createHost completed in 2.654546129s
	I1030 16:12:04.004181    3102 start.go:83] releasing machines lock for "docker-flags-719000", held for 2.654744378s
	W1030 16:12:04.004356    3102 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p docker-flags-719000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p docker-flags-719000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:04.051552    3102 out.go:177] 
	W1030 16:12:04.072953    3102 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:12:04.073033    3102 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:12:04.073051    3102 out.go:239] * Related issues:
	* Related issues:
	W1030 16:12:04.073076    3102 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:12:04.073098    3102 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:12:04.095030    3102 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-719000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-719000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-719000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 89 (175.563398ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p docker-flags-719000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-719000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 89
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-719000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-719000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-719000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-719000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 89 (167.380439ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p docker-flags-719000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-719000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 89
docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-719000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-719000\"\n"
panic.go:523: *** TestDockerFlags FAILED at 2023-10-30 16:12:04.550089 -0700 PDT m=+544.083343372
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-719000 -n docker-flags-719000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-719000 -n docker-flags-719000: exit status 7 (65.505963ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-719000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-719000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-719000
--- FAIL: TestDockerFlags (14.94s)

                                                
                                    
x
+
TestForceSystemdFlag (12.15s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-731000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-731000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (11.630039312s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-731000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node force-systemd-flag-731000 in cluster force-systemd-flag-731000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-flag-731000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:11:41.612183    3075 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:11:41.612467    3075 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:41.612472    3075 out.go:309] Setting ErrFile to fd 2...
	I1030 16:11:41.612476    3075 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:41.612644    3075 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:11:41.614185    3075 out.go:303] Setting JSON to false
	I1030 16:11:41.636034    3075 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":676,"bootTime":1698706825,"procs":432,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:11:41.636135    3075 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:11:41.658872    3075 out.go:177] * [force-systemd-flag-731000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:11:41.704506    3075 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:11:41.704580    3075 notify.go:220] Checking for updates...
	I1030 16:11:41.727603    3075 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:11:41.749588    3075 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:11:41.771415    3075 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:11:41.793237    3075 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:41.814224    3075 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:11:41.838669    3075 config.go:182] Loaded profile config "force-systemd-env-343000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:41.838868    3075 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:41.839010    3075 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:11:41.868404    3075 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:11:41.910099    3075 start.go:298] selected driver: hyperkit
	I1030 16:11:41.910127    3075 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:11:41.910146    3075 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:11:41.914508    3075 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:41.914634    3075 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:11:41.922658    3075 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:11:41.926784    3075 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:41.926827    3075 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:11:41.926870    3075 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:11:41.927053    3075 start_flags.go:916] Wait components to verify : map[apiserver:true system_pods:true]
	I1030 16:11:41.927109    3075 cni.go:84] Creating CNI manager for ""
	I1030 16:11:41.927123    3075 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:11:41.927131    3075 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:11:41.927144    3075 start_flags.go:323] config:
	{Name:force-systemd-flag-731000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-flag-731000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:11:41.927275    3075 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:41.970512    3075 out.go:177] * Starting control plane node force-systemd-flag-731000 in cluster force-systemd-flag-731000
	I1030 16:11:41.993324    3075 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:11:41.993396    3075 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:11:41.993460    3075 cache.go:56] Caching tarball of preloaded images
	I1030 16:11:41.993672    3075 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:11:41.993691    3075 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:11:41.993825    3075 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/force-systemd-flag-731000/config.json ...
	I1030 16:11:41.993858    3075 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/force-systemd-flag-731000/config.json: {Name:mk854866e318b79f5570c3bb723ae8b3868fdd82 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:11:41.994627    3075 start.go:365] acquiring machines lock for force-systemd-flag-731000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:41.994754    3075 start.go:369] acquired machines lock for "force-systemd-flag-731000" in 92.355µs
	I1030 16:11:41.994809    3075 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-731000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-flag-731000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:41.994896    3075 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:42.038302    3075 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:42.038730    3075 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:42.038808    3075 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:42.047862    3075 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50110
	I1030 16:11:42.048208    3075 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:42.048644    3075 main.go:141] libmachine: Using API Version  1
	I1030 16:11:42.048656    3075 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:42.048954    3075 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:42.049085    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .GetMachineName
	I1030 16:11:42.049183    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .DriverName
	I1030 16:11:42.049298    3075 start.go:159] libmachine.API.Create for "force-systemd-flag-731000" (driver="hyperkit")
	I1030 16:11:42.049329    3075 client.go:168] LocalClient.Create starting
	I1030 16:11:42.049357    3075 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:42.049401    3075 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:42.049417    3075 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:42.049471    3075 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:42.049508    3075 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:42.049516    3075 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:42.049530    3075 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:42.049540    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .PreCreateCheck
	I1030 16:11:42.049620    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:42.049821    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .GetConfigRaw
	I1030 16:11:42.050298    3075 main.go:141] libmachine: Creating machine...
	I1030 16:11:42.050307    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .Create
	I1030 16:11:42.050378    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:42.050517    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:42.050367    3083 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:42.050567    3075 main.go:141] libmachine: (force-systemd-flag-731000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:42.208869    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:42.208761    3083 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/id_rsa...
	I1030 16:11:42.278509    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:42.278402    3083 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/force-systemd-flag-731000.rawdisk...
	I1030 16:11:42.278522    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Writing magic tar header
	I1030 16:11:42.278530    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Writing SSH key tar header
	I1030 16:11:42.279402    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:42.279288    3083 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000 ...
	I1030 16:11:42.606031    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:42.606061    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/hyperkit.pid
	I1030 16:11:42.606075    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Using UUID afde2502-7779-11ee-96e7-149d997fca88
	I1030 16:11:42.640431    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:42.640520    3075 client.go:171] LocalClient.Create took 591.180871ms
	I1030 16:11:44.642768    3075 start.go:128] duration metric: createHost completed in 2.647852333s
	I1030 16:11:44.642800    3075 start.go:83] releasing machines lock for "force-systemd-flag-731000", held for 2.648031883s
	W1030 16:11:44.642826    3075 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:11:44.643380    3075 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:44.643424    3075 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:44.652920    3075 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50112
	I1030 16:11:44.653398    3075 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:44.653885    3075 main.go:141] libmachine: Using API Version  1
	I1030 16:11:44.653897    3075 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:44.654162    3075 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:44.654559    3075 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:44.654587    3075 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:44.662417    3075 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50114
	I1030 16:11:44.662728    3075 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:44.663051    3075 main.go:141] libmachine: Using API Version  1
	I1030 16:11:44.663064    3075 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:44.663274    3075 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:44.663376    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .GetState
	I1030 16:11:44.663464    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:44.663481    3075 main.go:141] libmachine: (force-systemd-flag-731000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/hyperkit.json: no such file or directory
	I1030 16:11:44.663491    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | hyperkit pid from json: 0
	I1030 16:11:44.663532    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .DriverName
	I1030 16:11:44.685437    3075 out.go:177] * Deleting "force-systemd-flag-731000" in hyperkit ...
	I1030 16:11:44.707073    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .Remove
	I1030 16:11:44.707417    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:44.707455    3075 main.go:141] libmachine: (force-systemd-flag-731000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/hyperkit.json: no such file or directory
	I1030 16:11:44.707470    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:44.707492    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | hyperkit pid from json: 0
	W1030 16:11:44.721233    3075 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:44.721246    3075 start.go:706] Will try again in 5 seconds ...
	I1030 16:11:49.721492    3075 start.go:365] acquiring machines lock for force-systemd-flag-731000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:49.721576    3075 start.go:369] acquired machines lock for "force-systemd-flag-731000" in 59.104µs
	I1030 16:11:49.721614    3075 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-731000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-flag-731000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke
r BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:49.721668    3075 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:49.743369    3075 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:49.743508    3075 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:49.743551    3075 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:49.753001    3075 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50123
	I1030 16:11:49.753363    3075 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:49.753722    3075 main.go:141] libmachine: Using API Version  1
	I1030 16:11:49.753735    3075 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:49.753942    3075 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:49.754059    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .GetMachineName
	I1030 16:11:49.754141    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .DriverName
	I1030 16:11:49.754239    3075 start.go:159] libmachine.API.Create for "force-systemd-flag-731000" (driver="hyperkit")
	I1030 16:11:49.754257    3075 client.go:168] LocalClient.Create starting
	I1030 16:11:49.754282    3075 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:49.754320    3075 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:49.754334    3075 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:49.754371    3075 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:49.754395    3075 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:49.754411    3075 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:49.754435    3075 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:49.754441    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .PreCreateCheck
	I1030 16:11:49.754526    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:49.754569    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .GetConfigRaw
	I1030 16:11:49.765553    3075 main.go:141] libmachine: Creating machine...
	I1030 16:11:49.765581    3075 main.go:141] libmachine: (force-systemd-flag-731000) Calling .Create
	I1030 16:11:49.765866    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:49.766221    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:49.765838    3099 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:49.766386    3075 main.go:141] libmachine: (force-systemd-flag-731000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:50.522596    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:50.522502    3099 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/id_rsa...
	I1030 16:11:50.626248    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:50.626174    3099 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/force-systemd-flag-731000.rawdisk...
	I1030 16:11:50.626288    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Writing magic tar header
	I1030 16:11:50.626309    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Writing SSH key tar header
	I1030 16:11:50.627210    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | I1030 16:11:50.627058    3099 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000 ...
	I1030 16:11:50.952364    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:50.952383    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-flag-731000/hyperkit.pid
	I1030 16:11:50.952424    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | Using UUID b475d7fe-7779-11ee-96e7-149d997fca88
	I1030 16:11:50.990617    3075 main.go:141] libmachine: (force-systemd-flag-731000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:50.990695    3075 client.go:171] LocalClient.Create took 1.236430134s
	I1030 16:11:52.992622    3075 start.go:128] duration metric: createHost completed in 3.270920045s
	I1030 16:11:52.992668    3075 start.go:83] releasing machines lock for "force-systemd-flag-731000", held for 3.271080029s
	W1030 16:11:52.992781    3075 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-731000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-731000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:53.038417    3075 out.go:177] 
	W1030 16:11:53.082190    3075 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:11:53.082244    3075 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:11:53.082265    3075 out.go:239] * Related issues:
	* Related issues:
	W1030 16:11:53.082332    3075 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:11:53.082372    3075 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:11:53.126427    3075 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-731000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-731000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-731000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (173.03084ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p force-systemd-flag-731000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-731000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2023-10-30 16:11:53.366514 -0700 PDT m=+532.899772281
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-731000 -n force-systemd-flag-731000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-731000 -n force-systemd-flag-731000: exit status 7 (68.39323ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-731000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-731000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-731000
--- FAIL: TestForceSystemdFlag (12.15s)

                                                
                                    
x
+
TestForceSystemdEnv (16.51s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-343000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-343000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (15.996314772s)

                                                
                                                
-- stdout --
	* [force-systemd-env-343000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the hyperkit driver based on user configuration
	* Downloading driver docker-machine-driver-hyperkit:
	* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	* Starting control plane node force-systemd-env-343000 in cluster force-systemd-env-343000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-env-343000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:11:33.481404    3034 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:11:33.481596    3034 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:33.481602    3034 out.go:309] Setting ErrFile to fd 2...
	I1030 16:11:33.481606    3034 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:11:33.481804    3034 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:11:33.483213    3034 out.go:303] Setting JSON to false
	I1030 16:11:33.505027    3034 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":668,"bootTime":1698706825,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:11:33.505123    3034 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:11:33.527610    3034 out.go:177] * [force-systemd-env-343000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:11:33.571469    3034 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:11:33.571575    3034 notify.go:220] Checking for updates...
	I1030 16:11:33.615199    3034 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:11:33.636632    3034 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:11:33.658326    3034 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:11:33.679215    3034 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:33.700099    3034 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I1030 16:11:33.722101    3034 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:11:33.722248    3034 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:11:33.751378    3034 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:11:33.793496    3034 start.go:298] selected driver: hyperkit
	I1030 16:11:33.793524    3034 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:11:33.793543    3034 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:11:33.797893    3034 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:36.236447    3034 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	W1030 16:11:36.250118    3034 install.go:62] docker-machine-driver-hyperkit: exit status 1
	I1030 16:11:36.271950    3034 out.go:177] * Downloading driver docker-machine-driver-hyperkit:
	I1030 16:11:36.314968    3034 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit-amd64.sha256 -> /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:36.851548    3034 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit-amd64.sha256 Dst:/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540] Decompressors:map[bz2:0xc0006c51d8 gz:0xc0006c52e0 tar:0xc0006c5290 tar.bz2:0xc0006c52a0 tar.gz:0xc0006c52b0 tar.xz:0xc0006c52c0 tar.zst:0xc0006c52d0 tbz2:0xc0006c52a0 tgz:0xc0006c52b0 txz:0xc0006c52c0 tzst:0xc0006c52d0 xz:0xc0006c52e8 zip:0xc0006c5300 zst:0xc0006c5310] Getters:map[file:0xc00228e1d0 http:0xc00012e870 https:0xc00012e8c0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum:
Error downloading checksum file: bad response code: 404. trying to get the common version
	I1030 16:11:36.851631    3034 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0-beta.0/docker-machine-driver-hyperkit.sha256 -> /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:38.346599    3034 install.go:79] stdout: 
	I1030 16:11:38.369761    3034 out.go:177] * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	I1030 16:11:38.389314    3034 install.go:99] testing: [sudo -n chown root:wheel /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit]
	I1030 16:11:38.404500    3034 install.go:106] running: [sudo chown root:wheel /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit]
	I1030 16:11:38.419513    3034 install.go:99] testing: [sudo -n chmod u+s /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit]
	I1030 16:11:38.433133    3034 install.go:106] running: [sudo chmod u+s /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit]
	I1030 16:11:38.447155    3034 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:11:38.447403    3034 start_flags.go:916] Wait components to verify : map[apiserver:true system_pods:true]
	I1030 16:11:38.447461    3034 cni.go:84] Creating CNI manager for ""
	I1030 16:11:38.447473    3034 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:11:38.447480    3034 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:11:38.447493    3034 start_flags.go:323] config:
	{Name:force-systemd-env-343000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-env-343000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:11:38.447638    3034 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:11:38.469350    3034 out.go:177] * Starting control plane node force-systemd-env-343000 in cluster force-systemd-env-343000
	I1030 16:11:38.510797    3034 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:11:38.510857    3034 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:11:38.532087    3034 cache.go:56] Caching tarball of preloaded images
	I1030 16:11:38.532208    3034 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:11:38.532218    3034 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:11:38.532300    3034 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/force-systemd-env-343000/config.json ...
	I1030 16:11:38.532318    3034 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/force-systemd-env-343000/config.json: {Name:mk0315f7a47dc6035549a9e72939cdc99c681677 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:11:38.532607    3034 start.go:365] acquiring machines lock for force-systemd-env-343000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:38.532663    3034 start.go:369] acquired machines lock for "force-systemd-env-343000" in 46.16µs
	I1030 16:11:38.532687    3034 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K
ubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-env-343000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:38.532746    3034 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:38.554096    3034 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:38.554310    3034 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:38.554342    3034 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:38.864011    3034 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50094
	I1030 16:11:38.864355    3034 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:38.864796    3034 main.go:141] libmachine: Using API Version  1
	I1030 16:11:38.864807    3034 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:38.865063    3034 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:38.865175    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .GetMachineName
	I1030 16:11:38.865262    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .DriverName
	I1030 16:11:38.865375    3034 start.go:159] libmachine.API.Create for "force-systemd-env-343000" (driver="hyperkit")
	I1030 16:11:38.865399    3034 client.go:168] LocalClient.Create starting
	I1030 16:11:38.865426    3034 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:38.865473    3034 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:38.865491    3034 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:38.865543    3034 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:38.865580    3034 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:38.865590    3034 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:38.865604    3034 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:38.865615    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .PreCreateCheck
	I1030 16:11:38.865699    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:38.865871    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .GetConfigRaw
	I1030 16:11:38.866276    3034 main.go:141] libmachine: Creating machine...
	I1030 16:11:38.866288    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .Create
	I1030 16:11:38.866366    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:38.866504    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:38.866359    3062 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:38.866555    3034 main.go:141] libmachine: (force-systemd-env-343000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:39.025082    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:39.024992    3062 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/id_rsa...
	I1030 16:11:39.062107    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:39.062034    3062 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/force-systemd-env-343000.rawdisk...
	I1030 16:11:39.062121    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Writing magic tar header
	I1030 16:11:39.062135    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Writing SSH key tar header
	I1030 16:11:39.062502    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:39.062454    3062 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000 ...
	I1030 16:11:39.388977    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:39.388999    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/hyperkit.pid
	I1030 16:11:39.389031    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Using UUID adca7dce-7779-11ee-bac8-149d997fca88
	I1030 16:11:39.422230    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:39.422316    3034 client.go:171] LocalClient.Create took 556.907443ms
	I1030 16:11:41.423307    3034 start.go:128] duration metric: createHost completed in 2.890541015s
	I1030 16:11:41.423336    3034 start.go:83] releasing machines lock for "force-systemd-env-343000", held for 2.890664316s
	W1030 16:11:41.423359    3034 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:11:41.423894    3034 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:41.423936    3034 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:41.433272    3034 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50105
	I1030 16:11:41.433794    3034 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:41.434206    3034 main.go:141] libmachine: Using API Version  1
	I1030 16:11:41.434216    3034 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:41.434538    3034 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:41.434869    3034 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:41.434891    3034 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:41.442698    3034 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50107
	I1030 16:11:41.443001    3034 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:41.443348    3034 main.go:141] libmachine: Using API Version  1
	I1030 16:11:41.443366    3034 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:41.443574    3034 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:41.443682    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .GetState
	I1030 16:11:41.443756    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:41.443793    3034 main.go:141] libmachine: (force-systemd-env-343000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/hyperkit.json: no such file or directory
	I1030 16:11:41.443805    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | hyperkit pid from json: 0
	I1030 16:11:41.443824    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .DriverName
	I1030 16:11:41.501810    3034 out.go:177] * Deleting "force-systemd-env-343000" in hyperkit ...
	I1030 16:11:41.522769    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .Remove
	I1030 16:11:41.522971    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:41.523013    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:41.523026    3034 main.go:141] libmachine: (force-systemd-env-343000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/hyperkit.json: no such file or directory
	I1030 16:11:41.523043    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | hyperkit pid from json: 0
	W1030 16:11:41.535962    3034 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:41.535976    3034 start.go:706] Will try again in 5 seconds ...
	I1030 16:11:46.536526    3034 start.go:365] acquiring machines lock for force-systemd-env-343000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:11:46.536697    3034 start.go:369] acquired machines lock for "force-systemd-env-343000" in 133.716µs
	I1030 16:11:46.536739    3034 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-343000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K
ubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:force-systemd-env-343000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:11:46.536840    3034 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:11:46.558625    3034 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I1030 16:11:46.558823    3034 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:11:46.558879    3034 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:11:46.568853    3034 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50116
	I1030 16:11:46.569418    3034 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:11:46.569992    3034 main.go:141] libmachine: Using API Version  1
	I1030 16:11:46.570005    3034 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:11:46.570270    3034 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:11:46.570415    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .GetMachineName
	I1030 16:11:46.570553    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .DriverName
	I1030 16:11:46.570653    3034 start.go:159] libmachine.API.Create for "force-systemd-env-343000" (driver="hyperkit")
	I1030 16:11:46.570672    3034 client.go:168] LocalClient.Create starting
	I1030 16:11:46.570718    3034 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:11:46.570764    3034 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:46.570775    3034 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:46.570818    3034 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:11:46.570852    3034 main.go:141] libmachine: Decoding PEM data...
	I1030 16:11:46.570863    3034 main.go:141] libmachine: Parsing certificate...
	I1030 16:11:46.570882    3034 main.go:141] libmachine: Running pre-create checks...
	I1030 16:11:46.570888    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .PreCreateCheck
	I1030 16:11:46.570978    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:46.571045    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .GetConfigRaw
	I1030 16:11:46.571552    3034 main.go:141] libmachine: Creating machine...
	I1030 16:11:46.571561    3034 main.go:141] libmachine: (force-systemd-env-343000) Calling .Create
	I1030 16:11:46.571635    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:46.571776    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:46.571625    3087 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:11:46.571826    3034 main.go:141] libmachine: (force-systemd-env-343000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:11:46.767566    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:46.767476    3087 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/id_rsa...
	I1030 16:11:46.879096    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:46.879021    3087 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/force-systemd-env-343000.rawdisk...
	I1030 16:11:46.879108    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Writing magic tar header
	I1030 16:11:46.879117    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Writing SSH key tar header
	I1030 16:11:46.879894    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | I1030 16:11:46.879788    3087 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000 ...
	I1030 16:11:47.210128    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:11:47.210152    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/force-systemd-env-343000/hyperkit.pid
	I1030 16:11:47.210203    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | Using UUID b28fe556-7779-11ee-bac8-149d997fca88
	I1030 16:11:47.248035    3034 main.go:141] libmachine: (force-systemd-env-343000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:11:47.248117    3034 client.go:171] LocalClient.Create took 677.438399ms
	I1030 16:11:49.249566    3034 start.go:128] duration metric: createHost completed in 2.712697471s
	I1030 16:11:49.249610    3034 start.go:83] releasing machines lock for "force-systemd-env-343000", held for 2.712898873s
	W1030 16:11:49.249700    3034 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-343000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-343000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:11:49.295439    3034 out.go:177] 
	W1030 16:11:49.317155    3034 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:11:49.317230    3034 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:11:49.317247    3034 out.go:239] * Related issues:
	* Related issues:
	W1030 16:11:49.317289    3034 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:11:49.317311    3034 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:11:49.360294    3034 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-343000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-343000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-343000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (131.054055ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p force-systemd-env-343000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-343000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2023-10-30 16:11:49.558434 -0700 PDT m=+529.091694043
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-343000 -n force-systemd-env-343000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-343000 -n force-systemd-env-343000: exit status 7 (65.968785ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-343000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-343000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-343000
--- FAIL: TestForceSystemdEnv (16.51s)

                                                
                                    
x
+
TestErrorSpam/setup (11.13s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-465000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 --driver=hyperkit 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p nospam-465000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 --driver=hyperkit : exit status 60 (11.126585576s)

                                                
                                                
-- stdout --
	* [nospam-465000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node nospam-465000 in cluster nospam-465000
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	* Deleting "nospam-465000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p nospam-465000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-amd64 start -p nospam-465000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 --driver=hyperkit " failed: exit status 60
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Failed to start hyperkit VM. Running \"minikube delete -p nospam-465000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Suggestion: "
error_spam_test.go:96: unexpected stderr: "    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing."
error_spam_test.go:96: unexpected stderr: "    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver."
error_spam_test.go:96: unexpected stderr: "* Related issues:"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/6028"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/5594"
error_spam_test.go:110: minikube stdout:
* [nospam-465000] minikube v1.32.0-beta.0 on Darwin 14.1
- MINIKUBE_LOCATION=17527
- KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting control plane node nospam-465000 in cluster nospam-465000
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
* Deleting "nospam-465000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Failed to start hyperkit VM. Running "minikube delete -p nospam-465000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (11.13s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (11.31s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 
functional_test.go:2230: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-621000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : exit status 60 (11.244677155s)

                                                
                                                
-- stdout --
	* [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node functional-621000 in cluster functional-621000
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "functional-621000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
	* Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:2232: failed minikube start. args "out/minikube-darwin-amd64 start -p functional-621000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit ": exit status 60
functional_test.go:2237: start stdout=* [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
- MINIKUBE_LOCATION=17527
- KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting control plane node functional-621000 in cluster functional-621000
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
* Deleting "functional-621000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2242: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
! Local proxy ignored: not passing HTTP_PROXY=localhost:49417 to docker env.
* Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (66.427689ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (11.31s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.83s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-621000 --alsologtostderr -v=8: exit status 60 (5.764600618s)

                                                
                                                
-- stdout --
	* [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node functional-621000 in cluster functional-621000
	* Restarting existing hyperkit VM for "functional-621000" ...
	* Restarting existing hyperkit VM for "functional-621000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:04:05.784241    1684 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:04:05.784457    1684 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:04:05.784462    1684 out.go:309] Setting ErrFile to fd 2...
	I1030 16:04:05.784466    1684 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:04:05.784649    1684 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:04:05.786021    1684 out.go:303] Setting JSON to false
	I1030 16:04:05.808019    1684 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":220,"bootTime":1698706825,"procs":411,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:04:05.808109    1684 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:04:05.829686    1684 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:04:05.872526    1684 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:04:05.872623    1684 notify.go:220] Checking for updates...
	I1030 16:04:05.894431    1684 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:04:05.916272    1684 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:04:05.938271    1684 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:04:05.959260    1684 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:04:05.980276    1684 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:04:06.001933    1684 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:04:06.002107    1684 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:04:06.002748    1684 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:06.002827    1684 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:06.011776    1684 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49435
	I1030 16:04:06.012140    1684 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:06.012550    1684 main.go:141] libmachine: Using API Version  1
	I1030 16:04:06.012563    1684 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:06.012817    1684 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:06.012938    1684 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:06.041448    1684 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:04:06.084356    1684 start.go:298] selected driver: hyperkit
	I1030 16:04:06.084384    1684 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:04:06.084552    1684 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:04:06.084731    1684 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:04:06.084942    1684 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:04:06.094136    1684 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:04:06.098042    1684 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:06.098059    1684 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:04:06.100708    1684 cni.go:84] Creating CNI manager for ""
	I1030 16:04:06.100730    1684 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:04:06.100743    1684 start_flags.go:323] config:
	{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO
ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:04:06.100921    1684 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:04:06.144155    1684 out.go:177] * Starting control plane node functional-621000 in cluster functional-621000
	I1030 16:04:06.165372    1684 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:04:06.165442    1684 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:04:06.165465    1684 cache.go:56] Caching tarball of preloaded images
	I1030 16:04:06.165641    1684 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:04:06.165659    1684 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:04:06.165825    1684 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/functional-621000/config.json ...
	I1030 16:04:06.166628    1684 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:04:06.166726    1684 start.go:369] acquired machines lock for "functional-621000" in 73.772µs
	I1030 16:04:06.166762    1684 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:04:06.166783    1684 fix.go:54] fixHost starting: 
	I1030 16:04:06.167211    1684 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:06.167248    1684 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:06.175779    1684 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49437
	I1030 16:04:06.176093    1684 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:06.176468    1684 main.go:141] libmachine: Using API Version  1
	I1030 16:04:06.176482    1684 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:06.176686    1684 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:06.176819    1684 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:06.176924    1684 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:04:06.177010    1684 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:06.177040    1684 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:04:06.177082    1684 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:04:06.177080    1684 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
	I1030 16:04:06.177098    1684 main.go:141] libmachine: (functional-621000) Calling .DriverName
	W1030 16:04:06.177185    1684 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:04:06.198269    1684 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
	I1030 16:04:06.240170    1684 main.go:141] libmachine: (functional-621000) Calling .Start
	I1030 16:04:06.240501    1684 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:06.240545    1684 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
	I1030 16:04:06.240699    1684 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
	I1030 16:04:06.243042    1684 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:04:06.243137    1684 fix.go:56] fixHost completed within 76.36236ms
	I1030 16:04:06.243153    1684 start.go:83] releasing machines lock for "functional-621000", held for 76.414637ms
	W1030 16:04:06.243170    1684 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:04:06.243246    1684 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:04:06.243254    1684 start.go:706] Will try again in 5 seconds ...
	I1030 16:04:11.243393    1684 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:04:11.243553    1684 start.go:369] acquired machines lock for "functional-621000" in 117.925µs
	I1030 16:04:11.243592    1684 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:04:11.243606    1684 fix.go:54] fixHost starting: 
	I1030 16:04:11.243968    1684 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:11.244019    1684 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:11.252746    1684 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49439
	I1030 16:04:11.253092    1684 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:11.253437    1684 main.go:141] libmachine: Using API Version  1
	I1030 16:04:11.253450    1684 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:11.253657    1684 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:11.253762    1684 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:11.253860    1684 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:04:11.253936    1684 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:11.253978    1684 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
	I1030 16:04:11.253987    1684 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:04:11.253988    1684 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:11.254001    1684 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	W1030 16:04:11.254087    1684 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:04:11.275877    1684 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
	I1030 16:04:11.318701    1684 main.go:141] libmachine: (functional-621000) Calling .Start
	I1030 16:04:11.318987    1684 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:11.319028    1684 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
	I1030 16:04:11.319110    1684 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
	I1030 16:04:11.321418    1684 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:04:11.321553    1684 fix.go:56] fixHost completed within 77.945753ms
	I1030 16:04:11.321571    1684 start.go:83] releasing machines lock for "functional-621000", held for 78.002691ms
	W1030 16:04:11.321679    1684 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:04:11.365386    1684 out.go:177] 
	W1030 16:04:11.387657    1684 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:04:11.387735    1684 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:04:11.387755    1684 out.go:239] * Related issues:
	* Related issues:
	W1030 16:04:11.387782    1684 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:04:11.387823    1684 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:04:11.431396    1684 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-amd64 start -p functional-621000 --alsologtostderr -v=8": exit status 60
functional_test.go:659: soft start took 5.766107582s for "functional-621000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (66.121696ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.83s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
functional_test.go:677: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (36.590523ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:679: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:683: expected current-context = "functional-621000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (66.871211ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.10s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-621000 get po -A
functional_test.go:692: (dbg) Non-zero exit: kubectl --context functional-621000 get po -A: exit status 1 (38.72173ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:694: failed to get kubectl pods: args "kubectl --context functional-621000 get po -A" : exit status 1
functional_test.go:698: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-621000\n"*: args "kubectl --context functional-621000 get po -A"
functional_test.go:701: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-621000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (67.115054ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl images
functional_test.go:1120: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl images: exit status 89 (130.892582ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1122: failed to get images by "out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl images" ssh exit status 89
functional_test.go:1126: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.13s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.49s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1143: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 89 (131.246767ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1146: failed to manually delete image "out/minikube-darwin-amd64 -p functional-621000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 89
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 89 (132.179192ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 89 (132.695425ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1161: expected "out/minikube-darwin-amd64 -p functional-621000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 89
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.49s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 kubectl -- --context functional-621000 get pods
functional_test.go:712: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 kubectl -- --context functional-621000 get pods: exit status 1 (56.442153ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
functional_test.go:715: failed to get pods. args "out/minikube-darwin-amd64 -p functional-621000 kubectl -- --context functional-621000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (65.635904ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (1.39s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-621000 get pods
functional_test.go:737: (dbg) Non-zero exit: out/kubectl --context functional-621000 get pods: exit status 1 (687.558171ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
functional_test.go:740: failed to run kubectl directly. args "out/kubectl --context functional-621000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (700.78786ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (1.39s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.88s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-621000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 60 (5.807489838s)

                                                
                                                
-- stdout --
	* [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node functional-621000 in cluster functional-621000
	* Restarting existing hyperkit VM for "functional-621000" ...
	* Restarting existing hyperkit VM for "functional-621000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:755: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-621000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 60
functional_test.go:757: restart took 5.807767006s for "functional-621000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (69.938597ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.88s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-621000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:806: (dbg) Non-zero exit: kubectl --context functional-621000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (36.917896ms)

                                                
                                                
** stderr ** 
	error: context "functional-621000" does not exist

                                                
                                                
** /stderr **
functional_test.go:808: failed to get components. args "kubectl --context functional-621000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (67.195951ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.32s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 logs
functional_test.go:1232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 logs: exit status 89 (315.503728ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
	| Command |                                   Args                                   |       Profile        |  User   |    Version     |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
	| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
	|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
	|         | --kubernetes-version=v1.16.0                                             |                      |         |                |                     |                     |
	|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
	|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
	| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
	|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
	|         | --kubernetes-version=v1.28.3                                             |                      |         |                |                     |                     |
	|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
	|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
	| delete  | --all                                                                    | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| start   | --download-only -p                                                       | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | binary-mirror-500000                                                     |                      |         |                |                     |                     |
	|         | --alsologtostderr                                                        |                      |         |                |                     |                     |
	|         | --binary-mirror                                                          |                      |         |                |                     |                     |
	|         | http://127.0.0.1:49336                                                   |                      |         |                |                     |                     |
	|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
	| delete  | -p binary-mirror-500000                                                  | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| addons  | enable dashboard -p                                                      | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | addons-690000                                                            |                      |         |                |                     |                     |
	| addons  | disable dashboard -p                                                     | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | addons-690000                                                            |                      |         |                |                     |                     |
	| start   | -p addons-690000 --wait=true                                             | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | --memory=4000 --alsologtostderr                                          |                      |         |                |                     |                     |
	|         | --addons=registry                                                        |                      |         |                |                     |                     |
	|         | --addons=metrics-server                                                  |                      |         |                |                     |                     |
	|         | --addons=volumesnapshots                                                 |                      |         |                |                     |                     |
	|         | --addons=csi-hostpath-driver                                             |                      |         |                |                     |                     |
	|         | --addons=gcp-auth                                                        |                      |         |                |                     |                     |
	|         | --addons=cloud-spanner                                                   |                      |         |                |                     |                     |
	|         | --addons=inspektor-gadget                                                |                      |         |                |                     |                     |
	|         | --addons=storage-provisioner-rancher                                     |                      |         |                |                     |                     |
	|         | --addons=nvidia-device-plugin                                            |                      |         |                |                     |                     |
	|         | --driver=hyperkit  --addons=ingress                                      |                      |         |                |                     |                     |
	|         | --addons=ingress-dns                                                     |                      |         |                |                     |                     |
	|         | --addons=helm-tiller                                                     |                      |         |                |                     |                     |
	| delete  | -p addons-690000                                                         | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| start   | -p nospam-465000 -n=1 --memory=2250 --wait=false                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 |                      |         |                |                     |                     |
	|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
	| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | start --dry-run                                                          |                      |         |                |                     |                     |
	| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | start --dry-run                                                          |                      |         |                |                     |                     |
	| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | start --dry-run                                                          |                      |         |                |                     |                     |
	| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | pause                                                                    |                      |         |                |                     |                     |
	| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | pause                                                                    |                      |         |                |                     |                     |
	| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | pause                                                                    |                      |         |                |                     |                     |
	| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | unpause                                                                  |                      |         |                |                     |                     |
	| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | unpause                                                                  |                      |         |                |                     |                     |
	| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | unpause                                                                  |                      |         |                |                     |                     |
	| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | stop                                                                     |                      |         |                |                     |                     |
	| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | stop                                                                     |                      |         |                |                     |                     |
	| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
	|         | stop                                                                     |                      |         |                |                     |                     |
	| delete  | -p nospam-465000                                                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
	| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
	|         | --memory=4000                                                            |                      |         |                |                     |                     |
	|         | --apiserver-port=8441                                                    |                      |         |                |                     |                     |
	|         | --wait=all --driver=hyperkit                                             |                      |         |                |                     |                     |
	| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | --alsologtostderr -v=8                                                   |                      |         |                |                     |                     |
	| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
	| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
	| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
	| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
	| cache   | functional-621000 cache delete                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
	| cache   | list                                                                     | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	| ssh     | functional-621000 ssh sudo                                               | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | crictl images                                                            |                      |         |                |                     |                     |
	| ssh     | functional-621000                                                        | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | ssh sudo docker rmi                                                      |                      |         |                |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
	| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
	| cache   | functional-621000 cache reload                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
	|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
	| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
	|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
	| kubectl | functional-621000 kubectl --                                             | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | --context functional-621000                                              |                      |         |                |                     |                     |
	|         | get pods                                                                 |                      |         |                |                     |                     |
	| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |                |                     |                     |
	|         | --wait=all                                                               |                      |         |                |                     |                     |
	|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 16:04:17
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.21.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 16:04:17.773939    1781 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:04:17.774128    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:04:17.774130    1781 out.go:309] Setting ErrFile to fd 2...
	I1030 16:04:17.774133    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:04:17.774305    1781 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:04:17.775599    1781 out.go:303] Setting JSON to false
	I1030 16:04:17.797535    1781 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":232,"bootTime":1698706825,"procs":420,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:04:17.797625    1781 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:04:17.819256    1781 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:04:17.863016    1781 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:04:17.863180    1781 notify.go:220] Checking for updates...
	I1030 16:04:17.885147    1781 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:04:17.907138    1781 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:04:17.928945    1781 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:04:17.951013    1781 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:04:17.973024    1781 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:04:17.995522    1781 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:04:17.995682    1781 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:04:17.996306    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:17.996377    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:18.005315    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49489
	I1030 16:04:18.005686    1781 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:18.006095    1781 main.go:141] libmachine: Using API Version  1
	I1030 16:04:18.006105    1781 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:18.006356    1781 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:18.006473    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:18.034924    1781 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:04:18.056876    1781 start.go:298] selected driver: hyperkit
	I1030 16:04:18.056893    1781 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:04:18.057096    1781 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:04:18.057267    1781 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:04:18.057446    1781 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:04:18.066456    1781 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:04:18.070190    1781 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:18.070202    1781 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:04:18.072788    1781 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:04:18.072853    1781 cni.go:84] Creating CNI manager for ""
	I1030 16:04:18.072863    1781 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:04:18.072872    1781 start_flags.go:323] config:
	{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:04:18.073025    1781 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:04:18.115944    1781 out.go:177] * Starting control plane node functional-621000 in cluster functional-621000
	I1030 16:04:18.137945    1781 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:04:18.138026    1781 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:04:18.138047    1781 cache.go:56] Caching tarball of preloaded images
	I1030 16:04:18.138274    1781 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:04:18.138287    1781 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:04:18.138465    1781 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/functional-621000/config.json ...
	I1030 16:04:18.139295    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:04:18.139402    1781 start.go:369] acquired machines lock for "functional-621000" in 83.668µs
	I1030 16:04:18.139431    1781 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:04:18.139445    1781 fix.go:54] fixHost starting: 
	I1030 16:04:18.139897    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:18.139929    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:18.148298    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49491
	I1030 16:04:18.148628    1781 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:18.148983    1781 main.go:141] libmachine: Using API Version  1
	I1030 16:04:18.148989    1781 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:18.149202    1781 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:18.149311    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:18.149420    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:04:18.149496    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:18.149518    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:04:18.149522    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:04:18.149543    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
	I1030 16:04:18.149555    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
	W1030 16:04:18.149639    1781 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:04:18.192014    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
	I1030 16:04:18.213961    1781 main.go:141] libmachine: (functional-621000) Calling .Start
	I1030 16:04:18.214248    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:18.214286    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
	I1030 16:04:18.214388    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
	I1030 16:04:18.251698    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:04:18.251805    1781 fix.go:56] fixHost completed within 112.365367ms
	I1030 16:04:18.251821    1781 start.go:83] releasing machines lock for "functional-621000", held for 112.405993ms
	W1030 16:04:18.251832    1781 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:04:18.251877    1781 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:04:18.251885    1781 start.go:706] Will try again in 5 seconds ...
	I1030 16:04:23.254111    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:04:23.254245    1781 start.go:369] acquired machines lock for "functional-621000" in 114.535µs
	I1030 16:04:23.254277    1781 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:04:23.254281    1781 fix.go:54] fixHost starting: 
	I1030 16:04:23.254748    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:04:23.254784    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:04:23.264680    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49493
	I1030 16:04:23.265263    1781 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:04:23.265737    1781 main.go:141] libmachine: Using API Version  1
	I1030 16:04:23.265754    1781 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:04:23.266105    1781 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:04:23.266307    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:04:23.266404    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:04:23.266477    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:23.266494    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:04:23.266504    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:04:23.266528    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
	I1030 16:04:23.266533    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
	W1030 16:04:23.266617    1781 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:04:23.288344    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
	I1030 16:04:23.332191    1781 main.go:141] libmachine: (functional-621000) Calling .Start
	I1030 16:04:23.332469    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:04:23.332501    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
	I1030 16:04:23.332583    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
	I1030 16:04:23.334852    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:04:23.334948    1781 fix.go:56] fixHost completed within 80.665501ms
	I1030 16:04:23.334956    1781 start.go:83] releasing machines lock for "functional-621000", held for 80.704784ms
	W1030 16:04:23.335016    1781 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:04:23.377103    1781 out.go:177] 
	W1030 16:04:23.398349    1781 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:04:23.398425    1781 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:04:23.398443    1781 out.go:239] * Related issues:
	W1030 16:04:23.398459    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:04:23.398514    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:04:23.441244    1781 out.go:177] 
	
	* 
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1234: out/minikube-darwin-amd64 -p functional-621000 logs failed: exit status 89
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
**** 
* ==> Audit <==
* |---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
| Command |                                   Args                                   |       Profile        |  User   |    Version     |     Start Time      |      End Time       |
|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
|         | --kubernetes-version=v1.16.0                                             |                      |         |                |                     |                     |
|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
|         | --kubernetes-version=v1.28.3                                             |                      |         |                |                     |                     |
|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | --download-only -p                                                       | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | binary-mirror-500000                                                     |                      |         |                |                     |                     |
|         | --alsologtostderr                                                        |                      |         |                |                     |                     |
|         | --binary-mirror                                                          |                      |         |                |                     |                     |
|         | http://127.0.0.1:49336                                                   |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| delete  | -p binary-mirror-500000                                                  | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| addons  | enable dashboard -p                                                      | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | addons-690000                                                            |                      |         |                |                     |                     |
| addons  | disable dashboard -p                                                     | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | addons-690000                                                            |                      |         |                |                     |                     |
| start   | -p addons-690000 --wait=true                                             | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --memory=4000 --alsologtostderr                                          |                      |         |                |                     |                     |
|         | --addons=registry                                                        |                      |         |                |                     |                     |
|         | --addons=metrics-server                                                  |                      |         |                |                     |                     |
|         | --addons=volumesnapshots                                                 |                      |         |                |                     |                     |
|         | --addons=csi-hostpath-driver                                             |                      |         |                |                     |                     |
|         | --addons=gcp-auth                                                        |                      |         |                |                     |                     |
|         | --addons=cloud-spanner                                                   |                      |         |                |                     |                     |
|         | --addons=inspektor-gadget                                                |                      |         |                |                     |                     |
|         | --addons=storage-provisioner-rancher                                     |                      |         |                |                     |                     |
|         | --addons=nvidia-device-plugin                                            |                      |         |                |                     |                     |
|         | --driver=hyperkit  --addons=ingress                                      |                      |         |                |                     |                     |
|         | --addons=ingress-dns                                                     |                      |         |                |                     |                     |
|         | --addons=helm-tiller                                                     |                      |         |                |                     |                     |
| delete  | -p addons-690000                                                         | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | -p nospam-465000 -n=1 --memory=2250 --wait=false                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| delete  | -p nospam-465000                                                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --memory=4000                                                            |                      |         |                |                     |                     |
|         | --apiserver-port=8441                                                    |                      |         |                |                     |                     |
|         | --wait=all --driver=hyperkit                                             |                      |         |                |                     |                     |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --alsologtostderr -v=8                                                   |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
| cache   | functional-621000 cache delete                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
| cache   | list                                                                     | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
| ssh     | functional-621000 ssh sudo                                               | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | crictl images                                                            |                      |         |                |                     |                     |
| ssh     | functional-621000                                                        | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | ssh sudo docker rmi                                                      |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | functional-621000 cache reload                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| kubectl | functional-621000 kubectl --                                             | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --context functional-621000                                              |                      |         |                |                     |                     |
|         | get pods                                                                 |                      |         |                |                     |                     |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |                |                     |                     |
|         | --wait=all                                                               |                      |         |                |                     |                     |
|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|

                                                
                                                
* 
* ==> Last Start <==
* Log file created at: 2023/10/30 16:04:17
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.21.3 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1030 16:04:17.773939    1781 out.go:296] Setting OutFile to fd 1 ...
I1030 16:04:17.774128    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:17.774130    1781 out.go:309] Setting ErrFile to fd 2...
I1030 16:04:17.774133    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:17.774305    1781 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:04:17.775599    1781 out.go:303] Setting JSON to false
I1030 16:04:17.797535    1781 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":232,"bootTime":1698706825,"procs":420,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W1030 16:04:17.797625    1781 start.go:136] gopshost.Virtualization returned error: not implemented yet
I1030 16:04:17.819256    1781 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
I1030 16:04:17.863016    1781 out.go:177]   - MINIKUBE_LOCATION=17527
I1030 16:04:17.863180    1781 notify.go:220] Checking for updates...
I1030 16:04:17.885147    1781 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
I1030 16:04:17.907138    1781 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I1030 16:04:17.928945    1781 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1030 16:04:17.951013    1781 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
I1030 16:04:17.973024    1781 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I1030 16:04:17.995522    1781 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:04:17.995682    1781 driver.go:378] Setting default libvirt URI to qemu:///system
I1030 16:04:17.996306    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:17.996377    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:18.005315    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49489
I1030 16:04:18.005686    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:18.006095    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:18.006105    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:18.006356    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:18.006473    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:18.034924    1781 out.go:177] * Using the hyperkit driver based on existing profile
I1030 16:04:18.056876    1781 start.go:298] selected driver: hyperkit
I1030 16:04:18.056893    1781 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1030 16:04:18.057096    1781 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1030 16:04:18.057267    1781 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1030 16:04:18.057446    1781 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I1030 16:04:18.066456    1781 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
I1030 16:04:18.070190    1781 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:18.070202    1781 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I1030 16:04:18.072788    1781 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1030 16:04:18.072853    1781 cni.go:84] Creating CNI manager for ""
I1030 16:04:18.072863    1781 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1030 16:04:18.072872    1781 start_flags.go:323] config:
{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 M
ountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1030 16:04:18.073025    1781 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1030 16:04:18.115944    1781 out.go:177] * Starting control plane node functional-621000 in cluster functional-621000
I1030 16:04:18.137945    1781 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
I1030 16:04:18.138026    1781 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
I1030 16:04:18.138047    1781 cache.go:56] Caching tarball of preloaded images
I1030 16:04:18.138274    1781 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1030 16:04:18.138287    1781 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
I1030 16:04:18.138465    1781 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/functional-621000/config.json ...
I1030 16:04:18.139295    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1030 16:04:18.139402    1781 start.go:369] acquired machines lock for "functional-621000" in 83.668µs
I1030 16:04:18.139431    1781 start.go:96] Skipping create...Using existing machine configuration
I1030 16:04:18.139445    1781 fix.go:54] fixHost starting: 
I1030 16:04:18.139897    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:18.139929    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:18.148298    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49491
I1030 16:04:18.148628    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:18.148983    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:18.148989    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:18.149202    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:18.149311    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:18.149420    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:04:18.149496    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:18.149518    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:04:18.149522    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:04:18.149543    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
I1030 16:04:18.149555    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
W1030 16:04:18.149639    1781 fix.go:128] unexpected machine state, will restart: <nil>
I1030 16:04:18.192014    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
I1030 16:04:18.213961    1781 main.go:141] libmachine: (functional-621000) Calling .Start
I1030 16:04:18.214248    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:18.214286    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
I1030 16:04:18.214388    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
I1030 16:04:18.251698    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I1030 16:04:18.251805    1781 fix.go:56] fixHost completed within 112.365367ms
I1030 16:04:18.251821    1781 start.go:83] releasing machines lock for "functional-621000", held for 112.405993ms
W1030 16:04:18.251832    1781 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W1030 16:04:18.251877    1781 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I1030 16:04:18.251885    1781 start.go:706] Will try again in 5 seconds ...
I1030 16:04:23.254111    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1030 16:04:23.254245    1781 start.go:369] acquired machines lock for "functional-621000" in 114.535µs
I1030 16:04:23.254277    1781 start.go:96] Skipping create...Using existing machine configuration
I1030 16:04:23.254281    1781 fix.go:54] fixHost starting: 
I1030 16:04:23.254748    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:23.254784    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:23.264680    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49493
I1030 16:04:23.265263    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:23.265737    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:23.265754    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:23.266105    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:23.266307    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:23.266404    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:04:23.266477    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:23.266494    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:04:23.266504    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:04:23.266528    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
I1030 16:04:23.266533    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
W1030 16:04:23.266617    1781 fix.go:128] unexpected machine state, will restart: <nil>
I1030 16:04:23.288344    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
I1030 16:04:23.332191    1781 main.go:141] libmachine: (functional-621000) Calling .Start
I1030 16:04:23.332469    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:23.332501    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
I1030 16:04:23.332583    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
I1030 16:04:23.334852    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I1030 16:04:23.334948    1781 fix.go:56] fixHost completed within 80.665501ms
I1030 16:04:23.334956    1781 start.go:83] releasing machines lock for "functional-621000", held for 80.704784ms
W1030 16:04:23.335016    1781 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I1030 16:04:23.377103    1781 out.go:177] 
W1030 16:04:23.398349    1781 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W1030 16:04:23.398425    1781 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W1030 16:04:23.398443    1781 out.go:239] * Related issues:
W1030 16:04:23.398459    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W1030 16:04:23.398514    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I1030 16:04:23.441244    1781 out.go:177] 

                                                
                                                
* 
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.32s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.27s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 logs --file /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialLogsFileCmd3517179706/001/logs.txt
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
**** 
* ==> Audit <==
* |---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
| Command |                                   Args                                   |       Profile        |  User   |    Version     |     Start Time      |      End Time       |
|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|
| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
|         | --kubernetes-version=v1.16.0                                             |                      |         |                |                     |                     |
|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| start   | -o=json --download-only                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | -p download-only-255000                                                  |                      |         |                |                     |                     |
|         | --force --alsologtostderr                                                |                      |         |                |                     |                     |
|         | --kubernetes-version=v1.28.3                                             |                      |         |                |                     |                     |
|         | --container-runtime=docker                                               |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| delete  | --all                                                                    | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| delete  | -p download-only-255000                                                  | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | --download-only -p                                                       | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | binary-mirror-500000                                                     |                      |         |                |                     |                     |
|         | --alsologtostderr                                                        |                      |         |                |                     |                     |
|         | --binary-mirror                                                          |                      |         |                |                     |                     |
|         | http://127.0.0.1:49336                                                   |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| delete  | -p binary-mirror-500000                                                  | binary-mirror-500000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| addons  | enable dashboard -p                                                      | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | addons-690000                                                            |                      |         |                |                     |                     |
| addons  | disable dashboard -p                                                     | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | addons-690000                                                            |                      |         |                |                     |                     |
| start   | -p addons-690000 --wait=true                                             | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --memory=4000 --alsologtostderr                                          |                      |         |                |                     |                     |
|         | --addons=registry                                                        |                      |         |                |                     |                     |
|         | --addons=metrics-server                                                  |                      |         |                |                     |                     |
|         | --addons=volumesnapshots                                                 |                      |         |                |                     |                     |
|         | --addons=csi-hostpath-driver                                             |                      |         |                |                     |                     |
|         | --addons=gcp-auth                                                        |                      |         |                |                     |                     |
|         | --addons=cloud-spanner                                                   |                      |         |                |                     |                     |
|         | --addons=inspektor-gadget                                                |                      |         |                |                     |                     |
|         | --addons=storage-provisioner-rancher                                     |                      |         |                |                     |                     |
|         | --addons=nvidia-device-plugin                                            |                      |         |                |                     |                     |
|         | --driver=hyperkit  --addons=ingress                                      |                      |         |                |                     |                     |
|         | --addons=ingress-dns                                                     |                      |         |                |                     |                     |
|         | --addons=helm-tiller                                                     |                      |         |                |                     |                     |
| delete  | -p addons-690000                                                         | addons-690000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | -p nospam-465000 -n=1 --memory=2250 --wait=false                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 |                      |         |                |                     |                     |
|         | --driver=hyperkit                                                        |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| start   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | start --dry-run                                                          |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| pause   | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | pause                                                                    |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| unpause | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | unpause                                                                  |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| stop    | nospam-465000 --log_dir                                                  | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000           |                      |         |                |                     |                     |
|         | stop                                                                     |                      |         |                |                     |                     |
| delete  | -p nospam-465000                                                         | nospam-465000        | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT | 30 Oct 23 16:03 PDT |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |                     |
|         | --memory=4000                                                            |                      |         |                |                     |                     |
|         | --apiserver-port=8441                                                    |                      |         |                |                     |                     |
|         | --wait=all --driver=hyperkit                                             |                      |         |                |                     |                     |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --alsologtostderr -v=8                                                   |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | functional-621000 cache add                                              | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
| cache   | functional-621000 cache delete                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | minikube-local-cache-test:functional-621000                              |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.3                                                |                      |         |                |                     |                     |
| cache   | list                                                                     | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
| ssh     | functional-621000 ssh sudo                                               | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | crictl images                                                            |                      |         |                |                     |                     |
| ssh     | functional-621000                                                        | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | ssh sudo docker rmi                                                      |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | functional-621000 cache reload                                           | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
| ssh     | functional-621000 ssh                                                    | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | sudo crictl inspecti                                                     |                      |         |                |                     |                     |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:3.1                                                |                      |         |                |                     |                     |
| cache   | delete                                                                   | minikube             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT | 30 Oct 23 16:04 PDT |
|         | registry.k8s.io/pause:latest                                             |                      |         |                |                     |                     |
| kubectl | functional-621000 kubectl --                                             | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --context functional-621000                                              |                      |         |                |                     |                     |
|         | get pods                                                                 |                      |         |                |                     |                     |
| start   | -p functional-621000                                                     | functional-621000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:04 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                      |         |                |                     |                     |
|         | --wait=all                                                               |                      |         |                |                     |                     |
|---------|--------------------------------------------------------------------------|----------------------|---------|----------------|---------------------|---------------------|

                                                
                                                
* 
* ==> Last Start <==
* Log file created at: 2023/10/30 16:04:17
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.21.3 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1030 16:04:17.773939    1781 out.go:296] Setting OutFile to fd 1 ...
I1030 16:04:17.774128    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:17.774130    1781 out.go:309] Setting ErrFile to fd 2...
I1030 16:04:17.774133    1781 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:17.774305    1781 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:04:17.775599    1781 out.go:303] Setting JSON to false
I1030 16:04:17.797535    1781 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":232,"bootTime":1698706825,"procs":420,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W1030 16:04:17.797625    1781 start.go:136] gopshost.Virtualization returned error: not implemented yet
I1030 16:04:17.819256    1781 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
I1030 16:04:17.863016    1781 out.go:177]   - MINIKUBE_LOCATION=17527
I1030 16:04:17.863180    1781 notify.go:220] Checking for updates...
I1030 16:04:17.885147    1781 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
I1030 16:04:17.907138    1781 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I1030 16:04:17.928945    1781 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1030 16:04:17.951013    1781 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
I1030 16:04:17.973024    1781 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I1030 16:04:17.995522    1781 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:04:17.995682    1781 driver.go:378] Setting default libvirt URI to qemu:///system
I1030 16:04:17.996306    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:17.996377    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:18.005315    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49489
I1030 16:04:18.005686    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:18.006095    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:18.006105    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:18.006356    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:18.006473    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:18.034924    1781 out.go:177] * Using the hyperkit driver based on existing profile
I1030 16:04:18.056876    1781 start.go:298] selected driver: hyperkit
I1030 16:04:18.056893    1781 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1030 16:04:18.057096    1781 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1030 16:04:18.057267    1781 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1030 16:04:18.057446    1781 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I1030 16:04:18.066456    1781 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
I1030 16:04:18.070190    1781 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:18.070202    1781 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I1030 16:04:18.072788    1781 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1030 16:04:18.072853    1781 cni.go:84] Creating CNI manager for ""
I1030 16:04:18.072863    1781 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1030 16:04:18.072872    1781 start_flags.go:323] config:
{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 M
ountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1030 16:04:18.073025    1781 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1030 16:04:18.115944    1781 out.go:177] * Starting control plane node functional-621000 in cluster functional-621000
I1030 16:04:18.137945    1781 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
I1030 16:04:18.138026    1781 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
I1030 16:04:18.138047    1781 cache.go:56] Caching tarball of preloaded images
I1030 16:04:18.138274    1781 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1030 16:04:18.138287    1781 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
I1030 16:04:18.138465    1781 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/functional-621000/config.json ...
I1030 16:04:18.139295    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1030 16:04:18.139402    1781 start.go:369] acquired machines lock for "functional-621000" in 83.668µs
I1030 16:04:18.139431    1781 start.go:96] Skipping create...Using existing machine configuration
I1030 16:04:18.139445    1781 fix.go:54] fixHost starting: 
I1030 16:04:18.139897    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:18.139929    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:18.148298    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49491
I1030 16:04:18.148628    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:18.148983    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:18.148989    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:18.149202    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:18.149311    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:18.149420    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:04:18.149496    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:18.149518    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:04:18.149522    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:04:18.149543    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
I1030 16:04:18.149555    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
W1030 16:04:18.149639    1781 fix.go:128] unexpected machine state, will restart: <nil>
I1030 16:04:18.192014    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
I1030 16:04:18.213961    1781 main.go:141] libmachine: (functional-621000) Calling .Start
I1030 16:04:18.214248    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:18.214286    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
I1030 16:04:18.214388    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
I1030 16:04:18.251698    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I1030 16:04:18.251805    1781 fix.go:56] fixHost completed within 112.365367ms
I1030 16:04:18.251821    1781 start.go:83] releasing machines lock for "functional-621000", held for 112.405993ms
W1030 16:04:18.251832    1781 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W1030 16:04:18.251877    1781 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I1030 16:04:18.251885    1781 start.go:706] Will try again in 5 seconds ...
I1030 16:04:23.254111    1781 start.go:365] acquiring machines lock for functional-621000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1030 16:04:23.254245    1781 start.go:369] acquired machines lock for "functional-621000" in 114.535µs
I1030 16:04:23.254277    1781 start.go:96] Skipping create...Using existing machine configuration
I1030 16:04:23.254281    1781 fix.go:54] fixHost starting: 
I1030 16:04:23.254748    1781 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:23.254784    1781 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:23.264680    1781 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49493
I1030 16:04:23.265263    1781 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:23.265737    1781 main.go:141] libmachine: Using API Version  1
I1030 16:04:23.265754    1781 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:23.266105    1781 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:23.266307    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
I1030 16:04:23.266404    1781 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:04:23.266477    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:23.266494    1781 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:04:23.266504    1781 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:04:23.266528    1781 fix.go:102] recreateIfNeeded on functional-621000: state=Stopped err=<nil>
I1030 16:04:23.266533    1781 main.go:141] libmachine: (functional-621000) Calling .DriverName
W1030 16:04:23.266617    1781 fix.go:128] unexpected machine state, will restart: <nil>
I1030 16:04:23.288344    1781 out.go:177] * Restarting existing hyperkit VM for "functional-621000" ...
I1030 16:04:23.332191    1781 main.go:141] libmachine: (functional-621000) Calling .Start
I1030 16:04:23.332469    1781 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:23.332501    1781 main.go:141] libmachine: (functional-621000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.pid
I1030 16:04:23.332583    1781 main.go:141] libmachine: (functional-621000) DBG | Using UUID 9e20cdf2-7778-11ee-91fc-149d997fca88
I1030 16:04:23.334852    1781 main.go:141] libmachine: (functional-621000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I1030 16:04:23.334948    1781 fix.go:56] fixHost completed within 80.665501ms
I1030 16:04:23.334956    1781 start.go:83] releasing machines lock for "functional-621000", held for 80.704784ms
W1030 16:04:23.335016    1781 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-621000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I1030 16:04:23.377103    1781 out.go:177] 
W1030 16:04:23.398349    1781 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W1030 16:04:23.398425    1781 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W1030 16:04:23.398443    1781 out.go:239] * Related issues:
W1030 16:04:23.398459    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W1030 16:04:23.398514    1781 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I1030 16:04:23.441244    1781 out.go:177] 

                                                
                                                
* 
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.27s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-621000 apply -f testdata/invalidsvc.yaml
functional_test.go:2317: (dbg) Non-zero exit: kubectl --context functional-621000 apply -f testdata/invalidsvc.yaml: exit status 1 (37.919008ms)

                                                
                                                
** stderr ** 
	error: context "functional-621000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2319: kubectl --context functional-621000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-621000 --alsologtostderr -v=1]
functional_test.go:914: output didn't produce a URL
functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-621000 --alsologtostderr -v=1] ...
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-621000 --alsologtostderr -v=1] stdout:
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-621000 --alsologtostderr -v=1] stderr:
I1030 16:05:17.274820    2168 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:17.275371    2168 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:17.275378    2168 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:17.275383    2168 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:17.275565    2168 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:17.275880    2168 mustload.go:65] Loading cluster: functional-621000
I1030 16:05:17.276155    2168 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:17.276495    2168 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:17.276538    2168 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:17.284110    2168 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49720
I1030 16:05:17.284539    2168 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:17.285052    2168 main.go:141] libmachine: Using API Version  1
I1030 16:05:17.285101    2168 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:17.285336    2168 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:17.285448    2168 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:17.285525    2168 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:17.285538    2168 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:17.307405    2168 out.go:177] * The control plane node must be running for this command
I1030 16:05:17.285557    2168 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:17.351056    2168 out.go:177]   To start a cluster, run: "minikube start -p functional-621000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (67.084958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 status
functional_test.go:850: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 status: exit status 7 (69.637946ms)

                                                
                                                
-- stdout --
	functional-621000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:852: failed to run minikube status. args "out/minikube-darwin-amd64 -p functional-621000 status" : exit status 7
functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:856: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (64.96959ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:858: failed to run minikube status with custom format: args "out/minikube-darwin-amd64 -p functional-621000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 status -o json
functional_test.go:868: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 status -o json: exit status 7 (66.660703ms)

                                                
                                                
-- stdout --
	{"Name":"functional-621000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:870: failed to run minikube status with json output. args "out/minikube-darwin-amd64 -p functional-621000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (65.419339ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1628: (dbg) Run:  kubectl --context functional-621000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1628: (dbg) Non-zero exit: kubectl --context functional-621000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8: exit status 1 (34.991211ms)

                                                
                                                
** stderr ** 
	error: context "functional-621000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1632: failed to create hello-node deployment with this command "kubectl --context functional-621000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8": exit status 1.
functional_test.go:1597: service test failed - dumping debug information
functional_test.go:1598: -----------------------service failure post-mortem--------------------------------
functional_test.go:1601: (dbg) Run:  kubectl --context functional-621000 describe po hello-node-connect
functional_test.go:1601: (dbg) Non-zero exit: kubectl --context functional-621000 describe po hello-node-connect: exit status 1 (35.348974ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:1603: "kubectl --context functional-621000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1605: hello-node pod describe:
functional_test.go:1607: (dbg) Run:  kubectl --context functional-621000 logs -l app=hello-node-connect
functional_test.go:1607: (dbg) Non-zero exit: kubectl --context functional-621000 logs -l app=hello-node-connect: exit status 1 (35.128478ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:1609: "kubectl --context functional-621000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1611: hello-node logs:
functional_test.go:1613: (dbg) Run:  kubectl --context functional-621000 describe svc hello-node-connect
functional_test.go:1613: (dbg) Non-zero exit: kubectl --context functional-621000 describe svc hello-node-connect: exit status 1 (35.559565ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:1615: "kubectl --context functional-621000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1617: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (65.339288ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-621000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (65.782963ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "echo hello"
functional_test.go:1724: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "echo hello": exit status 89 (144.84969ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1729: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"echo hello\"" : exit status 89
functional_test.go:1733: expected minikube ssh command output to be -"hello"- but got *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n"*. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"echo hello\""
functional_test.go:1741: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "cat /etc/hostname"
functional_test.go:1741: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "cat /etc/hostname": exit status 89 (126.177279ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1747: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"cat /etc/hostname\"" : exit status 89
functional_test.go:1751: expected minikube ssh command output to be -"functional-621000"- but got *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n"*. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (64.794611ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.71s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 89 (174.051217ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-621000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 89
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 "sudo cat /home/docker/cp-test.txt": exit status 89 (204.800452ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 89
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file cp process",
+ 	"he control plane node must be running for this command\n  To star",
+ 	"t a cluster, run: \"minikube start -p functional-621000\"\n",
}, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cp functional-621000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd443216606/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 cp functional-621000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd443216606/001/cp-test.txt: exit status 89 (151.898935ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-621000 cp functional-621000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd443216606/001/cp-test.txt" : exit status 89
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 "sudo cat /home/docker/cp-test.txt": exit status 89 (171.699808ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-621000 ssh -n functional-621000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 89
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd443216606/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n",
+ 	"",
)
--- FAIL: TestFunctional/parallel/CpCmd (0.71s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-621000 replace --force -f testdata/mysql.yaml
functional_test.go:1789: (dbg) Non-zero exit: kubectl --context functional-621000 replace --force -f testdata/mysql.yaml: exit status 1 (67.255536ms)

                                                
                                                
** stderr ** 
	error: context "functional-621000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1791: failed to kubectl replace mysql: args "kubectl --context functional-621000 replace --force -f testdata/mysql.yaml" failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (96.193614ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/MySQL (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1478/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/test/nested/copy/1478/hosts"
functional_test.go:1927: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/test/nested/copy/1478/hosts": exit status 89 (187.229612ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1929: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/test/nested/copy/1478/hosts" failed: exit status 89
functional_test.go:1932: file sync test content: * The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:1942: /etc/sync.test content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file sync process",
+ 	"he control plane node must be running for this command\n  To star",
+ 	"t a cluster, run: \"minikube start -p functional-621000\"\n",
}, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (84.946721ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (0.97s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1478.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/1478.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/1478.pem": exit status 89 (149.913575ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/1478.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /etc/ssl/certs/1478.pem\"": exit status 89
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/1478.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1478.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /usr/share/ca-certificates/1478.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /usr/share/ca-certificates/1478.pem": exit status 89 (152.747889ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/usr/share/ca-certificates/1478.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /usr/share/ca-certificates/1478.pem\"": exit status 89
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/1478.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 89 (153.520059ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 89
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/14782.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/14782.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/14782.pem": exit status 89 (129.955008ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/14782.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /etc/ssl/certs/14782.pem\"": exit status 89
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/14782.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/14782.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /usr/share/ca-certificates/14782.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /usr/share/ca-certificates/14782.pem": exit status 89 (129.708715ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/usr/share/ca-certificates/14782.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /usr/share/ca-certificates/14782.pem\"": exit status 89
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/14782.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 89 (188.139517ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 89
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control plane node must be running for this command
+ 	  To start a cluster, run: "minikube start -p functional-621000"
	"""
)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (65.897147ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (0.97s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-621000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:218: (dbg) Non-zero exit: kubectl --context functional-621000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (35.823835ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:220: failed to 'kubectl get nodes' with args "kubectl --context functional-621000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:226: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-621000 -n functional-621000: exit status 7 (66.1438ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-621000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo systemctl is-active crio": exit status 89 (166.264647ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:2026: output of 
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --: exit status 89
functional_test.go:2029: For runtime "docker": expected "crio" to be inactive but got "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-621000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-621000 image ls --format short --alsologtostderr:
I1030 16:05:18.529679    2203 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:18.529971    2203 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.529976    2203 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:18.529980    2203 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.530154    2203 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:18.530757    2203 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.530858    2203 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.531202    2203 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:18.531247    2203 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:18.538644    2203 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49732
I1030 16:05:18.539035    2203 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:18.539435    2203 main.go:141] libmachine: Using API Version  1
I1030 16:05:18.539446    2203 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:18.539696    2203 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:18.539807    2203 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:18.539895    2203 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:18.539911    2203 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:18.539925    2203 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:18.539935    2203 main.go:141] libmachine: Making call to close driver server
I1030 16:05:18.539941    2203 main.go:141] libmachine: (functional-621000) Calling .Close
I1030 16:05:18.540023    2203 main.go:141] libmachine: Successfully made call to close driver server
I1030 16:05:18.540032    2203 main.go:141] libmachine: Making call to close connection to plugin binary
I1030 16:05:18.540055    2203 main.go:141] libmachine: (functional-621000) DBG | Closing plugin on server side
functional_test.go:274: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-621000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-621000 image ls --format table --alsologtostderr:
I1030 16:05:19.197792    2234 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:19.198080    2234 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:19.198086    2234 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:19.198090    2234 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:19.198276    2234 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:19.198887    2234 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:19.198988    2234 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:19.199357    2234 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:19.199408    2234 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:19.207041    2234 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49744
I1030 16:05:19.207414    2234 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:19.207859    2234 main.go:141] libmachine: Using API Version  1
I1030 16:05:19.207878    2234 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:19.208122    2234 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:19.208243    2234 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:19.208332    2234 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:19.208355    2234 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:19.208365    2234 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:19.208456    2234 main.go:141] libmachine: Making call to close driver server
I1030 16:05:19.208463    2234 main.go:141] libmachine: (functional-621000) Calling .Close
I1030 16:05:19.208553    2234 main.go:141] libmachine: Successfully made call to close driver server
I1030 16:05:19.208556    2234 main.go:141] libmachine: (functional-621000) DBG | Closing plugin on server side
I1030 16:05:19.208561    2234 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-621000 image ls --format json --alsologtostderr:
[]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-621000 image ls --format json --alsologtostderr:
I1030 16:05:19.119068    2231 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:19.119395    2231 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:19.119405    2231 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:19.119412    2231 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:19.119642    2231 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:19.120580    2231 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:19.120708    2231 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:19.121329    2231 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:19.121409    2231 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:19.129930    2231 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49742
I1030 16:05:19.130364    2231 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:19.130801    2231 main.go:141] libmachine: Using API Version  1
I1030 16:05:19.130811    2231 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:19.131043    2231 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:19.131155    2231 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:19.131243    2231 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:19.131269    2231 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:19.131278    2231 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:19.131350    2231 main.go:141] libmachine: Making call to close driver server
I1030 16:05:19.131356    2231 main.go:141] libmachine: (functional-621000) Calling .Close
I1030 16:05:19.131438    2231 main.go:141] libmachine: (functional-621000) DBG | Closing plugin on server side
I1030 16:05:19.131468    2231 main.go:141] libmachine: Successfully made call to close driver server
I1030 16:05:19.131477    2231 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-621000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-621000 image ls --format yaml --alsologtostderr:
I1030 16:05:18.619641    2206 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:18.619915    2206 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.619921    2206 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:18.619925    2206 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.620102    2206 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:18.620727    2206 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.620819    2206 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.621161    2206 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:18.621205    2206 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:18.628614    2206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49734
I1030 16:05:18.628963    2206 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:18.629392    2206 main.go:141] libmachine: Using API Version  1
I1030 16:05:18.629414    2206 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:18.629645    2206 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:18.629746    2206 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:18.629831    2206 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:18.629865    2206 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:18.629901    2206 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:18.629950    2206 main.go:141] libmachine: Making call to close driver server
I1030 16:05:18.629964    2206 main.go:141] libmachine: (functional-621000) Calling .Close
I1030 16:05:18.630041    2206 main.go:141] libmachine: Successfully made call to close driver server
I1030 16:05:18.630045    2206 main.go:141] libmachine: (functional-621000) DBG | Closing plugin on server side
I1030 16:05:18.630051    2206 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh pgrep buildkitd: exit status 89 (134.018208ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image build -t localhost/my-image:functional-621000 testdata/build --alsologtostderr
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-621000 image build -t localhost/my-image:functional-621000 testdata/build --alsologtostderr:
I1030 16:05:18.866074    2216 out.go:296] Setting OutFile to fd 1 ...
I1030 16:05:18.866503    2216 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.866514    2216 out.go:309] Setting ErrFile to fd 2...
I1030 16:05:18.866521    2216 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:05:18.866810    2216 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:05:18.867760    2216 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.868627    2216 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:05:18.869119    2216 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:05:18.869177    2216 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:05:18.881410    2216 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49738
I1030 16:05:18.882027    2216 main.go:141] libmachine: () Calling .GetVersion
I1030 16:05:18.882582    2216 main.go:141] libmachine: Using API Version  1
I1030 16:05:18.882600    2216 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:05:18.882892    2216 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:05:18.883036    2216 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:05:18.883177    2216 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:05:18.883197    2216 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:05:18.883217    2216 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:05:18.883299    2216 build_images.go:123] succeeded building to: 
I1030 16:05:18.883321    2216 build_images.go:124] failed building to: 
I1030 16:05:18.883368    2216 main.go:141] libmachine: Making call to close driver server
I1030 16:05:18.883386    2216 main.go:141] libmachine: (functional-621000) Calling .Close
I1030 16:05:18.883507    2216 main.go:141] libmachine: Successfully made call to close driver server
I1030 16:05:18.883519    2216 main.go:141] libmachine: Making call to close connection to plugin binary
I1030 16:05:18.883568    2216 main.go:141] libmachine: (functional-621000) DBG | Closing plugin on server side
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
functional_test.go:442: expected "localhost/my-image:functional-621000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-621000 docker-env) && out/minikube-darwin-amd64 status -p functional-621000"
functional_test.go:495: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-621000 docker-env) && out/minikube-darwin-amd64 status -p functional-621000": exit status 1 (135.422442ms)
functional_test.go:501: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2: exit status 89 (154.085564ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:05:18.125446    2194 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:05:18.125782    2194 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.125790    2194 out.go:309] Setting ErrFile to fd 2...
	I1030 16:05:18.125794    2194 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.126009    2194 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:05:18.126386    2194 mustload.go:65] Loading cluster: functional-621000
	I1030 16:05:18.126707    2194 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:05:18.127078    2194 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:18.127149    2194 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:18.135838    2194 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49726
	I1030 16:05:18.136399    2194 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:18.137013    2194 main.go:141] libmachine: Using API Version  1
	I1030 16:05:18.137028    2194 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:18.137354    2194 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:18.137526    2194 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:05:18.137666    2194 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:05:18.137690    2194 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:05:18.137708    2194 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:05:18.160909    2194 out.go:177] * The control plane node must be running for this command
	I1030 16:05:18.183254    2194 out.go:177]   To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2": exit status 89
functional_test.go:2122: update-context: got="* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2: exit status 89 (128.372084ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:05:18.400551    2200 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:05:18.401203    2200 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.401212    2200 out.go:309] Setting ErrFile to fd 2...
	I1030 16:05:18.401219    2200 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.401790    2200 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:05:18.402121    2200 mustload.go:65] Loading cluster: functional-621000
	I1030 16:05:18.402382    2200 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:05:18.402711    2200 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:18.402762    2200 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:18.410288    2200 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49730
	I1030 16:05:18.410686    2200 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:18.411091    2200 main.go:141] libmachine: Using API Version  1
	I1030 16:05:18.411115    2200 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:18.411336    2200 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:18.411430    2200 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:05:18.411526    2200 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:05:18.411552    2200 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:05:18.411559    2200 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:05:18.432587    2200 out.go:177] * The control plane node must be running for this command
	I1030 16:05:18.453591    2200 out.go:177]   To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2": exit status 89
functional_test.go:2122: update-context: got="* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2: exit status 89 (138.250248ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:05:18.268023    2197 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:05:18.268339    2197 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.268344    2197 out.go:309] Setting ErrFile to fd 2...
	I1030 16:05:18.268349    2197 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:18.268541    2197 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:05:18.268899    2197 mustload.go:65] Loading cluster: functional-621000
	I1030 16:05:18.269190    2197 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:05:18.269561    2197 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:18.269616    2197 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:18.278243    2197 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49728
	I1030 16:05:18.278674    2197 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:18.279120    2197 main.go:141] libmachine: Using API Version  1
	I1030 16:05:18.279132    2197 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:18.279361    2197 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:18.279478    2197 main.go:141] libmachine: (functional-621000) Calling .GetState
	I1030 16:05:18.279571    2197 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:05:18.279603    2197 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
	I1030 16:05:18.279631    2197 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
	I1030 16:05:18.301176    2197 out.go:177] * The control plane node must be running for this command
	I1030 16:05:18.322367    2197 out.go:177]   To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-621000 update-context --alsologtostderr -v=2": exit status 89
functional_test.go:2122: update-context: got="* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.88s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr: (1.785094591s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-621000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.88s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 89. stderr: I1030 16:04:27.667955    1909 out.go:296] Setting OutFile to fd 1 ...
I1030 16:04:27.673506    1909 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:27.673513    1909 out.go:309] Setting ErrFile to fd 2...
I1030 16:04:27.673519    1909 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:04:27.673713    1909 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:04:27.674072    1909 mustload.go:65] Loading cluster: functional-621000
I1030 16:04:27.674362    1909 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:04:27.674741    1909 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1030 16:04:27.674792    1909 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1030 16:04:27.682762    1909 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49564
I1030 16:04:27.683199    1909 main.go:141] libmachine: () Calling .GetVersion
I1030 16:04:27.683629    1909 main.go:141] libmachine: Using API Version  1
I1030 16:04:27.683660    1909 main.go:141] libmachine: () Calling .SetConfigRaw
I1030 16:04:27.683916    1909 main.go:141] libmachine: () Calling .GetMachineName
I1030 16:04:27.684036    1909 main.go:141] libmachine: (functional-621000) Calling .GetState
I1030 16:04:27.684157    1909 main.go:141] libmachine: (functional-621000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1030 16:04:27.684178    1909 main.go:141] libmachine: (functional-621000) DBG | hyperkit pid from json: 0
I1030 16:04:27.684199    1909 main.go:141] libmachine: (functional-621000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/functional-621000/hyperkit.json: no such file or directory
I1030 16:04:27.706955    1909 out.go:177] * The control plane node must be running for this command
I1030 16:04:27.769131    1909 out.go:177]   To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
stdout: * The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1912: os: process already finished
helpers_test.go:502: unable to terminate pid 1908: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-621000": client config: context "functional-621000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (105.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-621000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-621000 get svc nginx-svc: exit status 1 (38.043795ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-621000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-621000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (105.42s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr: (1.678282034s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-621000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.77s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.796512552s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-621000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-darwin-amd64 -p functional-621000 image load --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr: (1.647028858s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-621000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.59s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image save gcr.io/google-containers/addon-resizer:functional-621000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/Users/jenkins/workspace/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-621000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1438: (dbg) Run:  kubectl --context functional-621000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1438: (dbg) Non-zero exit: kubectl --context functional-621000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8: exit status 1 (34.551511ms)

                                                
                                                
** stderr ** 
	error: context "functional-621000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1442: failed to create hello-node deployment with this command "kubectl --context functional-621000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.03s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 service list
functional_test.go:1458: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 service list: exit status 89 (153.547753ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1460: failed to do service list. args "out/minikube-darwin-amd64 -p functional-621000 service list" : exit status 89
functional_test.go:1463: expected 'service list' to contain *hello-node* but got -"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 service list -o json
functional_test.go:1488: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 service list -o json: exit status 89 (131.21365ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1490: failed to list services with json format. args "out/minikube-darwin-amd64 -p functional-621000 service list -o json": exit status 89
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 service --namespace=default --https --url hello-node
functional_test.go:1508: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 service --namespace=default --https --url hello-node: exit status 89 (130.888995ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1510: failed to get service url. args "out/minikube-darwin-amd64 -p functional-621000 service --namespace=default --https --url hello-node" : exit status 89
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 service hello-node --url --format={{.IP}}
functional_test.go:1539: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 service hello-node --url --format={{.IP}}: exit status 89 (132.461138ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1541: failed to get service url with custom format. args "out/minikube-darwin-amd64 -p functional-621000 service hello-node --url --format={{.IP}}": exit status 89
functional_test.go:1547: "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 service hello-node --url
functional_test.go:1558: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 service hello-node --url: exit status 89 (130.620916ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:1560: failed to get service url. args: "out/minikube-darwin-amd64 -p functional-621000 service hello-node --url": exit status 89
functional_test.go:1564: found endpoint for hello-node: * The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:1568: failed to parse "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"": parse "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p functional-621000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 version -o=json --components
functional_test.go:2266: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 version -o=json --components: exit status 89 (131.424178ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test.go:2268: error version: exit status 89
functional_test.go:2273: expected to see "buildctl" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "commit" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "containerd" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "crictl" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "crio" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "ctr" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "docker" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "minikubeVersion" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "podman" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
functional_test.go:2273: expected to see "crun" in the minikube version --components but got:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p functional-621000"
--- FAIL: TestFunctional/parallel/Version/components (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.03774327s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
if_index : 4 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.07s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (37.89s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (37.89s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (11.12s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -p image-368000 --driver=hyperkit 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-368000 --driver=hyperkit : exit status 60 (11.052118937s)

                                                
                                                
-- stdout --
	* [image-368000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node image-368000 in cluster image-368000
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "image-368000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p image-368000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-368000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p image-368000 -n image-368000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p image-368000 -n image-368000: exit status 7 (68.557745ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-368000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (11.12s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (19.12s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-darwin-amd64 start -p ingress-addon-legacy-237000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=hyperkit 
ingress_addon_legacy_test.go:39: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ingress-addon-legacy-237000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (19.118730261s)

                                                
                                                
-- stdout --
	* [ingress-addon-legacy-237000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node ingress-addon-legacy-237000 in cluster ingress-addon-legacy-237000
	* Downloading Kubernetes v1.18.20 preload ...
	* Creating hyperkit VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	* Deleting "ingress-addon-legacy-237000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:07:28.438261    2356 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:07:28.438459    2356 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:07:28.438464    2356 out.go:309] Setting ErrFile to fd 2...
	I1030 16:07:28.438468    2356 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:07:28.438641    2356 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:07:28.440037    2356 out.go:303] Setting JSON to false
	I1030 16:07:28.462007    2356 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":423,"bootTime":1698706825,"procs":431,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:07:28.462097    2356 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:07:28.483970    2356 out.go:177] * [ingress-addon-legacy-237000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:07:28.527768    2356 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:07:28.527835    2356 notify.go:220] Checking for updates...
	I1030 16:07:28.571654    2356 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:07:28.592645    2356 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:07:28.614474    2356 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:07:28.635715    2356 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:07:28.678487    2356 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:07:28.699655    2356 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:07:28.728434    2356 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:07:28.770620    2356 start.go:298] selected driver: hyperkit
	I1030 16:07:28.770643    2356 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:07:28.770657    2356 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:07:28.774083    2356 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:07:28.774191    2356 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:07:28.781817    2356 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:07:28.785561    2356 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:28.785578    2356 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:07:28.785605    2356 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:07:28.785798    2356 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:07:28.785827    2356 cni.go:84] Creating CNI manager for ""
	I1030 16:07:28.785839    2356 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 16:07:28.785846    2356 start_flags.go:323] config:
	{Name:ingress-addon-legacy-237000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-237000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.
local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:07:28.785989    2356 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:07:28.807692    2356 out.go:177] * Starting control plane node ingress-addon-legacy-237000 in cluster ingress-addon-legacy-237000
	I1030 16:07:28.829491    2356 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 16:07:28.885151    2356 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4
	I1030 16:07:28.885198    2356 cache.go:56] Caching tarball of preloaded images
	I1030 16:07:28.885543    2356 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I1030 16:07:28.907285    2356 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I1030 16:07:28.949748    2356 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:07:29.036238    2356 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4?checksum=md5:ff35f06d4f6c0bac9297b8f85d8ebf70 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4
	I1030 16:07:36.088658    2356 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:07:36.088931    2356 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:07:36.770816    2356 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I1030 16:07:36.771051    2356 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/ingress-addon-legacy-237000/config.json ...
	I1030 16:07:36.771074    2356 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/ingress-addon-legacy-237000/config.json: {Name:mka3345de9fd8c89183af933a74c2a9d4f4bdf3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:07:36.771445    2356 start.go:365] acquiring machines lock for ingress-addon-legacy-237000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:07:36.771494    2356 start.go:369] acquired machines lock for "ingress-addon-legacy-237000" in 38.583µs
	I1030 16:07:36.771544    2356 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-237000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:2
2 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-237000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:07:36.771601    2356 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:07:36.801013    2356 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	I1030 16:07:36.801396    2356 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:36.801464    2356 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:36.811850    2356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49773
	I1030 16:07:36.812388    2356 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:36.812970    2356 main.go:141] libmachine: Using API Version  1
	I1030 16:07:36.812979    2356 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:36.813307    2356 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:36.813439    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetMachineName
	I1030 16:07:36.813522    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .DriverName
	I1030 16:07:36.813635    2356 start.go:159] libmachine.API.Create for "ingress-addon-legacy-237000" (driver="hyperkit")
	I1030 16:07:36.813663    2356 client.go:168] LocalClient.Create starting
	I1030 16:07:36.813701    2356 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:07:36.813755    2356 main.go:141] libmachine: Decoding PEM data...
	I1030 16:07:36.813773    2356 main.go:141] libmachine: Parsing certificate...
	I1030 16:07:36.813836    2356 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:07:36.813874    2356 main.go:141] libmachine: Decoding PEM data...
	I1030 16:07:36.813884    2356 main.go:141] libmachine: Parsing certificate...
	I1030 16:07:36.813898    2356 main.go:141] libmachine: Running pre-create checks...
	I1030 16:07:36.813907    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .PreCreateCheck
	I1030 16:07:36.813985    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:36.814171    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetConfigRaw
	I1030 16:07:36.822364    2356 main.go:141] libmachine: Creating machine...
	I1030 16:07:36.822390    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Create
	I1030 16:07:36.822617    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:36.822950    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:36.822614    2368 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:07:36.823077    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:07:36.981296    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:36.981153    2368 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/id_rsa...
	I1030 16:07:37.162548    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:37.162432    2368 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/ingress-addon-legacy-237000.rawdisk...
	I1030 16:07:37.162564    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Writing magic tar header
	I1030 16:07:37.162577    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Writing SSH key tar header
	I1030 16:07:37.163369    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:37.163251    2368 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000 ...
	I1030 16:07:37.491921    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:37.491942    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.pid
	I1030 16:07:37.491963    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Using UUID 1db1e6dc-7779-11ee-83a2-149d997fca88
	I1030 16:07:37.533502    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:07:37.533586    2356 client.go:171] LocalClient.Create took 719.912315ms
	I1030 16:07:39.535373    2356 start.go:128] duration metric: createHost completed in 2.763753783s
	I1030 16:07:39.535400    2356 start.go:83] releasing machines lock for "ingress-addon-legacy-237000", held for 2.76387189s
	W1030 16:07:39.535428    2356 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:07:39.535993    2356 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:39.536035    2356 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:39.546070    2356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49775
	I1030 16:07:39.546433    2356 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:39.546815    2356 main.go:141] libmachine: Using API Version  1
	I1030 16:07:39.546827    2356 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:39.547067    2356 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:39.547464    2356 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:39.547491    2356 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:39.555891    2356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49777
	I1030 16:07:39.556349    2356 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:39.556708    2356 main.go:141] libmachine: Using API Version  1
	I1030 16:07:39.556742    2356 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:39.556995    2356 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:39.557126    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetState
	I1030 16:07:39.557212    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:39.557232    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | hyperkit pid from json: 0
	I1030 16:07:39.557247    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.json: no such file or directory
	I1030 16:07:39.557293    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .DriverName
	I1030 16:07:39.603155    2356 out.go:177] * Deleting "ingress-addon-legacy-237000" in hyperkit ...
	I1030 16:07:39.625764    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Remove
	I1030 16:07:39.626122    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:39.626145    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:39.626176    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | hyperkit pid from json: 0
	I1030 16:07:39.626204    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.json: no such file or directory
	W1030 16:07:39.639425    2356 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:07:39.639438    2356 start.go:706] Will try again in 5 seconds ...
	I1030 16:07:44.640101    2356 start.go:365] acquiring machines lock for ingress-addon-legacy-237000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:07:44.640290    2356 start.go:369] acquired machines lock for "ingress-addon-legacy-237000" in 134.602µs
	I1030 16:07:44.640353    2356 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-237000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:2
2 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-237000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:07:44.640468    2356 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:07:44.663696    2356 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...
	I1030 16:07:44.663878    2356 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:44.663936    2356 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:44.673998    2356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49779
	I1030 16:07:44.674537    2356 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:44.674940    2356 main.go:141] libmachine: Using API Version  1
	I1030 16:07:44.674969    2356 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:44.675211    2356 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:44.675327    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetMachineName
	I1030 16:07:44.675423    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .DriverName
	I1030 16:07:44.675526    2356 start.go:159] libmachine.API.Create for "ingress-addon-legacy-237000" (driver="hyperkit")
	I1030 16:07:44.675543    2356 client.go:168] LocalClient.Create starting
	I1030 16:07:44.675568    2356 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:07:44.675612    2356 main.go:141] libmachine: Decoding PEM data...
	I1030 16:07:44.675623    2356 main.go:141] libmachine: Parsing certificate...
	I1030 16:07:44.675662    2356 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:07:44.675704    2356 main.go:141] libmachine: Decoding PEM data...
	I1030 16:07:44.675713    2356 main.go:141] libmachine: Parsing certificate...
	I1030 16:07:44.675727    2356 main.go:141] libmachine: Running pre-create checks...
	I1030 16:07:44.675735    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .PreCreateCheck
	I1030 16:07:44.675811    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:44.675855    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetConfigRaw
	I1030 16:07:44.676276    2356 main.go:141] libmachine: Creating machine...
	I1030 16:07:44.676285    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Create
	I1030 16:07:44.676347    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:44.676523    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:44.676349    2372 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:07:44.676544    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:07:44.836416    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:44.836265    2372 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/id_rsa...
	I1030 16:07:44.931900    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:44.931829    2372 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/ingress-addon-legacy-237000.rawdisk...
	I1030 16:07:44.931941    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Writing magic tar header
	I1030 16:07:44.931951    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Writing SSH key tar header
	I1030 16:07:44.932842    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | I1030 16:07:44.932726    2372 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000 ...
	I1030 16:07:45.258501    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:45.258523    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.pid
	I1030 16:07:45.258533    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Using UUID 2261a7b2-7779-11ee-83a2-149d997fca88
	I1030 16:07:45.292100    2356 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:07:45.292177    2356 client.go:171] LocalClient.Create took 616.626954ms
	I1030 16:07:47.292527    2356 start.go:128] duration metric: createHost completed in 2.652037965s
	I1030 16:07:47.292589    2356 start.go:83] releasing machines lock for "ingress-addon-legacy-237000", held for 2.652284525s
	W1030 16:07:47.292715    2356 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ingress-addon-legacy-237000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ingress-addon-legacy-237000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:07:47.348256    2356 out.go:177] 
	W1030 16:07:47.370490    2356 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:07:47.370568    2356 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:07:47.370584    2356 out.go:239] * Related issues:
	* Related issues:
	W1030 16:07:47.370618    2356 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:07:47.370647    2356 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:07:47.416403    2356 out.go:177] 

                                                
                                                
** /stderr **
ingress_addon_legacy_test.go:41: failed to start minikube with args: "out/minikube-darwin-amd64 start -p ingress-addon-legacy-237000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
--- FAIL: TestIngressAddonLegacy/StartLegacyK8sCluster (19.12s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (0.34s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-237000 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ingress-addon-legacy-237000 addons enable ingress --alsologtostderr -v=5: exit status 10 (269.682241ms)

                                                
                                                
-- stdout --
	* ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.
	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS
	* Verifying ingress addon...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:07:47.560658    2374 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:07:47.561060    2374 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:07:47.561067    2374 out.go:309] Setting ErrFile to fd 2...
	I1030 16:07:47.561071    2374 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:07:47.561240    2374 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:07:47.561642    2374 mustload.go:65] Loading cluster: ingress-addon-legacy-237000
	I1030 16:07:47.561914    2374 config.go:182] Loaded profile config "ingress-addon-legacy-237000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1030 16:07:47.561930    2374 addons.go:594] checking whether the cluster is paused
	I1030 16:07:47.562008    2374 config.go:182] Loaded profile config "ingress-addon-legacy-237000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1030 16:07:47.562022    2374 host.go:66] Checking if "ingress-addon-legacy-237000" exists ...
	I1030 16:07:47.562352    2374 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:47.562397    2374 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:47.569786    2374 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49781
	I1030 16:07:47.570152    2374 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:47.570561    2374 main.go:141] libmachine: Using API Version  1
	I1030 16:07:47.570574    2374 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:47.570854    2374 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:47.570987    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetState
	I1030 16:07:47.571159    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:47.571184    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.json: no such file or directory
	I1030 16:07:47.571194    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | hyperkit pid from json: 0
	I1030 16:07:47.571240    2374 main.go:141] libmachine: Making call to close driver server
	I1030 16:07:47.571260    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Close
	I1030 16:07:47.571346    2374 main.go:141] libmachine: Successfully made call to close driver server
	I1030 16:07:47.571357    2374 main.go:141] libmachine: Making call to close connection to plugin binary
	I1030 16:07:47.571352    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Closing plugin on server side
	I1030 16:07:47.598547    2374 out.go:177] * ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.
	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS
	I1030 16:07:47.622100    2374 config.go:182] Loaded profile config "ingress-addon-legacy-237000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I1030 16:07:47.622125    2374 addons.go:69] Setting ingress=true in profile "ingress-addon-legacy-237000"
	I1030 16:07:47.622139    2374 addons.go:231] Setting addon ingress=true in "ingress-addon-legacy-237000"
	I1030 16:07:47.622196    2374 host.go:66] Checking if "ingress-addon-legacy-237000" exists ...
	I1030 16:07:47.622632    2374 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:47.622680    2374 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:47.631763    2374 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49783
	I1030 16:07:47.632097    2374 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:47.632484    2374 main.go:141] libmachine: Using API Version  1
	I1030 16:07:47.632509    2374 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:47.632715    2374 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:47.633054    2374 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:07:47.633076    2374 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:07:47.640573    2374 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49785
	I1030 16:07:47.640911    2374 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:07:47.641256    2374 main.go:141] libmachine: Using API Version  1
	I1030 16:07:47.641291    2374 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:07:47.641496    2374 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:07:47.641593    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .GetState
	I1030 16:07:47.641686    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:07:47.641721    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | hyperkit pid from json: 0
	I1030 16:07:47.641743    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/ingress-addon-legacy-237000/hyperkit.json: no such file or directory
	W1030 16:07:47.641753    2374 host.go:58] "ingress-addon-legacy-237000" host status: Stopped
	W1030 16:07:47.641768    2374 addons.go:277] "ingress-addon-legacy-237000" is not running, setting ingress=true and skipping enablement (err=<nil>)
	I1030 16:07:47.641783    2374 main.go:141] libmachine: Making call to close driver server
	I1030 16:07:47.641792    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Close
	I1030 16:07:47.641898    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Closing plugin on server side
	I1030 16:07:47.641915    2374 main.go:141] libmachine: Successfully made call to close driver server
	I1030 16:07:47.641923    2374 main.go:141] libmachine: Making call to close connection to plugin binary
	I1030 16:07:47.641930    2374 main.go:141] libmachine: Making call to close driver server
	I1030 16:07:47.641936    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) Calling .Close
	I1030 16:07:47.642018    2374 main.go:141] libmachine: (ingress-addon-legacy-237000) DBG | Closing plugin on server side
	I1030 16:07:47.642033    2374 main.go:141] libmachine: Successfully made call to close driver server
	I1030 16:07:47.642044    2374 main.go:141] libmachine: Making call to close connection to plugin binary
	I1030 16:07:47.642060    2374 addons.go:467] Verifying addon ingress=true in "ingress-addon-legacy-237000"
	I1030 16:07:47.663112    2374 out.go:177] * Verifying ingress addon...
	I1030 16:07:47.685092    2374 loader.go:141] Config not found: /Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:07:47.706739    2374 out.go:177] 
	W1030 16:07:47.727966    2374 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-237000" does not exist: client config: context "ingress-addon-legacy-237000" does not exist]
	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-237000" does not exist: client config: context "ingress-addon-legacy-237000" does not exist]
	W1030 16:07:47.728001    2374 out.go:239] * 
	* 
	W1030 16:07:47.731233    2374 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                           │
	│    * If the above advice does not help, please let us know:                                                               │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │
	│                                                                                                                           │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │
	│    * Please also attach the following file to the GitHub issue:                                                           │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │
	│                                                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                           │
	│    * If the above advice does not help, please let us know:                                                               │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │
	│                                                                                                                           │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │
	│    * Please also attach the following file to the GitHub issue:                                                           │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │
	│                                                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1030 16:07:47.752929    2374 out.go:177] 

                                                
                                                
** /stderr **
ingress_addon_legacy_test.go:71: failed to enable ingress addon: exit status 10
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-237000 -n ingress-addon-legacy-237000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-237000 -n ingress-addon-legacy-237000: exit status 7 (65.037878ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ingress-addon-legacy-237000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (0.34s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (0.07s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:200: failed to get Kubernetes client: <nil>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-237000 -n ingress-addon-legacy-237000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-237000 -n ingress-addon-legacy-237000: exit status 7 (66.310004ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ingress-addon-legacy-237000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (0.07s)

                                                
                                    
x
+
TestJSONOutput/start/Command (10.98s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-624000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-624000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit : exit status 60 (10.978184194s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"2e075cf1-39f7-4245-8eb5-02136a76ea58","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-624000] minikube v1.32.0-beta.0 on Darwin 14.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"c6b97f28-df65-403c-8251-2bd5b4de56ae","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17527"}}
	{"specversion":"1.0","id":"8b32b105-d1a3-43d4-9995-238845c8df87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig"}}
	{"specversion":"1.0","id":"1a75e328-abc3-4ec9-a798-94c345b27043","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"572f2400-1eff-40ec-afd5-9770b12b1adc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"e483ded4-d448-4f70-8997-9129eabb3aaa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube"}}
	{"specversion":"1.0","id":"7660fd78-79ba-45de-89cb-d44d840d13a2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"15d6fe2c-eaa4-4b19-b719-cf7b792c6454","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"55605a74-f37b-464a-90da-37d1265ddf3e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node json-output-624000 in cluster json-output-624000","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"552a7074-11b0-465b-98b9-5ee7e96b4af4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"3695eef4-271e-4830-91b5-13db4187a64f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-624000\" in hyperkit ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"20653936-29b8-4441-a6fa-0b2c4409ed67","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"8e36cd83-1cbd-41fb-b04f-fdc5363bfb38","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"ded7594e-275a-40e5-85c7-5c4b1b8e9e8d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start hyperkit VM. Running \"minikube delete -p json-output-624000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"7f964ed0-a174-45c2-ba33-55faa7300b61","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.","exitcode":"60","issues":"https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594","message":"Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1","name":"PR_HYPERKIT_VMNET_FRAMEWORK","url":""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 start -p json-output-624000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit ": exit status 60
--- FAIL: TestJSONOutput/start/Command (10.98s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
json_output_test.go:114: step 9 has already been assigned to another step:
Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
Cannot use for:
Deleting "json-output-624000" in hyperkit ...
[Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2e075cf1-39f7-4245-8eb5-02136a76ea58
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-624000] minikube v1.32.0-beta.0 on Darwin 14.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: c6b97f28-df65-403c-8251-2bd5b4de56ae
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=17527"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 8b32b105-d1a3-43d4-9995-238845c8df87
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 1a75e328-abc3-4ec9-a798-94c345b27043
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 572f2400-1eff-40ec-afd5-9770b12b1adc
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: e483ded4-d448-4f70-8997-9129eabb3aaa
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 7660fd78-79ba-45de-89cb-d44d840d13a2
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 15d6fe2c-eaa4-4b19-b719-cf7b792c6454
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 55605a74-f37b-464a-90da-37d1265ddf3e
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting control plane node json-output-624000 in cluster json-output-624000",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 552a7074-11b0-465b-98b9-5ee7e96b4af4
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 3695eef4-271e-4830-91b5-13db4187a64f
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-624000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 20653936-29b8-4441-a6fa-0b2c4409ed67
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 8e36cd83-1cbd-41fb-b04f-fdc5363bfb38
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: ded7594e-275a-40e5-85c7-5c4b1b8e9e8d
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-624000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 7f964ed0-a174-45c2-ba33-55faa7300b61
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
json_output_test.go:144: current step is not in increasing order: [Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2e075cf1-39f7-4245-8eb5-02136a76ea58
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-624000] minikube v1.32.0-beta.0 on Darwin 14.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: c6b97f28-df65-403c-8251-2bd5b4de56ae
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=17527"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 8b32b105-d1a3-43d4-9995-238845c8df87
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 1a75e328-abc3-4ec9-a798-94c345b27043
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 572f2400-1eff-40ec-afd5-9770b12b1adc
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: e483ded4-d448-4f70-8997-9129eabb3aaa
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 7660fd78-79ba-45de-89cb-d44d840d13a2
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 15d6fe2c-eaa4-4b19-b719-cf7b792c6454
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 55605a74-f37b-464a-90da-37d1265ddf3e
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting control plane node json-output-624000 in cluster json-output-624000",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 552a7074-11b0-465b-98b9-5ee7e96b4af4
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 3695eef4-271e-4830-91b5-13db4187a64f
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-624000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 20653936-29b8-4441-a6fa-0b2c4409ed67
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 8e36cd83-1cbd-41fb-b04f-fdc5363bfb38
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: ded7594e-275a-40e5-85c7-5c4b1b8e9e8d
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-624000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 7f964ed0-a174-45c2-ba33-55faa7300b61
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.13s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 pause -p json-output-624000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p json-output-624000 --output=json --user=testUser: exit status 89 (134.22535ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"5cfb606a-fa78-4d78-b726-69959fc62ff7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control plane node must be running for this command"}}
	{"specversion":"1.0","id":"57991c44-745d-4e6e-b338-9d180c8b2338","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-624000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 pause -p json-output-624000 --output=json --user=testUser": exit status 89
--- FAIL: TestJSONOutput/pause/Command (0.13s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.16s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 unpause -p json-output-624000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p json-output-624000 --output=json --user=testUser: exit status 89 (155.439241ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p json-output-624000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 unpause -p json-output-624000 --output=json --user=testUser": exit status 89
json_output_test.go:213: unable to marshal output: * The control plane node must be running for this command
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.16s)

                                                
                                    
x
+
TestMinikubeProfile (11.9s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-054000 --driver=hyperkit 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p first-054000 --driver=hyperkit : exit status 60 (11.083704292s)

                                                
                                                
-- stdout --
	* [first-054000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node first-054000 in cluster first-054000
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "first-054000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p first-054000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p first-054000 --driver=hyperkit ": exit status 60
panic.go:523: *** TestMinikubeProfile FAILED at 2023-10-30 16:08:11.950077 -0700 PDT m=+311.483419210
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-057000 -n second-057000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-057000 -n second-057000: exit status 85 (125.739743ms)

                                                
                                                
-- stdout --
	* Profile "second-057000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-057000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-057000" host is not running, skipping log retrieval (state="* Profile \"second-057000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-057000\"")
helpers_test.go:175: Cleaning up "second-057000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-057000
panic.go:523: *** TestMinikubeProfile FAILED at 2023-10-30 16:08:12.449215 -0700 PDT m=+311.982557259
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-054000 -n first-054000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p first-054000 -n first-054000: exit status 7 (66.657209ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-054000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-054000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-054000
--- FAIL: TestMinikubeProfile (11.90s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (11.22s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-amd64 start -p mount-start-1-195000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p mount-start-1-195000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit : exit status 60 (11.155521355s)

                                                
                                                
-- stdout --
	* [mount-start-1-195000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting minikube without Kubernetes in cluster mount-start-1-195000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "mount-start-1-195000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p mount-start-1-195000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-amd64 start -p mount-start-1-195000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-195000 -n mount-start-1-195000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-195000 -n mount-start-1-195000: exit status 7 (66.91693ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-195000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (11.22s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (11.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-337000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:85: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-337000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (11.282658983s)

                                                
                                                
-- stdout --
	* [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node multinode-337000 in cluster multinode-337000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "multinode-337000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:08:24.672881    2521 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:08:24.673089    2521 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:08:24.673096    2521 out.go:309] Setting ErrFile to fd 2...
	I1030 16:08:24.673100    2521 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:08:24.673287    2521 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:08:24.674737    2521 out.go:303] Setting JSON to false
	I1030 16:08:24.696653    2521 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":479,"bootTime":1698706825,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:08:24.696747    2521 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:08:24.719312    2521 out.go:177] * [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:08:24.761814    2521 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:08:24.761985    2521 notify.go:220] Checking for updates...
	I1030 16:08:24.783953    2521 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:08:24.804785    2521 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:08:24.825823    2521 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:08:24.846945    2521 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:08:24.867728    2521 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:08:24.889406    2521 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:08:24.919913    2521 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:08:24.961714    2521 start.go:298] selected driver: hyperkit
	I1030 16:08:24.961742    2521 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:08:24.961760    2521 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:08:24.966360    2521 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:08:24.966501    2521 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:08:24.975034    2521 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:08:24.979131    2521 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:08:24.979337    2521 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:08:24.979367    2521 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:08:24.979569    2521 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:08:24.979627    2521 cni.go:84] Creating CNI manager for ""
	I1030 16:08:24.979635    2521 cni.go:136] 0 nodes found, recommending kindnet
	I1030 16:08:24.979646    2521 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I1030 16:08:24.979656    2521 start_flags.go:323] config:
	{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:08:24.979808    2521 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:08:25.021800    2521 out.go:177] * Starting control plane node multinode-337000 in cluster multinode-337000
	I1030 16:08:25.042823    2521 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:08:25.042916    2521 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:08:25.042943    2521 cache.go:56] Caching tarball of preloaded images
	I1030 16:08:25.043178    2521 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:08:25.043196    2521 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:08:25.043685    2521 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/multinode-337000/config.json ...
	I1030 16:08:25.043765    2521 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/multinode-337000/config.json: {Name:mkf271e95dc2ef2df493625e60410f7dec89111a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:08:25.044430    2521 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:08:25.044543    2521 start.go:369] acquired machines lock for "multinode-337000" in 91.033µs
	I1030 16:08:25.044589    2521 start.go:93] Provisioning new machine with config: &{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:08:25.044667    2521 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:08:25.065990    2521 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:08:25.066412    2521 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:08:25.066487    2521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:08:25.075743    2521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49856
	I1030 16:08:25.076105    2521 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:08:25.076582    2521 main.go:141] libmachine: Using API Version  1
	I1030 16:08:25.076597    2521 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:08:25.076798    2521 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:08:25.076893    2521 main.go:141] libmachine: (multinode-337000) Calling .GetMachineName
	I1030 16:08:25.076979    2521 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:08:25.077076    2521 start.go:159] libmachine.API.Create for "multinode-337000" (driver="hyperkit")
	I1030 16:08:25.077103    2521 client.go:168] LocalClient.Create starting
	I1030 16:08:25.077137    2521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:08:25.077186    2521 main.go:141] libmachine: Decoding PEM data...
	I1030 16:08:25.077200    2521 main.go:141] libmachine: Parsing certificate...
	I1030 16:08:25.077251    2521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:08:25.077286    2521 main.go:141] libmachine: Decoding PEM data...
	I1030 16:08:25.077308    2521 main.go:141] libmachine: Parsing certificate...
	I1030 16:08:25.077320    2521 main.go:141] libmachine: Running pre-create checks...
	I1030 16:08:25.077329    2521 main.go:141] libmachine: (multinode-337000) Calling .PreCreateCheck
	I1030 16:08:25.077404    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:25.077568    2521 main.go:141] libmachine: (multinode-337000) Calling .GetConfigRaw
	I1030 16:08:25.087611    2521 main.go:141] libmachine: Creating machine...
	I1030 16:08:25.087635    2521 main.go:141] libmachine: (multinode-337000) Calling .Create
	I1030 16:08:25.087862    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:25.088210    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:25.087865    2529 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:08:25.088310    2521 main.go:141] libmachine: (multinode-337000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:08:25.250492    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:25.250378    2529 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/id_rsa...
	I1030 16:08:25.626661    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:25.626536    2529 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/multinode-337000.rawdisk...
	I1030 16:08:25.626678    2521 main.go:141] libmachine: (multinode-337000) DBG | Writing magic tar header
	I1030 16:08:25.626692    2521 main.go:141] libmachine: (multinode-337000) DBG | Writing SSH key tar header
	I1030 16:08:25.627497    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:25.627327    2529 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000 ...
	I1030 16:08:25.951644    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:25.951664    2521 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:08:25.951691    2521 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3a768d86-7779-11ee-9aeb-149d997fca88
	I1030 16:08:25.988559    2521 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:08:25.988613    2521 client.go:171] LocalClient.Create took 911.499195ms
	I1030 16:08:27.988844    2521 start.go:128] duration metric: createHost completed in 2.944155086s
	I1030 16:08:27.988893    2521 start.go:83] releasing machines lock for "multinode-337000", held for 2.944337178s
	W1030 16:08:27.988921    2521 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:08:27.989525    2521 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:08:27.989566    2521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:08:27.998691    2521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49858
	I1030 16:08:27.999249    2521 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:08:27.999725    2521 main.go:141] libmachine: Using API Version  1
	I1030 16:08:27.999739    2521 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:08:28.000021    2521 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:08:28.000367    2521 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:08:28.000409    2521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:08:28.008859    2521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49860
	I1030 16:08:28.009212    2521 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:08:28.009609    2521 main.go:141] libmachine: Using API Version  1
	I1030 16:08:28.009625    2521 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:08:28.009891    2521 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:08:28.010032    2521 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:08:28.010117    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:28.010141    2521 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:08:28.010168    2521 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:08:28.010174    2521 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:08:28.054735    2521 out.go:177] * Deleting "multinode-337000" in hyperkit ...
	I1030 16:08:28.076588    2521 main.go:141] libmachine: (multinode-337000) Calling .Remove
	I1030 16:08:28.076914    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:28.076938    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:28.076967    2521 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:08:28.077012    2521 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	W1030 16:08:28.090142    2521 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:08:28.090155    2521 start.go:706] Will try again in 5 seconds ...
	I1030 16:08:33.092430    2521 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:08:33.092618    2521 start.go:369] acquired machines lock for "multinode-337000" in 151.931µs
	I1030 16:08:33.092652    2521 start.go:93] Provisioning new machine with config: &{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:08:33.092772    2521 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:08:33.116694    2521 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:08:33.116855    2521 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:08:33.116905    2521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:08:33.127253    2521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49862
	I1030 16:08:33.127780    2521 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:08:33.128268    2521 main.go:141] libmachine: Using API Version  1
	I1030 16:08:33.128296    2521 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:08:33.128600    2521 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:08:33.128711    2521 main.go:141] libmachine: (multinode-337000) Calling .GetMachineName
	I1030 16:08:33.128786    2521 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:08:33.128878    2521 start.go:159] libmachine.API.Create for "multinode-337000" (driver="hyperkit")
	I1030 16:08:33.128897    2521 client.go:168] LocalClient.Create starting
	I1030 16:08:33.128922    2521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:08:33.128976    2521 main.go:141] libmachine: Decoding PEM data...
	I1030 16:08:33.128988    2521 main.go:141] libmachine: Parsing certificate...
	I1030 16:08:33.129028    2521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:08:33.129061    2521 main.go:141] libmachine: Decoding PEM data...
	I1030 16:08:33.129073    2521 main.go:141] libmachine: Parsing certificate...
	I1030 16:08:33.129086    2521 main.go:141] libmachine: Running pre-create checks...
	I1030 16:08:33.129096    2521 main.go:141] libmachine: (multinode-337000) Calling .PreCreateCheck
	I1030 16:08:33.129174    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:33.129184    2521 main.go:141] libmachine: (multinode-337000) Calling .GetConfigRaw
	I1030 16:08:33.129574    2521 main.go:141] libmachine: Creating machine...
	I1030 16:08:33.129583    2521 main.go:141] libmachine: (multinode-337000) Calling .Create
	I1030 16:08:33.129657    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:33.129813    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:33.129659    2533 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:08:33.129857    2521 main.go:141] libmachine: (multinode-337000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:08:33.291361    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:33.291297    2533 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/id_rsa...
	I1030 16:08:33.381152    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:33.381053    2533 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/multinode-337000.rawdisk...
	I1030 16:08:33.381171    2521 main.go:141] libmachine: (multinode-337000) DBG | Writing magic tar header
	I1030 16:08:33.381182    2521 main.go:141] libmachine: (multinode-337000) DBG | Writing SSH key tar header
	I1030 16:08:33.381921    2521 main.go:141] libmachine: (multinode-337000) DBG | I1030 16:08:33.381828    2533 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000 ...
	I1030 16:08:33.713149    2521 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:08:33.713183    2521 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:08:33.713202    2521 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3f42fe12-7779-11ee-9aeb-149d997fca88
	I1030 16:08:33.750190    2521 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:08:33.750269    2521 client.go:171] LocalClient.Create took 621.364323ms
	I1030 16:08:35.751839    2521 start.go:128] duration metric: createHost completed in 2.659048998s
	I1030 16:08:35.751871    2521 start.go:83] releasing machines lock for "multinode-337000", held for 2.659238654s
	W1030 16:08:35.752022    2521 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:08:35.793524    2521 out.go:177] 
	W1030 16:08:35.816727    2521 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:08:35.816797    2521 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:08:35.816822    2521 out.go:239] * Related issues:
	* Related issues:
	W1030 16:08:35.816856    2521 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:08:35.816881    2521 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:08:35.838638    2521 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:87: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-337000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (65.830516ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (11.35s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (89.07s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:481: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (57.45393ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:483: failed to create busybox deployment to multinode cluster
multinode_test.go:486: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- rollout status deployment/busybox: exit status 1 (56.320619ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:488: failed to deploy busybox to multinode cluster
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (57.677349ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (62.295378ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (60.361442ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (61.743433ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (61.850363ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (63.941215ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (64.512903ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (65.005156ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (63.40024ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (61.836177ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (60.301388ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:512: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:516: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:516: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.435819ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:518: failed get Pod names
multinode_test.go:524: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.io: exit status 1 (56.911531ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:526: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.default: exit status 1 (57.235335ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:536: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:542: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (56.736297ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:544: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (67.270377ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (89.07s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.13s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:552: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-337000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (59.864787ms)

                                                
                                                
** stderr ** 
	Error running /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: fork/exec /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl: exec format error

                                                
                                                
** /stderr **
multinode_test.go:554: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (66.464861ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.13s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-337000 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-337000 -v 3 --alsologtostderr: exit status 89 (131.580213ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-337000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:05.223663    2613 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:05.223954    2613 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.223959    2613 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:05.223963    2613 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.224147    2613 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:05.224494    2613 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:05.224773    2613 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:05.225120    2613 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:05.225167    2613 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:05.232696    2613 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49873
	I1030 16:10:05.233097    2613 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:05.233533    2613 main.go:141] libmachine: Using API Version  1
	I1030 16:10:05.233545    2613 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:05.233757    2613 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:05.233870    2613 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:05.233962    2613 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:05.233976    2613 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:05.233989    2613 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:05.256257    2613 out.go:177] * The control plane node must be running for this command
	I1030 16:10:05.278000    2613 out.go:177]   To start a cluster, run: "minikube start -p multinode-337000"

                                                
                                                
** /stderr **
multinode_test.go:112: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-337000 -v 3 --alsologtostderr" : exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (66.301094ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.20s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
multinode_test.go:155: expected profile "multinode-337000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-337000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-337000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"VMDriver\":\"\",\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMH
idden\":false,\"KVMNUMACount\":1,\"APIServerPort\":0,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.3\",\"ClusterName\":\"multinode-337000\",\"Namespace\":\"default\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\",\"NodeIP\":\"\",\"NodePort\":8443,\"NodeName\":\"\"},\"Nodes\":[{\"Name\":
\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.3\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"
SSHAgentPID\":0,\"AutoPauseInterval\":60000000000,\"GPUs\":\"\"},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (65.600832ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.20s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.13s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status --output json --alsologtostderr
multinode_test.go:173: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status --output json --alsologtostderr: exit status 7 (65.87401ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-337000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:05.627749    2627 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:05.628043    2627 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.628050    2627 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:05.628054    2627 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.628265    2627 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:05.628452    2627 out.go:303] Setting JSON to true
	I1030 16:10:05.628474    2627 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:05.628521    2627 notify.go:220] Checking for updates...
	I1030 16:10:05.628761    2627 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:05.628771    2627 status.go:255] checking status of multinode-337000 ...
	I1030 16:10:05.629126    2627 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:05.629175    2627 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:05.637254    2627 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49885
	I1030 16:10:05.637564    2627 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:05.637974    2627 main.go:141] libmachine: Using API Version  1
	I1030 16:10:05.637985    2627 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:05.638244    2627 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:05.638362    2627 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:05.638447    2627 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:05.638469    2627 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:05.638478    2627 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:05.638491    2627 status.go:330] multinode-337000 host status = "Stopped" (err=<nil>)
	I1030 16:10:05.638498    2627 status.go:343] host is not running, skipping remaining checks
	I1030 16:10:05.638504    2627 status.go:257] multinode-337000 status: &{Name:multinode-337000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:180: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-337000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (66.228572ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.13s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 node stop m03
multinode_test.go:210: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 node stop m03: exit status 85 (150.086269ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:212: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-337000 node stop m03": exit status 85
multinode_test.go:216: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status: exit status 7 (65.791518ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr: exit status 7 (65.598173ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:05.976967    2641 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:05.977237    2641 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.977244    2641 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:05.977248    2641 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:05.977424    2641 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:05.977589    2641 out.go:303] Setting JSON to false
	I1030 16:10:05.977611    2641 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:05.977650    2641 notify.go:220] Checking for updates...
	I1030 16:10:05.977868    2641 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:05.977876    2641 status.go:255] checking status of multinode-337000 ...
	I1030 16:10:05.978202    2641 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:05.978246    2641 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:05.986096    2641 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49894
	I1030 16:10:05.986400    2641 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:05.986805    2641 main.go:141] libmachine: Using API Version  1
	I1030 16:10:05.986837    2641 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:05.987027    2641 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:05.987146    2641 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:05.987224    2641 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:05.987286    2641 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:05.987315    2641 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:05.987321    2641 status.go:330] multinode-337000 host status = "Stopped" (err=<nil>)
	I1030 16:10:05.987331    2641 status.go:343] host is not running, skipping remaining checks
	I1030 16:10:05.987337    2641 status.go:257] multinode-337000 status: &{Name:multinode-337000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:229: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr": multinode-337000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (66.476819ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.35s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (0.28s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 node start m03 --alsologtostderr: exit status 85 (146.900955ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:06.108916    2647 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:06.109197    2647 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:06.109202    2647 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:06.109206    2647 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:06.109379    2647 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:06.109709    2647 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:06.110026    2647 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:06.131601    2647 out.go:177] 
	W1030 16:10:06.153150    2647 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W1030 16:10:06.153174    2647 out.go:239] * 
	* 
	W1030 16:10:06.156429    2647 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I1030 16:10:06.178061    2647 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:256: I1030 16:10:06.108916    2647 out.go:296] Setting OutFile to fd 1 ...
I1030 16:10:06.109197    2647 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:10:06.109202    2647 out.go:309] Setting ErrFile to fd 2...
I1030 16:10:06.109206    2647 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1030 16:10:06.109379    2647 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
I1030 16:10:06.109709    2647 mustload.go:65] Loading cluster: multinode-337000
I1030 16:10:06.110026    2647 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
I1030 16:10:06.131601    2647 out.go:177] 
W1030 16:10:06.153150    2647 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W1030 16:10:06.153174    2647 out.go:239] * 
* 
W1030 16:10:06.156429    2647 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I1030 16:10:06.178061    2647 out.go:177] 
multinode_test.go:257: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-337000 node start m03 --alsologtostderr": exit status 85
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status: exit status 7 (66.413319ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:263: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-337000 status" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (65.445383ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (6.23s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-337000
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-337000
multinode_test.go:295: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-337000 --wait=true -v=8 --alsologtostderr
multinode_test.go:295: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-337000 --wait=true -v=8 --alsologtostderr: exit status 60 (5.827427352s)

                                                
                                                
-- stdout --
	* [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node multinode-337000 in cluster multinode-337000
	* Restarting existing hyperkit VM for "multinode-337000" ...
	* Restarting existing hyperkit VM for "multinode-337000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:06.669794    2660 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:06.670037    2660 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:06.670042    2660 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:06.670046    2660 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:06.670235    2660 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:06.672082    2660 out.go:303] Setting JSON to false
	I1030 16:10:06.694481    2660 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":581,"bootTime":1698706825,"procs":443,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:10:06.694573    2660 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:10:06.716854    2660 out.go:177] * [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:10:06.760238    2660 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:10:06.760343    2660 notify.go:220] Checking for updates...
	I1030 16:10:06.804296    2660 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:10:06.826317    2660 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:10:06.847431    2660 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:10:06.869358    2660 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:10:06.891391    2660 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:10:06.913081    2660 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:06.913252    2660 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:10:06.913909    2660 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:06.913994    2660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:06.922780    2660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49908
	I1030 16:10:06.923116    2660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:06.923517    2660 main.go:141] libmachine: Using API Version  1
	I1030 16:10:06.923530    2660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:06.923793    2660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:06.923907    2660 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:06.952451    2660 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:10:06.995459    2660 start.go:298] selected driver: hyperkit
	I1030 16:10:06.995487    2660 start.go:902] validating driver "hyperkit" against &{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:10:06.995682    2660 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:10:06.995863    2660 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:06.996041    2660 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:10:07.005240    2660 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:10:07.009017    2660 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:07.009035    2660 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:10:07.011700    2660 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:10:07.011774    2660 cni.go:84] Creating CNI manager for ""
	I1030 16:10:07.011782    2660 cni.go:136] 1 nodes found, recommending kindnet
	I1030 16:10:07.011792    2660 start_flags.go:323] config:
	{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpti
mizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:10:07.011961    2660 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:07.054374    2660 out.go:177] * Starting control plane node multinode-337000 in cluster multinode-337000
	I1030 16:10:07.076441    2660 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:10:07.076572    2660 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:10:07.076617    2660 cache.go:56] Caching tarball of preloaded images
	I1030 16:10:07.076771    2660 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:10:07.076785    2660 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:10:07.076916    2660 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/multinode-337000/config.json ...
	I1030 16:10:07.077619    2660 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:07.077704    2660 start.go:369] acquired machines lock for "multinode-337000" in 65.752µs
	I1030 16:10:07.077731    2660 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:10:07.077741    2660 fix.go:54] fixHost starting: 
	I1030 16:10:07.078037    2660 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:07.078069    2660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:07.086038    2660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49910
	I1030 16:10:07.086374    2660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:07.086735    2660 main.go:141] libmachine: Using API Version  1
	I1030 16:10:07.086750    2660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:07.086973    2660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:07.087081    2660 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:07.087186    2660 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:07.087272    2660 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:07.087299    2660 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:07.087322    2660 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:07.087359    2660 fix.go:102] recreateIfNeeded on multinode-337000: state=Stopped err=<nil>
	I1030 16:10:07.087375    2660 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	W1030 16:10:07.087458    2660 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:10:07.108392    2660 out.go:177] * Restarting existing hyperkit VM for "multinode-337000" ...
	I1030 16:10:07.150348    2660 main.go:141] libmachine: (multinode-337000) Calling .Start
	I1030 16:10:07.150608    2660 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:07.150660    2660 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:10:07.150748    2660 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3f42fe12-7779-11ee-9aeb-149d997fca88
	I1030 16:10:07.190349    2660 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:07.190466    2660 fix.go:56] fixHost completed within 112.724995ms
	I1030 16:10:07.190478    2660 start.go:83] releasing machines lock for "multinode-337000", held for 112.76541ms
	W1030 16:10:07.190490    2660 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:10:07.190540    2660 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:07.190547    2660 start.go:706] Will try again in 5 seconds ...
	I1030 16:10:12.192757    2660 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:12.192928    2660 start.go:369] acquired machines lock for "multinode-337000" in 138.465µs
	I1030 16:10:12.192964    2660 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:10:12.192972    2660 fix.go:54] fixHost starting: 
	I1030 16:10:12.193396    2660 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:12.193437    2660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:12.203062    2660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49912
	I1030 16:10:12.203678    2660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:12.204269    2660 main.go:141] libmachine: Using API Version  1
	I1030 16:10:12.204293    2660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:12.204510    2660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:12.204624    2660 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:12.204725    2660 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:12.204802    2660 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:12.204827    2660 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:12.204832    2660 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:12.204864    2660 fix.go:102] recreateIfNeeded on multinode-337000: state=Stopped err=<nil>
	I1030 16:10:12.204879    2660 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	W1030 16:10:12.204959    2660 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:10:12.226825    2660 out.go:177] * Restarting existing hyperkit VM for "multinode-337000" ...
	I1030 16:10:12.269641    2660 main.go:141] libmachine: (multinode-337000) Calling .Start
	I1030 16:10:12.269918    2660 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:12.269949    2660 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:10:12.270128    2660 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3f42fe12-7779-11ee-9aeb-149d997fca88
	I1030 16:10:12.272205    2660 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:12.272304    2660 fix.go:56] fixHost completed within 79.331808ms
	I1030 16:10:12.272317    2660 start.go:83] releasing machines lock for "multinode-337000", held for 79.376462ms
	W1030 16:10:12.272421    2660 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:12.314299    2660 out.go:177] 
	W1030 16:10:12.335574    2660 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:10:12.335641    2660 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:10:12.335665    2660 out.go:239] * Related issues:
	* Related issues:
	W1030 16:10:12.335722    2660 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:10:12.335743    2660 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:10:12.378310    2660 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:297: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-337000" : exit status 60
multinode_test.go:300: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-337000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (64.82851ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (6.23s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 node delete m03
multinode_test.go:394: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 node delete m03: exit status 89 (132.147829ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-337000"

                                                
                                                
-- /stdout --
multinode_test.go:396: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-337000 node delete m03": exit status 89
multinode_test.go:400: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr
multinode_test.go:400: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr: exit status 7 (66.602516ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:12.751556    2680 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:12.751756    2680 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:12.751761    2680 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:12.751766    2680 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:12.751960    2680 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:12.752151    2680 out.go:303] Setting JSON to false
	I1030 16:10:12.752174    2680 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:12.752221    2680 notify.go:220] Checking for updates...
	I1030 16:10:12.752460    2680 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:12.752469    2680 status.go:255] checking status of multinode-337000 ...
	I1030 16:10:12.752819    2680 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:12.752861    2680 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:12.760637    2680 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49920
	I1030 16:10:12.761045    2680 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:12.761484    2680 main.go:141] libmachine: Using API Version  1
	I1030 16:10:12.761494    2680 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:12.761705    2680 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:12.761801    2680 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:12.761911    2680 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:12.761930    2680 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:12.761939    2680 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:12.761939    2680 status.go:330] multinode-337000 host status = "Stopped" (err=<nil>)
	I1030 16:10:12.761948    2680 status.go:343] host is not running, skipping remaining checks
	I1030 16:10:12.761954    2680 status.go:257] multinode-337000 status: &{Name:multinode-337000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:402: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (67.551346ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.27s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (0.42s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 stop
multinode_test.go:320: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status: exit status 7 (68.516187ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr: exit status 7 (65.45794ms)

                                                
                                                
-- stdout --
	multinode-337000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:13.176975    2692 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:13.177270    2692 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:13.177276    2692 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:13.177280    2692 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:13.177462    2692 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:13.177640    2692 out.go:303] Setting JSON to false
	I1030 16:10:13.177664    2692 mustload.go:65] Loading cluster: multinode-337000
	I1030 16:10:13.177700    2692 notify.go:220] Checking for updates...
	I1030 16:10:13.177930    2692 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:13.177940    2692 status.go:255] checking status of multinode-337000 ...
	I1030 16:10:13.178286    2692 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:13.178339    2692 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:13.186179    2692 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49931
	I1030 16:10:13.186493    2692 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:13.186899    2692 main.go:141] libmachine: Using API Version  1
	I1030 16:10:13.186910    2692 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:13.187100    2692 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:13.187213    2692 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:13.187320    2692 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:13.187336    2692 status.go:330] multinode-337000 host status = "Stopped" (err=<nil>)
	I1030 16:10:13.187342    2692 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:13.187343    2692 status.go:343] host is not running, skipping remaining checks
	I1030 16:10:13.187353    2692 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:13.187350    2692 status.go:257] multinode-337000 status: &{Name:multinode-337000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:333: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr": multinode-337000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:337: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-337000 status --alsologtostderr": multinode-337000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (65.337733ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (0.42s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.85s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-337000 --wait=true -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:354: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-337000 --wait=true -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (5.774731003s)

                                                
                                                
-- stdout --
	* [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node multinode-337000 in cluster multinode-337000
	* Restarting existing hyperkit VM for "multinode-337000" ...
	* Restarting existing hyperkit VM for "multinode-337000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:13.307354    2698 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:13.307643    2698 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:13.307649    2698 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:13.307653    2698 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:13.307854    2698 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:13.309202    2698 out.go:303] Setting JSON to false
	I1030 16:10:13.330957    2698 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":588,"bootTime":1698706825,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:10:13.331064    2698 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:10:13.352883    2698 out.go:177] * [multinode-337000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:10:13.395590    2698 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:10:13.395709    2698 notify.go:220] Checking for updates...
	I1030 16:10:13.417592    2698 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:10:13.439823    2698 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:10:13.461591    2698 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:10:13.483634    2698 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:10:13.506409    2698 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:10:13.528212    2698 config.go:182] Loaded profile config "multinode-337000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:13.528865    2698 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:13.528946    2698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:13.537974    2698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49937
	I1030 16:10:13.538330    2698 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:13.538765    2698 main.go:141] libmachine: Using API Version  1
	I1030 16:10:13.538777    2698 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:13.539068    2698 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:13.539183    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:13.539364    2698 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:10:13.539600    2698 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:13.539639    2698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:13.547206    2698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49939
	I1030 16:10:13.547500    2698 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:13.547840    2698 main.go:141] libmachine: Using API Version  1
	I1030 16:10:13.547854    2698 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:13.548058    2698 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:13.548151    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:13.576464    2698 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:10:13.618525    2698 start.go:298] selected driver: hyperkit
	I1030 16:10:13.618554    2698 start.go:902] validating driver "hyperkit" against &{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:10:13.618751    2698 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:10:13.618945    2698 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:13.619120    2698 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:10:13.628285    2698 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:10:13.632035    2698 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:13.632063    2698 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:10:13.634601    2698 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:10:13.634672    2698 cni.go:84] Creating CNI manager for ""
	I1030 16:10:13.634681    2698 cni.go:136] 1 nodes found, recommending kindnet
	I1030 16:10:13.634691    2698 start_flags.go:323] config:
	{Name:multinode-337000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:multinode-337000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpti
mizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:10:13.634871    2698 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:13.678319    2698 out.go:177] * Starting control plane node multinode-337000 in cluster multinode-337000
	I1030 16:10:13.699360    2698 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:10:13.699435    2698 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:10:13.699465    2698 cache.go:56] Caching tarball of preloaded images
	I1030 16:10:13.699655    2698 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:10:13.699672    2698 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:10:13.699822    2698 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/multinode-337000/config.json ...
	I1030 16:10:13.700763    2698 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:13.700856    2698 start.go:369] acquired machines lock for "multinode-337000" in 69.473µs
	I1030 16:10:13.700892    2698 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:10:13.700909    2698 fix.go:54] fixHost starting: 
	I1030 16:10:13.701344    2698 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:13.701382    2698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:13.710273    2698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49941
	I1030 16:10:13.710618    2698 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:13.710994    2698 main.go:141] libmachine: Using API Version  1
	I1030 16:10:13.711008    2698 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:13.711225    2698 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:13.711343    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:13.711441    2698 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:13.711532    2698 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:13.711553    2698 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:13.711567    2698 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:13.711568    2698 fix.go:102] recreateIfNeeded on multinode-337000: state=Stopped err=<nil>
	I1030 16:10:13.711589    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	W1030 16:10:13.711675    2698 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:10:13.753201    2698 out.go:177] * Restarting existing hyperkit VM for "multinode-337000" ...
	I1030 16:10:13.774560    2698 main.go:141] libmachine: (multinode-337000) Calling .Start
	I1030 16:10:13.774806    2698 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:13.774944    2698 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:10:13.775006    2698 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3f42fe12-7779-11ee-9aeb-149d997fca88
	I1030 16:10:13.777241    2698 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:13.777348    2698 fix.go:56] fixHost completed within 76.442576ms
	I1030 16:10:13.777362    2698 start.go:83] releasing machines lock for "multinode-337000", held for 76.494201ms
	W1030 16:10:13.777378    2698 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:10:13.777453    2698 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:13.777462    2698 start.go:706] Will try again in 5 seconds ...
	I1030 16:10:18.779636    2698 start.go:365] acquiring machines lock for multinode-337000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:18.779831    2698 start.go:369] acquired machines lock for "multinode-337000" in 128.513µs
	I1030 16:10:18.779864    2698 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:10:18.779871    2698 fix.go:54] fixHost starting: 
	I1030 16:10:18.780265    2698 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:18.780304    2698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:18.790209    2698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49943
	I1030 16:10:18.790743    2698 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:18.791191    2698 main.go:141] libmachine: Using API Version  1
	I1030 16:10:18.791202    2698 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:18.791491    2698 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:18.791645    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	I1030 16:10:18.791732    2698 main.go:141] libmachine: (multinode-337000) Calling .GetState
	I1030 16:10:18.791813    2698 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:18.791843    2698 main.go:141] libmachine: (multinode-337000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.json: no such file or directory
	I1030 16:10:18.791855    2698 main.go:141] libmachine: (multinode-337000) DBG | hyperkit pid from json: 0
	I1030 16:10:18.791860    2698 fix.go:102] recreateIfNeeded on multinode-337000: state=Stopped err=<nil>
	I1030 16:10:18.791875    2698 main.go:141] libmachine: (multinode-337000) Calling .DriverName
	W1030 16:10:18.791966    2698 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:10:18.835311    2698 out.go:177] * Restarting existing hyperkit VM for "multinode-337000" ...
	I1030 16:10:18.856512    2698 main.go:141] libmachine: (multinode-337000) Calling .Start
	I1030 16:10:18.856802    2698 main.go:141] libmachine: (multinode-337000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:18.856873    2698 main.go:141] libmachine: (multinode-337000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/multinode-337000/hyperkit.pid
	I1030 16:10:18.856922    2698 main.go:141] libmachine: (multinode-337000) DBG | Using UUID 3f42fe12-7779-11ee-9aeb-149d997fca88
	I1030 16:10:18.858912    2698 main.go:141] libmachine: (multinode-337000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:18.859025    2698 fix.go:56] fixHost completed within 79.153702ms
	I1030 16:10:18.859036    2698 start.go:83] releasing machines lock for "multinode-337000", held for 79.193407ms
	W1030 16:10:18.859113    2698 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-337000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:18.902298    2698 out.go:177] 
	W1030 16:10:18.923610    2698 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:10:18.923676    2698 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:10:18.923699    2698 out.go:239] * Related issues:
	* Related issues:
	W1030 16:10:18.923741    2698 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:10:18.923762    2698 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:10:18.945409    2698 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:356: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-337000 --wait=true -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (70.533003ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.85s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (22.88s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-337000
multinode_test.go:452: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-337000-m01 --driver=hyperkit 
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-337000-m01 --driver=hyperkit : exit status 60 (11.156782976s)

                                                
                                                
-- stdout --
	* [multinode-337000-m01] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node multinode-337000-m01 in cluster multinode-337000-m01
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-337000-m01" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-337000-m01" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-337000-m02 --driver=hyperkit 
multinode_test.go:460: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-337000-m02 --driver=hyperkit : exit status 60 (11.20591402s)

                                                
                                                
-- stdout --
	* [multinode-337000-m02] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node multinode-337000-m02 in cluster multinode-337000-m02
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-337000-m02" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-337000-m02" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:462: failed to start profile. args "out/minikube-darwin-amd64 start -p multinode-337000-m02 --driver=hyperkit " : exit status 60
multinode_test.go:467: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-337000
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-337000: exit status 89 (136.271819ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p multinode-337000"

                                                
                                                
-- /stdout --
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 delete -p multinode-337000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-337000 -n multinode-337000: exit status 7 (68.804155ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-337000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (22.88s)

                                                
                                    
x
+
TestPreload (11.42s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p test-preload-125000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p test-preload-125000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4: exit status 60 (11.101124303s)

                                                
                                                
-- stdout --
	* [test-preload-125000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node test-preload-125000 in cluster test-preload-125000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "test-preload-125000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:10:42.358721    2769 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:10:42.359001    2769 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:42.359006    2769 out.go:309] Setting ErrFile to fd 2...
	I1030 16:10:42.359011    2769 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:10:42.359190    2769 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:10:42.360562    2769 out.go:303] Setting JSON to false
	I1030 16:10:42.382558    2769 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":617,"bootTime":1698706825,"procs":439,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:10:42.382676    2769 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:10:42.405034    2769 out.go:177] * [test-preload-125000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:10:42.448622    2769 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:10:42.448711    2769 notify.go:220] Checking for updates...
	I1030 16:10:42.470800    2769 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:10:42.492633    2769 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:10:42.513415    2769 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:10:42.534574    2769 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:10:42.555740    2769 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:10:42.578371    2769 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:10:42.578539    2769 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:10:42.608725    2769 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:10:42.650512    2769 start.go:298] selected driver: hyperkit
	I1030 16:10:42.650541    2769 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:10:42.650559    2769 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:10:42.654959    2769 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.655100    2769 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:10:42.663263    2769 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:10:42.667478    2769 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:42.667496    2769 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:10:42.667539    2769 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:10:42.667746    2769 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:10:42.667776    2769 cni.go:84] Creating CNI manager for ""
	I1030 16:10:42.667790    2769 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:10:42.667796    2769 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:10:42.667805    2769 start_flags.go:323] config:
	{Name:test-preload-125000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-125000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:10:42.667944    2769 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.711664    2769 out.go:177] * Starting control plane node test-preload-125000 in cluster test-preload-125000
	I1030 16:10:42.733432    2769 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I1030 16:10:42.733619    2769 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/test-preload-125000/config.json ...
	I1030 16:10:42.733678    2769 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/test-preload-125000/config.json: {Name:mk3a196ce6ca16f7d3e92e16c2260d9d30d2d44f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:10:42.733783    2769 cache.go:107] acquiring lock: {Name:mke062db5e61ff1e367259314e8f23567df815d2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.733827    2769 cache.go:107] acquiring lock: {Name:mk8947116383bfe4244ea777454c3cd85a35424a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.733803    2769 cache.go:107] acquiring lock: {Name:mkcb03cd23f5a869523d93f3808aa05a24ff2443 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.733918    2769 cache.go:107] acquiring lock: {Name:mk5b3284b34617b10d1af97893be94cf5bee7b56 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.734003    2769 cache.go:107] acquiring lock: {Name:mkd69426bc2c6082c494f84d36b51e97265737b3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.734044    2769 cache.go:107] acquiring lock: {Name:mkeb9d7a6e5ab0fdee0c85e98ecb6d5d3121f603 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.734134    2769 cache.go:107] acquiring lock: {Name:mk585ee38decd598b83079d91d479906a4e68ece Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.734166    2769 cache.go:107] acquiring lock: {Name:mkf9f1db9d3963c2668eb7cf5168b30d0e5589dc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:10:42.734548    2769 start.go:365] acquiring machines lock for test-preload-125000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:42.734638    2769 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I1030 16:10:42.734721    2769 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I1030 16:10:42.734765    2769 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 16:10:42.734826    2769 start.go:369] acquired machines lock for "test-preload-125000" in 249.038µs
	I1030 16:10:42.734884    2769 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1030 16:10:42.734939    2769 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I1030 16:10:42.734949    2769 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I1030 16:10:42.734910    2769 start.go:93] Provisioning new machine with config: &{Name:test-preload-125000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubern
etesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-125000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:10:42.735058    2769 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I1030 16:10:42.735065    2769 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:10:42.735080    2769 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I1030 16:10:42.757593    2769 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:10:42.758073    2769 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:42.758152    2769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:42.767552    2769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49983
	I1030 16:10:42.767869    2769 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:42.768272    2769 main.go:141] libmachine: Using API Version  1
	I1030 16:10:42.768282    2769 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:42.768512    2769 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:42.768614    2769 main.go:141] libmachine: (test-preload-125000) Calling .GetMachineName
	I1030 16:10:42.768690    2769 main.go:141] libmachine: (test-preload-125000) Calling .DriverName
	I1030 16:10:42.768790    2769 start.go:159] libmachine.API.Create for "test-preload-125000" (driver="hyperkit")
	I1030 16:10:42.768820    2769 client.go:168] LocalClient.Create starting
	I1030 16:10:42.768847    2769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:10:42.768892    2769 main.go:141] libmachine: Decoding PEM data...
	I1030 16:10:42.768906    2769 main.go:141] libmachine: Parsing certificate...
	I1030 16:10:42.768975    2769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:10:42.769016    2769 main.go:141] libmachine: Decoding PEM data...
	I1030 16:10:42.769027    2769 main.go:141] libmachine: Parsing certificate...
	I1030 16:10:42.769041    2769 main.go:141] libmachine: Running pre-create checks...
	I1030 16:10:42.769050    2769 main.go:141] libmachine: (test-preload-125000) Calling .PreCreateCheck
	I1030 16:10:42.769132    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:42.769332    2769 main.go:141] libmachine: (test-preload-125000) Calling .GetConfigRaw
	I1030 16:10:42.778863    2769 main.go:141] libmachine: Creating machine...
	I1030 16:10:42.778878    2769 main.go:141] libmachine: (test-preload-125000) Calling .Create
	I1030 16:10:42.779017    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:42.779286    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:42.779002    2777 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:10:42.779406    2769 main.go:141] libmachine: (test-preload-125000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:10:42.781326    2769 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I1030 16:10:42.782681    2769 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I1030 16:10:42.784199    2769 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I1030 16:10:42.784668    2769 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I1030 16:10:42.784819    2769 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I1030 16:10:42.785073    2769 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I1030 16:10:42.785082    2769 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I1030 16:10:42.785100    2769 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I1030 16:10:42.952368    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:42.952249    2777 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/id_rsa...
	I1030 16:10:43.054231    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:43.054082    2777 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/test-preload-125000.rawdisk...
	I1030 16:10:43.054264    2769 main.go:141] libmachine: (test-preload-125000) DBG | Writing magic tar header
	I1030 16:10:43.054276    2769 main.go:141] libmachine: (test-preload-125000) DBG | Writing SSH key tar header
	I1030 16:10:43.054730    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:43.054704    2777 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000 ...
	I1030 16:10:43.277127    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4
	I1030 16:10:43.295377    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6
	I1030 16:10:43.297550    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4
	I1030 16:10:43.317459    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0
	I1030 16:10:43.359633    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4
	I1030 16:10:43.384099    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:43.384116    2769 main.go:141] libmachine: (test-preload-125000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/hyperkit.pid
	I1030 16:10:43.384177    2769 main.go:141] libmachine: (test-preload-125000) DBG | Using UUID 8c88a122-7779-11ee-96c0-149d997fca88
	I1030 16:10:43.419470    2769 main.go:141] libmachine: (test-preload-125000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:43.419562    2769 client.go:171] LocalClient.Create took 650.730684ms
	I1030 16:10:43.438997    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I1030 16:10:43.469189    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7
	I1030 16:10:43.484425    2769 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4
	I1030 16:10:43.663995    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1030 16:10:43.664016    2769 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 930.243307ms
	I1030 16:10:43.664025    2769 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1030 16:10:43.694680    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 exists
	I1030 16:10:43.694693    2769 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7" took 960.616378ms
	I1030 16:10:43.694699    2769 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 succeeded
	I1030 16:10:44.887676    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I1030 16:10:44.887696    2769 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6" took 2.153774915s
	I1030 16:10:44.887706    2769 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I1030 16:10:45.419721    2769 start.go:128] duration metric: createHost completed in 2.684640631s
	I1030 16:10:45.419735    2769 start.go:83] releasing machines lock for "test-preload-125000", held for 2.684889364s
	W1030 16:10:45.419752    2769 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:10:45.420038    2769 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:45.420057    2769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:45.428119    2769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49997
	I1030 16:10:45.428604    2769 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:45.428957    2769 main.go:141] libmachine: Using API Version  1
	I1030 16:10:45.428969    2769 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:45.429164    2769 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:45.429489    2769 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:45.429515    2769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:45.437302    2769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49999
	I1030 16:10:45.437629    2769 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:45.437968    2769 main.go:141] libmachine: Using API Version  1
	I1030 16:10:45.437983    2769 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:45.438183    2769 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:45.438285    2769 main.go:141] libmachine: (test-preload-125000) Calling .GetState
	I1030 16:10:45.438369    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:45.438387    2769 main.go:141] libmachine: (test-preload-125000) DBG | hyperkit pid from json: 0
	I1030 16:10:45.438410    2769 main.go:141] libmachine: (test-preload-125000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/hyperkit.json: no such file or directory
	I1030 16:10:45.438444    2769 main.go:141] libmachine: (test-preload-125000) Calling .DriverName
	I1030 16:10:45.492143    2769 out.go:177] * Deleting "test-preload-125000" in hyperkit ...
	I1030 16:10:45.512934    2769 main.go:141] libmachine: (test-preload-125000) Calling .Remove
	I1030 16:10:45.513380    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:45.513425    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:45.513453    2769 main.go:141] libmachine: (test-preload-125000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/hyperkit.json: no such file or directory
	I1030 16:10:45.513486    2769 main.go:141] libmachine: (test-preload-125000) DBG | hyperkit pid from json: 0
	W1030 16:10:45.527095    2769 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:45.527110    2769 start.go:706] Will try again in 5 seconds ...
	I1030 16:10:46.840038    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I1030 16:10:46.840054    2769 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4" took 4.106141209s
	I1030 16:10:46.840062    2769 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I1030 16:10:48.394763    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I1030 16:10:48.394782    2769 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4" took 5.66073179s
	I1030 16:10:48.394792    2769 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I1030 16:10:49.239972    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I1030 16:10:49.239988    2769 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4" took 6.506193786s
	I1030 16:10:49.239997    2769 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I1030 16:10:49.448189    2769 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I1030 16:10:49.448209    2769 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4" took 6.714436762s
	I1030 16:10:49.448219    2769 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I1030 16:10:50.527551    2769 start.go:365] acquiring machines lock for test-preload-125000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:10:50.527728    2769 start.go:369] acquired machines lock for "test-preload-125000" in 141.546µs
	I1030 16:10:50.527770    2769 start.go:93] Provisioning new machine with config: &{Name:test-preload-125000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubern
etesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-125000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:
262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:10:50.527907    2769 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:10:50.578309    2769 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:10:50.578427    2769 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:10:50.578459    2769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:10:50.587154    2769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50001
	I1030 16:10:50.587508    2769 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:10:50.587869    2769 main.go:141] libmachine: Using API Version  1
	I1030 16:10:50.587884    2769 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:10:50.588090    2769 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:10:50.588189    2769 main.go:141] libmachine: (test-preload-125000) Calling .GetMachineName
	I1030 16:10:50.588270    2769 main.go:141] libmachine: (test-preload-125000) Calling .DriverName
	I1030 16:10:50.588407    2769 start.go:159] libmachine.API.Create for "test-preload-125000" (driver="hyperkit")
	I1030 16:10:50.588422    2769 client.go:168] LocalClient.Create starting
	I1030 16:10:50.588450    2769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:10:50.588501    2769 main.go:141] libmachine: Decoding PEM data...
	I1030 16:10:50.588511    2769 main.go:141] libmachine: Parsing certificate...
	I1030 16:10:50.588551    2769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:10:50.588589    2769 main.go:141] libmachine: Decoding PEM data...
	I1030 16:10:50.588599    2769 main.go:141] libmachine: Parsing certificate...
	I1030 16:10:50.588613    2769 main.go:141] libmachine: Running pre-create checks...
	I1030 16:10:50.588626    2769 main.go:141] libmachine: (test-preload-125000) Calling .PreCreateCheck
	I1030 16:10:50.588722    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:50.588748    2769 main.go:141] libmachine: (test-preload-125000) Calling .GetConfigRaw
	I1030 16:10:50.589193    2769 main.go:141] libmachine: Creating machine...
	I1030 16:10:50.589202    2769 main.go:141] libmachine: (test-preload-125000) Calling .Create
	I1030 16:10:50.589277    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:50.589427    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:50.589271    2815 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:10:50.589508    2769 main.go:141] libmachine: (test-preload-125000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:10:50.749810    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:50.749723    2815 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/id_rsa...
	I1030 16:10:50.890498    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:50.890453    2815 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/test-preload-125000.rawdisk...
	I1030 16:10:50.890515    2769 main.go:141] libmachine: (test-preload-125000) DBG | Writing magic tar header
	I1030 16:10:50.890529    2769 main.go:141] libmachine: (test-preload-125000) DBG | Writing SSH key tar header
	I1030 16:10:50.891113    2769 main.go:141] libmachine: (test-preload-125000) DBG | I1030 16:10:50.891065    2815 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000 ...
	I1030 16:10:51.213959    2769 main.go:141] libmachine: (test-preload-125000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I1030 16:10:51.213981    2769 main.go:141] libmachine: (test-preload-125000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/test-preload-125000/hyperkit.pid
	I1030 16:10:51.213992    2769 main.go:141] libmachine: (test-preload-125000) DBG | Using UUID 9131f822-7779-11ee-96c0-149d997fca88
	I1030 16:10:51.251281    2769 main.go:141] libmachine: (test-preload-125000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:10:51.251374    2769 client.go:171] LocalClient.Create took 662.945288ms
	I1030 16:10:53.251965    2769 start.go:128] duration metric: createHost completed in 2.724045109s
	I1030 16:10:53.251982    2769 start.go:83] releasing machines lock for "test-preload-125000", held for 2.724240089s
	W1030 16:10:53.252067    2769 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p test-preload-125000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p test-preload-125000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:10:53.274948    2769 out.go:177] 
	W1030 16:10:53.298607    2769 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:10:53.298701    2769 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:10:53.298730    2769 out.go:239] * Related issues:
	* Related issues:
	W1030 16:10:53.298773    2769 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:10:53.298816    2769 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:10:53.342648    2769 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-amd64 start -p test-preload-125000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4 failed: exit status 60
panic.go:523: *** TestPreload FAILED at 2023-10-30 16:10:53.40964 -0700 PDT m=+472.942921245
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-125000 -n test-preload-125000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-125000 -n test-preload-125000: exit status 7 (66.361425ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-125000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-125000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p test-preload-125000
--- FAIL: TestPreload (11.42s)

                                                
                                    
x
+
TestScheduledStopUnix (11.59s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 start -p scheduled-stop-982000 --memory=2048 --driver=hyperkit 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p scheduled-stop-982000 --memory=2048 --driver=hyperkit : exit status 60 (11.2677202s)

                                                
                                                
-- stdout --
	* [scheduled-stop-982000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node scheduled-stop-982000 in cluster scheduled-stop-982000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-982000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-982000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [scheduled-stop-982000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node scheduled-stop-982000 in cluster scheduled-stop-982000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-982000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-982000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:523: *** TestScheduledStopUnix FAILED at 2023-10-30 16:11:04.999114 -0700 PDT m=+484.532390998
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-982000 -n scheduled-stop-982000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-982000 -n scheduled-stop-982000: exit status 7 (67.970824ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-982000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-982000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p scheduled-stop-982000
--- FAIL: TestScheduledStopUnix (11.59s)

                                                
                                    
x
+
TestSkaffold (13.87s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/skaffold.exe4261140123 version
skaffold_test.go:63: skaffold version: v2.8.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-amd64 start -p skaffold-160000 --memory=2600 --driver=hyperkit 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p skaffold-160000 --memory=2600 --driver=hyperkit : exit status 60 (11.102023735s)

                                                
                                                
-- stdout --
	* [skaffold-160000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node skaffold-160000 in cluster skaffold-160000
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-160000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-160000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [skaffold-160000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node skaffold-160000 in cluster skaffold-160000
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-160000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-160000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:523: *** TestSkaffold FAILED at 2023-10-30 16:11:18.861743 -0700 PDT m=+498.395014479
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-160000 -n skaffold-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-160000 -n skaffold-160000: exit status 7 (68.974123ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-160000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-160000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p skaffold-160000
--- FAIL: TestSkaffold (13.87s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (10.16s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:133: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:133: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit : exit status 78 (5.962521351s)

                                                
                                                
-- stdout --
	! [running-upgrade-399000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig1744628608
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Downloading VM boot image ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

                                                
                                                
-- /stdout --
** stderr ** 
	* minikube 1.31.2 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.31.2
	* To disable this notice, run: 'minikube config set WantUpdateNotification false'
	
	    > minikube-v1.6.0.iso.sha256: 65 B / 65 B [--------------] 100.00% ? p/s 0s    > minikube-v1.6.0.iso: 8.00 MiB / 150.93 MiB [>_____________] 5.30% ? p/s ?    > minikube-v1.6.0.iso: 22.11 MiB / 150.93 MiB [->__________] 14.65% ? p/s ?    > minikube-v1.6.0.iso: 34.28 MiB / 150.93 MiB [-->_________] 22.71% ? p/s ?    > minikube-v1.6.0.iso: 48.00 MiB / 150.93 MiB [ 31.80% 66.91 MiB p/s ETA 1s    > minikube-v1.6.0.iso: 64.00 MiB / 150.93 MiB [ 42.40% 66.91 MiB p/s ETA 1s    > minikube-v1.6.0.iso: 79.73 MiB / 150.93 MiB [ 52.83% 66.91 MiB p/s ETA 1s    > minikube-v1.6.0.iso: 95.86 MiB / 150.93 MiB [ 63.51% 67.74 MiB p/s ETA 0s    > minikube-v1.6.0.iso: 110.92 MiB / 150.93 MiB  73.49% 67.74 MiB p/s ETA 0s    > minikube-v1.6.0.iso: 123.75 MiB / 150.93 MiB  81.99% 67.74 MiB p/s ETA 0s    > minikube-v1.6.0.iso: 139.73 MiB / 150.93 MiB  92.58% 68.08 MiB p/s ETA 0s    > minikube-v1.6.0.iso: 150.93 MiB / 150.93 MiB [-] 100.00% 78.61 MiB p/s 2s* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:133: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:133: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit : exit status 78 (109.652355ms)

                                                
                                                
-- stdout --
	* [running-upgrade-399000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig1264404886
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Starting existing hyperkit VM for "running-upgrade-399000" ...

                                                
                                                
-- /stdout --
** stderr ** 
	* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:133: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:133: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.2386249843.exe start -p running-upgrade-399000 --memory=2200 --vm-driver=hyperkit : exit status 78 (111.168596ms)

                                                
                                                
-- stdout --
	* [running-upgrade-399000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig3393992420
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Starting existing hyperkit VM for "running-upgrade-399000" ...

                                                
                                                
-- /stdout --
** stderr ** 
	* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:139: legacy v1.6.2 start failed: exit status 78
panic.go:523: *** TestRunningBinaryUpgrade FAILED at 2023-10-30 16:12:28.582164 -0700 PDT m=+568.115409241
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-399000 -n running-upgrade-399000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-399000 -n running-upgrade-399000: exit status 85 (148.053441ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node running-upgrade-399000
	* 
	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                           │
	│    * If the above advice does not help, please let us know:                                                               │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │
	│                                                                                                                           │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │
	│    * Please also attach the following file to the GitHub issue:                                                           │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_status_8980859c28362053cbc8940f41f258f108f0854e_0.log    │
	│                                                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "running-upgrade-399000" host is not running, skipping log retrieval (state="")
helpers_test.go:175: Cleaning up "running-upgrade-399000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-399000
--- FAIL: TestRunningBinaryUpgrade (10.16s)

                                                
                                    
x
+
TestKubernetesUpgrade (17.57s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:235: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:235: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (11.124357776s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-724000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node kubernetes-upgrade-724000 in cluster kubernetes-upgrade-724000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "kubernetes-upgrade-724000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:12:29.012145    3273 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:12:29.012347    3273 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:29.012352    3273 out.go:309] Setting ErrFile to fd 2...
	I1030 16:12:29.012356    3273 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:29.012535    3273 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:12:29.013951    3273 out.go:303] Setting JSON to false
	I1030 16:12:29.035843    3273 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":724,"bootTime":1698706825,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:12:29.035950    3273 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:12:29.057820    3273 out.go:177] * [kubernetes-upgrade-724000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:12:29.100652    3273 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:12:29.100840    3273 notify.go:220] Checking for updates...
	I1030 16:12:29.123316    3273 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:12:29.145203    3273 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:12:29.167498    3273 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:12:29.189276    3273 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:29.211074    3273 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:12:29.233057    3273 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:12:29.233261    3273 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:12:29.233391    3273 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:12:29.263296    3273 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:12:29.305293    3273 start.go:298] selected driver: hyperkit
	I1030 16:12:29.305344    3273 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:12:29.305362    3273 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:12:29.309778    3273 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:29.309874    3273 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:12:29.317945    3273 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:12:29.322241    3273 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:29.322258    3273 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:12:29.322291    3273 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:12:29.322501    3273 start_flags.go:916] Wait components to verify : map[apiserver:true system_pods:true]
	I1030 16:12:29.322559    3273 cni.go:84] Creating CNI manager for ""
	I1030 16:12:29.322573    3273 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 16:12:29.322584    3273 start_flags.go:323] config:
	{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-724000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:12:29.322716    3273 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:29.344193    3273 out.go:177] * Starting control plane node kubernetes-upgrade-724000 in cluster kubernetes-upgrade-724000
	I1030 16:12:29.365942    3273 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:12:29.366019    3273 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
	I1030 16:12:29.366043    3273 cache.go:56] Caching tarball of preloaded images
	I1030 16:12:29.366224    3273 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:12:29.366242    3273 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1030 16:12:29.366411    3273 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubernetes-upgrade-724000/config.json ...
	I1030 16:12:29.366445    3273 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubernetes-upgrade-724000/config.json: {Name:mk892f0b16baed7f5128ef2410f09b86f5822ec1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:12:29.367183    3273 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:29.367312    3273 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 93.647µs
	I1030 16:12:29.367362    3273 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-724000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:12:29.367431    3273 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:12:29.389364    3273 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:12:29.389756    3273 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:29.389826    3273 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:29.399157    3273 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50247
	I1030 16:12:29.399708    3273 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:29.400271    3273 main.go:141] libmachine: Using API Version  1
	I1030 16:12:29.400284    3273 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:29.400589    3273 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:29.400766    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetMachineName
	I1030 16:12:29.400884    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:29.401024    3273 start.go:159] libmachine.API.Create for "kubernetes-upgrade-724000" (driver="hyperkit")
	I1030 16:12:29.401075    3273 client.go:168] LocalClient.Create starting
	I1030 16:12:29.401103    3273 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:12:29.401154    3273 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:29.401169    3273 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:29.401250    3273 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:12:29.401288    3273 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:29.401298    3273 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:29.401313    3273 main.go:141] libmachine: Running pre-create checks...
	I1030 16:12:29.401320    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .PreCreateCheck
	I1030 16:12:29.401406    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:29.401624    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetConfigRaw
	I1030 16:12:29.412061    3273 main.go:141] libmachine: Creating machine...
	I1030 16:12:29.412086    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Create
	I1030 16:12:29.412330    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:29.412656    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:29.412294    3281 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:29.412788    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:12:29.576166    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:29.576039    3281 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/id_rsa...
	I1030 16:12:29.743538    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:29.743431    3281 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/kubernetes-upgrade-724000.rawdisk...
	I1030 16:12:29.743553    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Writing magic tar header
	I1030 16:12:29.743576    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Writing SSH key tar header
	I1030 16:12:29.744378    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:29.744256    3281 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000 ...
	I1030 16:12:30.073917    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:30.073941    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:30.074015    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID cc175734-7779-11ee-91ff-149d997fca88
	I1030 16:12:30.110678    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:30.110775    3273 client.go:171] LocalClient.Create took 709.688454ms
	I1030 16:12:32.112512    3273 start.go:128] duration metric: createHost completed in 2.745061443s
	I1030 16:12:32.112539    3273 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 2.745213252s
	W1030 16:12:32.112565    3273 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:12:32.113175    3273 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:32.113221    3273 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:32.122775    3273 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50249
	I1030 16:12:32.123358    3273 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:32.123747    3273 main.go:141] libmachine: Using API Version  1
	I1030 16:12:32.123756    3273 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:32.123970    3273 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:32.124309    3273 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:32.124330    3273 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:32.132105    3273 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50251
	I1030 16:12:32.132404    3273 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:32.132739    3273 main.go:141] libmachine: Using API Version  1
	I1030 16:12:32.132761    3273 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:32.132970    3273 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:32.133072    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetState
	I1030 16:12:32.133157    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:32.133182    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	I1030 16:12:32.133196    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:32.133222    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:32.188147    3273 out.go:177] * Deleting "kubernetes-upgrade-724000" in hyperkit ...
	I1030 16:12:32.209929    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Remove
	I1030 16:12:32.210275    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:32.210297    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:32.210320    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:32.210344    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	W1030 16:12:32.225636    3273 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:32.225652    3273 start.go:706] Will try again in 5 seconds ...
	I1030 16:12:37.226685    3273 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:37.226873    3273 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 130.43µs
	I1030 16:12:37.226902    3273 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-724000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:12:37.227013    3273 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:12:37.270579    3273 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:12:37.270780    3273 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:37.270851    3273 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:37.280571    3273 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50253
	I1030 16:12:37.281168    3273 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:37.281588    3273 main.go:141] libmachine: Using API Version  1
	I1030 16:12:37.281604    3273 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:37.281816    3273 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:37.281923    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetMachineName
	I1030 16:12:37.282011    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:37.282100    3273 start.go:159] libmachine.API.Create for "kubernetes-upgrade-724000" (driver="hyperkit")
	I1030 16:12:37.282121    3273 client.go:168] LocalClient.Create starting
	I1030 16:12:37.282153    3273 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:12:37.282200    3273 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:37.282214    3273 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:37.282258    3273 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:12:37.282292    3273 main.go:141] libmachine: Decoding PEM data...
	I1030 16:12:37.282304    3273 main.go:141] libmachine: Parsing certificate...
	I1030 16:12:37.282321    3273 main.go:141] libmachine: Running pre-create checks...
	I1030 16:12:37.282327    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .PreCreateCheck
	I1030 16:12:37.282449    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:37.282454    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetConfigRaw
	I1030 16:12:37.282899    3273 main.go:141] libmachine: Creating machine...
	I1030 16:12:37.282914    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Create
	I1030 16:12:37.282991    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:37.283132    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:37.282978    3288 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:37.283207    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:12:37.445545    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:37.445449    3288 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/id_rsa...
	I1030 16:12:37.547751    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:37.547648    3288 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/kubernetes-upgrade-724000.rawdisk...
	I1030 16:12:37.547765    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Writing magic tar header
	I1030 16:12:37.547784    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Writing SSH key tar header
	I1030 16:12:37.548702    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | I1030 16:12:37.548570    3288 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000 ...
	I1030 16:12:37.875538    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:37.875559    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:37.875572    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID d0c9eb48-7779-11ee-91ff-149d997fca88
	I1030 16:12:37.908996    3273 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:37.909076    3273 client.go:171] LocalClient.Create took 626.948149ms
	I1030 16:12:39.909880    3273 start.go:128] duration metric: createHost completed in 2.682836359s
	I1030 16:12:39.909910    3273 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 2.683022149s
	W1030 16:12:39.910009    3273 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-724000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-724000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:39.953727    3273 out.go:177] 
	W1030 16:12:39.976720    3273 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:12:39.976785    3273 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:12:39.976852    3273 out.go:239] * Related issues:
	* Related issues:
	W1030 16:12:39.976912    3273 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:12:39.976948    3273 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:12:40.019595    3273 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:237: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60
version_upgrade_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-724000
version_upgrade_test.go:245: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-724000 status --format={{.Host}}
version_upgrade_test.go:245: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-724000 status --format={{.Host}}: exit status 7 (65.384247ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:247: status error: exit status 7 (may be ok)
version_upgrade_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (5.786623045s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-724000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node kubernetes-upgrade-724000 in cluster kubernetes-upgrade-724000
	* Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	* Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:12:40.428226    3296 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:12:40.428438    3296 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:40.428443    3296 out.go:309] Setting ErrFile to fd 2...
	I1030 16:12:40.428447    3296 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:40.428617    3296 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:12:40.429954    3296 out.go:303] Setting JSON to false
	I1030 16:12:40.451898    3296 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":735,"bootTime":1698706825,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:12:40.452002    3296 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:12:40.473591    3296 out.go:177] * [kubernetes-upgrade-724000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:12:40.517259    3296 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:12:40.517397    3296 notify.go:220] Checking for updates...
	I1030 16:12:40.560079    3296 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:12:40.581286    3296 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:12:40.602588    3296 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:12:40.624460    3296 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:40.667078    3296 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:12:40.691081    3296 config.go:182] Loaded profile config "kubernetes-upgrade-724000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1030 16:12:40.691742    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.691818    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.701500    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50261
	I1030 16:12:40.702104    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.702534    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.702561    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.702808    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.702924    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.703109    3296 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:12:40.703345    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.703373    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.710976    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50263
	I1030 16:12:40.711282    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.711603    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.711623    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.711840    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.711940    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.740296    3296 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:12:40.782358    3296 start.go:298] selected driver: hyperkit
	I1030 16:12:40.782386    3296 start.go:902] validating driver "hyperkit" against &{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-724000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:12:40.782569    3296 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:12:40.786841    3296 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:40.786932    3296 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:12:40.794581    3296 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:12:40.798440    3296 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.798460    3296 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:12:40.798587    3296 cni.go:84] Creating CNI manager for ""
	I1030 16:12:40.798601    3296 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:12:40.798611    3296 start_flags.go:323] config:
	{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:kubernetes-upgrade-724000
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePat
h: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:12:40.798742    3296 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:40.842249    3296 out.go:177] * Starting control plane node kubernetes-upgrade-724000 in cluster kubernetes-upgrade-724000
	I1030 16:12:40.864371    3296 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:12:40.864441    3296 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:12:40.864473    3296 cache.go:56] Caching tarball of preloaded images
	I1030 16:12:40.864651    3296 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:12:40.864669    3296 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:12:40.864810    3296 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubernetes-upgrade-724000/config.json ...
	I1030 16:12:40.865678    3296 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:40.865780    3296 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 76.325µs
	I1030 16:12:40.865816    3296 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:12:40.865833    3296 fix.go:54] fixHost starting: 
	I1030 16:12:40.866216    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.866255    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.874872    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50265
	I1030 16:12:40.875435    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.875789    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.875803    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.876034    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.876149    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.876249    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetState
	I1030 16:12:40.876349    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:40.876360    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:40.876370    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	I1030 16:12:40.876388    3296 fix.go:102] recreateIfNeeded on kubernetes-upgrade-724000: state=Stopped err=<nil>
	I1030 16:12:40.876404    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	W1030 16:12:40.876477    3296 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:12:40.918228    3296 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	I1030 16:12:40.940422    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Start
	I1030 16:12:40.940770    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:40.940807    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:40.940878    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID d0c9eb48-7779-11ee-91ff-149d997fca88
	I1030 16:12:40.943231    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:40.943352    3296 fix.go:56] fixHost completed within 77.522103ms
	I1030 16:12:40.943367    3296 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 77.575202ms
	W1030 16:12:40.943383    3296 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:12:40.943456    3296 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:40.943464    3296 start.go:706] Will try again in 5 seconds ...
	I1030 16:12:45.945666    3296 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:45.945879    3296 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 146.321µs
	I1030 16:12:45.945915    3296 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:12:45.945933    3296 fix.go:54] fixHost starting: 
	I1030 16:12:45.946352    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:45.946394    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:45.956482    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50267
	I1030 16:12:45.956869    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:45.957250    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:45.957276    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:45.957542    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:45.957719    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:45.957807    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetState
	I1030 16:12:45.957902    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:45.957919    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	I1030 16:12:45.957929    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:45.957941    3296 fix.go:102] recreateIfNeeded on kubernetes-upgrade-724000: state=Stopped err=<nil>
	I1030 16:12:45.957951    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	W1030 16:12:45.958058    3296 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:12:46.001838    3296 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	I1030 16:12:46.029950    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Start
	I1030 16:12:46.030236    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:46.030281    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:46.030328    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID d0c9eb48-7779-11ee-91ff-149d997fca88
	I1030 16:12:46.032618    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:46.032756    3296 fix.go:56] fixHost completed within 86.826118ms
	I1030 16:12:46.032781    3296 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 86.88857ms
	W1030 16:12:46.032894    3296 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-724000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-724000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:46.054640    3296 out.go:177] 
	W1030 16:12:46.076532    3296 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:12:46.076594    3296 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:12:46.076625    3296 out.go:239] * Related issues:
	* Related issues:
	W1030 16:12:46.076662    3296 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:12:46.076680    3296 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:12:46.098589    3296 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:258: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-724000 --memory=2200 --kubernetes-version=v1.28.3 --alsologtostderr -v=1 --driver=hyperkit  : exit status 60
version_upgrade_test.go:261: (dbg) Run:  kubectl --context kubernetes-upgrade-724000 version --output=json
version_upgrade_test.go:261: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-724000 version --output=json: exit status 1 (35.660603ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-724000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:263: error running kubectl: exit status 1
panic.go:523: *** TestKubernetesUpgrade FAILED at 2023-10-30 16:12:46.200412 -0700 PDT m=+585.733650097
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-724000 -n kubernetes-upgrade-724000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-724000 -n kubernetes-upgrade-724000: exit status 7 (66.178313ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-724000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-724000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-724000
--- FAIL: TestKubernetesUpgrade (17.57s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (6.06s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:196: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit : exit status 78 (3.145651608s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-814000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig3123475217
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

                                                
                                                
-- /stdout --
** stderr ** 
	* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:196: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit : exit status 78 (111.192303ms)

                                                
                                                
-- stdout --
	* [stopped-upgrade-814000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig1605434683
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Starting existing hyperkit VM for "stopped-upgrade-814000" ...

                                                
                                                
-- /stdout --
** stderr ** 
	* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:196: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:196: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.6.2.3618977322.exe start -p stopped-upgrade-814000 --memory=2200 --vm-driver=hyperkit : exit status 78 (112.330614ms)

                                                
                                                
-- stdout --
	* [stopped-upgrade-814000] minikube v1.6.2 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig1591909069
	* Selecting 'hyperkit' driver from user configuration (alternates: [])
	* Starting existing hyperkit VM for "stopped-upgrade-814000" ...

                                                
                                                
-- /stdout --
** stderr ** 
	* 
	X Unable to start VM. Please investigate and run 'minikube delete' if possible
	* Error: [HYPERKIT_VMNET_FRAMEWORK] start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: Hyperkit networking is broken. Upgrade to the latest hyperkit version and/or Docker for Desktop. Alternatively, you may choose an alternate --vm-driver
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594
	* 
	* If the above advice does not help, please let us know: 
	  - https://github.com/kubernetes/minikube/issues/new/choose

                                                
                                                
** /stderr **
version_upgrade_test.go:202: legacy v1.6.2 start failed: exit status 78
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (6.06s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:219: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-814000
version_upgrade_test.go:219: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-814000: exit status 89 (319.031373ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   |    Version     |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
	| start   | -p scheduled-stop-982000                             | scheduled-stop-982000     | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:10 PDT |                     |
	|         | --memory=2048                                        |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| delete  | -p scheduled-stop-982000                             | scheduled-stop-982000     | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| start   | -p skaffold-160000                                   | skaffold-160000           | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --memory=2600                                        |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| delete  | -p skaffold-160000                                   | skaffold-160000           | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| start   | -p offline-docker-325000                             | offline-docker-325000     | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --alsologtostderr -v=1                               |                           |         |                |                     |                     |
	|         | --memory=2048 --wait=true                            |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/nsswitch.conf                                   |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/hosts                                           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/resolv.conf                                     |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo crictl                         | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | pods                                                 |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo crictl                         | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | ps --all                                             |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo find                           | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/cni -type f -exec sh -c                         |                           |         |                |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo ip a s                         | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	| ssh     | -p cilium-996000 sudo ip r s                         | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | iptables-save                                        |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo iptables                       | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | -t nat -L -n -v                                      |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl status kubelet --all                       |                           |         |                |                     |                     |
	|         | --full --no-pager                                    |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl cat kubelet                                |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | journalctl -xeu kubelet --all                        |                           |         |                |                     |                     |
	|         | --full --no-pager                                    |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl status docker --all                        |                           |         |                |                     |                     |
	|         | --full --no-pager                                    |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl cat docker                                 |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/docker/daemon.json                              |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo docker                         | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | system info                                          |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl status cri-docker                          |                           |         |                |                     |                     |
	|         | --all --full --no-pager                              |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl cat cri-docker                             |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | cri-dockerd --version                                |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl status containerd                          |                           |         |                |                     |                     |
	|         | --all --full --no-pager                              |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl cat containerd                             |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo cat                            | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/containerd/config.toml                          |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | containerd config dump                               |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl status crio --all                          |                           |         |                |                     |                     |
	|         | --full --no-pager                                    |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo                                | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo find                           | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |                |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |                |                     |                     |
	| ssh     | -p cilium-996000 sudo crio                           | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | config                                               |                           |         |                |                     |                     |
	| delete  | -p cilium-996000                                     | cilium-996000             | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| delete  | -p offline-docker-325000                             | offline-docker-325000     | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| start   | -p force-systemd-env-343000                          | force-systemd-env-343000  | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --memory=2048                                        |                           |         |                |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| start   | -p force-systemd-flag-731000                         | force-systemd-flag-731000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |                |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| ssh     | force-systemd-env-343000                             | force-systemd-env-343000  | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | ssh docker info --format                             |                           |         |                |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |                |                     |                     |
	| delete  | -p force-systemd-env-343000                          | force-systemd-env-343000  | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| start   | -p docker-flags-719000                               | docker-flags-719000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --cache-images=false                                 |                           |         |                |                     |                     |
	|         | --memory=2048                                        |                           |         |                |                     |                     |
	|         | --install-addons=false                               |                           |         |                |                     |                     |
	|         | --wait=false                                         |                           |         |                |                     |                     |
	|         | --docker-env=FOO=BAR                                 |                           |         |                |                     |                     |
	|         | --docker-env=BAZ=BAT                                 |                           |         |                |                     |                     |
	|         | --docker-opt=debug                                   |                           |         |                |                     |                     |
	|         | --docker-opt=icc=true                                |                           |         |                |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| ssh     | force-systemd-flag-731000                            | force-systemd-flag-731000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | ssh docker info --format                             |                           |         |                |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |                |                     |                     |
	| delete  | -p force-systemd-flag-731000                         | force-systemd-flag-731000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT | 30 Oct 23 16:11 PDT |
	| start   | -p cert-expiration-249000                            | cert-expiration-249000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:11 PDT |                     |
	|         | --memory=2048                                        |                           |         |                |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| ssh     | docker-flags-719000 ssh                              | docker-flags-719000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | sudo systemctl show docker                           |                           |         |                |                     |                     |
	|         | --property=Environment                               |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| ssh     | docker-flags-719000 ssh                              | docker-flags-719000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | sudo systemctl show docker                           |                           |         |                |                     |                     |
	|         | --property=ExecStart                                 |                           |         |                |                     |                     |
	|         | --no-pager                                           |                           |         |                |                     |                     |
	| delete  | -p docker-flags-719000                               | docker-flags-719000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT | 30 Oct 23 16:12 PDT |
	| start   | -p cert-options-907000                               | cert-options-907000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | --memory=2048                                        |                           |         |                |                     |                     |
	|         | --apiserver-ips=127.0.0.1                            |                           |         |                |                     |                     |
	|         | --apiserver-ips=192.168.15.15                        |                           |         |                |                     |                     |
	|         | --apiserver-names=localhost                          |                           |         |                |                     |                     |
	|         | --apiserver-names=www.google.com                     |                           |         |                |                     |                     |
	|         | --apiserver-port=8555                                |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| ssh     | cert-options-907000 ssh                              | cert-options-907000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | openssl x509 -text -noout -in                        |                           |         |                |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                |                           |         |                |                     |                     |
	| ssh     | -p cert-options-907000 -- sudo                       | cert-options-907000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | cat /etc/kubernetes/admin.conf                       |                           |         |                |                     |                     |
	| delete  | -p cert-options-907000                               | cert-options-907000       | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT | 30 Oct 23 16:12 PDT |
	| delete  | -p running-upgrade-399000                            | running-upgrade-399000    | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT | 30 Oct 23 16:12 PDT |
	| start   | -p kubernetes-upgrade-724000                         | kubernetes-upgrade-724000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | --memory=2200                                        |                           |         |                |                     |                     |
	|         | --kubernetes-version=v1.16.0                         |                           |         |                |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| stop    | -p kubernetes-upgrade-724000                         | kubernetes-upgrade-724000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT | 30 Oct 23 16:12 PDT |
	| start   | -p kubernetes-upgrade-724000                         | kubernetes-upgrade-724000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT |                     |
	|         | --memory=2200                                        |                           |         |                |                     |                     |
	|         | --kubernetes-version=v1.28.3                         |                           |         |                |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |                |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |                |                     |                     |
	| delete  | -p kubernetes-upgrade-724000                         | kubernetes-upgrade-724000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:12 PDT | 30 Oct 23 16:12 PDT |
	|---------|------------------------------------------------------|---------------------------|---------|----------------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 16:12:40
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.21.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 16:12:40.428226    3296 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:12:40.428438    3296 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:40.428443    3296 out.go:309] Setting ErrFile to fd 2...
	I1030 16:12:40.428447    3296 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:12:40.428617    3296 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:12:40.429954    3296 out.go:303] Setting JSON to false
	I1030 16:12:40.451898    3296 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":735,"bootTime":1698706825,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:12:40.452002    3296 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:12:40.473591    3296 out.go:177] * [kubernetes-upgrade-724000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:12:40.517259    3296 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:12:40.517397    3296 notify.go:220] Checking for updates...
	I1030 16:12:40.560079    3296 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:12:40.581286    3296 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:12:40.602588    3296 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:12:40.624460    3296 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:12:40.667078    3296 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:12:40.691081    3296 config.go:182] Loaded profile config "kubernetes-upgrade-724000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1030 16:12:40.691742    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.691818    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.701500    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50261
	I1030 16:12:40.702104    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.702534    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.702561    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.702808    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.702924    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.703109    3296 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:12:40.703345    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.703373    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.710976    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50263
	I1030 16:12:40.711282    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.711603    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.711623    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.711840    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.711940    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.740296    3296 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:12:40.782358    3296 start.go:298] selected driver: hyperkit
	I1030 16:12:40.782386    3296 start.go:902] validating driver "hyperkit" against &{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-724000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B
inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:12:40.782569    3296 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:12:40.786841    3296 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:40.786932    3296 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:12:40.794581    3296 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:12:40.798440    3296 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.798460    3296 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:12:40.798587    3296 cni.go:84] Creating CNI manager for ""
	I1030 16:12:40.798601    3296 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:12:40.798611    3296 start_flags.go:323] config:
	{Name:kubernetes-upgrade-724000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:kubernetes-upgrade-724000
Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePat
h: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:12:40.798742    3296 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:12:40.842249    3296 out.go:177] * Starting control plane node kubernetes-upgrade-724000 in cluster kubernetes-upgrade-724000
	I1030 16:12:40.864371    3296 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:12:40.864441    3296 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:12:40.864473    3296 cache.go:56] Caching tarball of preloaded images
	I1030 16:12:40.864651    3296 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:12:40.864669    3296 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:12:40.864810    3296 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubernetes-upgrade-724000/config.json ...
	I1030 16:12:40.865678    3296 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:40.865780    3296 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 76.325µs
	I1030 16:12:40.865816    3296 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:12:40.865833    3296 fix.go:54] fixHost starting: 
	I1030 16:12:40.866216    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:40.866255    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:40.874872    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50265
	I1030 16:12:40.875435    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:40.875789    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:40.875803    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:40.876034    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:40.876149    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:40.876249    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetState
	I1030 16:12:40.876349    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:40.876360    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:40.876370    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	I1030 16:12:40.876388    3296 fix.go:102] recreateIfNeeded on kubernetes-upgrade-724000: state=Stopped err=<nil>
	I1030 16:12:40.876404    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	W1030 16:12:40.876477    3296 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:12:40.918228    3296 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	I1030 16:12:40.940422    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Start
	I1030 16:12:40.940770    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:40.940807    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:40.940878    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID d0c9eb48-7779-11ee-91ff-149d997fca88
	I1030 16:12:40.943231    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:40.943352    3296 fix.go:56] fixHost completed within 77.522103ms
	I1030 16:12:40.943367    3296 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 77.575202ms
	W1030 16:12:40.943383    3296 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:12:40.943456    3296 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:40.943464    3296 start.go:706] Will try again in 5 seconds ...
	I1030 16:12:45.945666    3296 start.go:365] acquiring machines lock for kubernetes-upgrade-724000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:12:45.945879    3296 start.go:369] acquired machines lock for "kubernetes-upgrade-724000" in 146.321µs
	I1030 16:12:45.945915    3296 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:12:45.945933    3296 fix.go:54] fixHost starting: 
	I1030 16:12:45.946352    3296 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:12:45.946394    3296 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:12:45.956482    3296 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50267
	I1030 16:12:45.956869    3296 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:12:45.957250    3296 main.go:141] libmachine: Using API Version  1
	I1030 16:12:45.957276    3296 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:12:45.957542    3296 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:12:45.957719    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	I1030 16:12:45.957807    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .GetState
	I1030 16:12:45.957902    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:45.957919    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.json: no such file or directory
	I1030 16:12:45.957929    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | hyperkit pid from json: 0
	I1030 16:12:45.957941    3296 fix.go:102] recreateIfNeeded on kubernetes-upgrade-724000: state=Stopped err=<nil>
	I1030 16:12:45.957951    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .DriverName
	W1030 16:12:45.958058    3296 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:12:46.001838    3296 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-724000" ...
	I1030 16:12:46.029950    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) Calling .Start
	I1030 16:12:46.030236    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:12:46.030281    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubernetes-upgrade-724000/hyperkit.pid
	I1030 16:12:46.030328    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | Using UUID d0c9eb48-7779-11ee-91ff-149d997fca88
	I1030 16:12:46.032618    3296 main.go:141] libmachine: (kubernetes-upgrade-724000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:12:46.032756    3296 fix.go:56] fixHost completed within 86.826118ms
	I1030 16:12:46.032781    3296 start.go:83] releasing machines lock for "kubernetes-upgrade-724000", held for 86.88857ms
	W1030 16:12:46.032894    3296 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-724000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:12:46.054640    3296 out.go:177] 
	W1030 16:12:46.076532    3296 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:12:46.076594    3296 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:12:46.076625    3296 out.go:239] * Related issues:
	W1030 16:12:46.076662    3296 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:12:46.076680    3296 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:12:46.098589    3296 out.go:177] 
	
	* 
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p stopped-upgrade-814000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:221: `minikube logs` after upgrade to HEAD from v1.6.2 failed: exit status 89
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                    
x
+
TestPause/serial/Start (11.32s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-729000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-729000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit : exit status 60 (11.255291066s)

                                                
                                                
-- stdout --
	* [pause-729000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node pause-729000 in cluster pause-729000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "pause-729000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p pause-729000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-729000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-729000 -n pause-729000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-729000 -n pause-729000: exit status 7 (69.048973ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-729000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (11.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit : exit status 60 (11.024955458s)

                                                
                                                
-- stdout --
	* [NoKubernetes-128000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node NoKubernetes-128000 in cluster NoKubernetes-128000
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "NoKubernetes-128000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-128000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000: exit status 7 (67.037918ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-128000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (11.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.92s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit : exit status 60 (5.848343387s)

                                                
                                                
-- stdout --
	* [NoKubernetes-128000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-128000
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-128000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000: exit status 7 (71.135009ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-128000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.92s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.97s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit : exit status 60 (5.904256712s)

                                                
                                                
-- stdout --
	* [NoKubernetes-128000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-128000
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-128000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000: exit status 7 (67.52947ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-128000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.97s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.92s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit : exit status 60 (5.851987917s)

                                                
                                                
-- stdout --
	* [NoKubernetes-128000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-128000
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-128000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-128000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-128000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-128000 -n NoKubernetes-128000: exit status 7 (69.558142ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-128000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.92s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 60 (11.315333153s)

                                                
                                                
-- stdout --
	* [auto-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node auto-996000 in cluster auto-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "auto-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:13:36.271572    3512 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:13:36.271857    3512 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:13:36.271862    3512 out.go:309] Setting ErrFile to fd 2...
	I1030 16:13:36.271866    3512 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:13:36.272045    3512 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:13:36.273475    3512 out.go:303] Setting JSON to false
	I1030 16:13:36.295423    3512 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":791,"bootTime":1698706825,"procs":440,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:13:36.295526    3512 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:13:36.317550    3512 out.go:177] * [auto-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:13:36.339293    3512 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:13:36.339307    3512 notify.go:220] Checking for updates...
	I1030 16:13:36.383272    3512 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:13:36.404155    3512 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:13:36.425269    3512 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:13:36.446145    3512 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:13:36.467149    3512 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:13:36.489203    3512 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:13:36.489392    3512 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:13:36.489537    3512 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:13:36.519283    3512 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:13:36.561296    3512 start.go:298] selected driver: hyperkit
	I1030 16:13:36.561325    3512 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:13:36.561349    3512 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:13:36.565749    3512 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:13:36.565879    3512 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:13:36.574216    3512 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:13:36.578367    3512 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:36.578386    3512 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:13:36.578414    3512 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:13:36.578613    3512 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:13:36.578643    3512 cni.go:84] Creating CNI manager for ""
	I1030 16:13:36.578656    3512 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:13:36.578663    3512 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:13:36.578672    3512 start_flags.go:323] config:
	{Name:auto-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:auto-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:13:36.578809    3512 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:13:36.622165    3512 out.go:177] * Starting control plane node auto-996000 in cluster auto-996000
	I1030 16:13:36.643221    3512 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:13:36.643318    3512 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:13:36.643345    3512 cache.go:56] Caching tarball of preloaded images
	I1030 16:13:36.643551    3512 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:13:36.643568    3512 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:13:36.643757    3512 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/auto-996000/config.json ...
	I1030 16:13:36.643791    3512 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/auto-996000/config.json: {Name:mkfda80df334047dfc38dcc03b073be354160c37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:13:36.644387    3512 start.go:365] acquiring machines lock for auto-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:13:36.644503    3512 start.go:369] acquired machines lock for "auto-996000" in 78.576µs
	I1030 16:13:36.644547    3512 start.go:93] Provisioning new machine with config: &{Name:auto-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.3 ClusterName:auto-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpt
ions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:13:36.644649    3512 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:13:36.687922    3512 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:13:36.688240    3512 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:36.688292    3512 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:36.696832    3512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50414
	I1030 16:13:36.697211    3512 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:36.697623    3512 main.go:141] libmachine: Using API Version  1
	I1030 16:13:36.697634    3512 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:36.697848    3512 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:36.697961    3512 main.go:141] libmachine: (auto-996000) Calling .GetMachineName
	I1030 16:13:36.698049    3512 main.go:141] libmachine: (auto-996000) Calling .DriverName
	I1030 16:13:36.698150    3512 start.go:159] libmachine.API.Create for "auto-996000" (driver="hyperkit")
	I1030 16:13:36.698197    3512 client.go:168] LocalClient.Create starting
	I1030 16:13:36.698233    3512 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:13:36.698292    3512 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:36.698308    3512 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:36.698359    3512 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:13:36.698394    3512 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:36.698406    3512 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:36.698419    3512 main.go:141] libmachine: Running pre-create checks...
	I1030 16:13:36.698425    3512 main.go:141] libmachine: (auto-996000) Calling .PreCreateCheck
	I1030 16:13:36.698509    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:36.698723    3512 main.go:141] libmachine: (auto-996000) Calling .GetConfigRaw
	I1030 16:13:36.699177    3512 main.go:141] libmachine: Creating machine...
	I1030 16:13:36.699186    3512 main.go:141] libmachine: (auto-996000) Calling .Create
	I1030 16:13:36.699270    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:36.699412    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:36.699262    3520 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:13:36.699465    3512 main.go:141] libmachine: (auto-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:13:36.859907    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:36.859780    3520 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/id_rsa...
	I1030 16:13:37.000837    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:37.000757    3520 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/auto-996000.rawdisk...
	I1030 16:13:37.000877    3512 main.go:141] libmachine: (auto-996000) DBG | Writing magic tar header
	I1030 16:13:37.000886    3512 main.go:141] libmachine: (auto-996000) DBG | Writing SSH key tar header
	I1030 16:13:37.001662    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:37.001571    3520 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000 ...
	I1030 16:13:37.327124    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:37.327145    3512 main.go:141] libmachine: (auto-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/hyperkit.pid
	I1030 16:13:37.327157    3512 main.go:141] libmachine: (auto-996000) DBG | Using UUID f43448da-7779-11ee-b55b-149d997fca88
	I1030 16:13:37.364705    3512 main.go:141] libmachine: (auto-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:13:37.364783    3512 client.go:171] LocalClient.Create took 666.575661ms
	I1030 16:13:39.367011    3512 start.go:128] duration metric: createHost completed in 2.722343337s
	I1030 16:13:39.367043    3512 start.go:83] releasing machines lock for "auto-996000", held for 2.722527799s
	W1030 16:13:39.367069    3512 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:13:39.367657    3512 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:39.367709    3512 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:39.377274    3512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50416
	I1030 16:13:39.377784    3512 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:39.378236    3512 main.go:141] libmachine: Using API Version  1
	I1030 16:13:39.378254    3512 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:39.378466    3512 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:39.378812    3512 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:39.378834    3512 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:39.387055    3512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50418
	I1030 16:13:39.387457    3512 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:39.387825    3512 main.go:141] libmachine: Using API Version  1
	I1030 16:13:39.387842    3512 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:39.388029    3512 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:39.388125    3512 main.go:141] libmachine: (auto-996000) Calling .GetState
	I1030 16:13:39.388201    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:39.388238    3512 main.go:141] libmachine: (auto-996000) DBG | hyperkit pid from json: 0
	I1030 16:13:39.388257    3512 main.go:141] libmachine: (auto-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/hyperkit.json: no such file or directory
	I1030 16:13:39.388261    3512 main.go:141] libmachine: (auto-996000) Calling .DriverName
	I1030 16:13:39.410298    3512 out.go:177] * Deleting "auto-996000" in hyperkit ...
	I1030 16:13:39.431913    3512 main.go:141] libmachine: (auto-996000) Calling .Remove
	I1030 16:13:39.432135    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:39.432156    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:39.432184    3512 main.go:141] libmachine: (auto-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/hyperkit.json: no such file or directory
	I1030 16:13:39.432194    3512 main.go:141] libmachine: (auto-996000) DBG | hyperkit pid from json: 0
	W1030 16:13:39.447141    3512 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:13:39.447154    3512 start.go:706] Will try again in 5 seconds ...
	I1030 16:13:44.449367    3512 start.go:365] acquiring machines lock for auto-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:13:44.449540    3512 start.go:369] acquired machines lock for "auto-996000" in 132.18µs
	I1030 16:13:44.449568    3512 start.go:93] Provisioning new machine with config: &{Name:auto-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.3 ClusterName:auto-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpt
ions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:13:44.449664    3512 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:13:44.496297    3512 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:13:44.496444    3512 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:44.496497    3512 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:44.506191    3512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50420
	I1030 16:13:44.506712    3512 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:44.507348    3512 main.go:141] libmachine: Using API Version  1
	I1030 16:13:44.507381    3512 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:44.507598    3512 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:44.507726    3512 main.go:141] libmachine: (auto-996000) Calling .GetMachineName
	I1030 16:13:44.507817    3512 main.go:141] libmachine: (auto-996000) Calling .DriverName
	I1030 16:13:44.507910    3512 start.go:159] libmachine.API.Create for "auto-996000" (driver="hyperkit")
	I1030 16:13:44.507941    3512 client.go:168] LocalClient.Create starting
	I1030 16:13:44.507965    3512 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:13:44.508012    3512 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:44.508023    3512 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:44.508059    3512 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:13:44.508093    3512 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:44.508107    3512 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:44.508119    3512 main.go:141] libmachine: Running pre-create checks...
	I1030 16:13:44.508125    3512 main.go:141] libmachine: (auto-996000) Calling .PreCreateCheck
	I1030 16:13:44.508205    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:44.508223    3512 main.go:141] libmachine: (auto-996000) Calling .GetConfigRaw
	I1030 16:13:44.508696    3512 main.go:141] libmachine: Creating machine...
	I1030 16:13:44.508706    3512 main.go:141] libmachine: (auto-996000) Calling .Create
	I1030 16:13:44.508792    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:44.508938    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:44.508788    3524 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:13:44.508988    3512 main.go:141] libmachine: (auto-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:13:44.672470    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:44.672349    3524 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/id_rsa...
	I1030 16:13:44.990787    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:44.990666    3524 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/auto-996000.rawdisk...
	I1030 16:13:44.990803    3512 main.go:141] libmachine: (auto-996000) DBG | Writing magic tar header
	I1030 16:13:44.990812    3512 main.go:141] libmachine: (auto-996000) DBG | Writing SSH key tar header
	I1030 16:13:44.991578    3512 main.go:141] libmachine: (auto-996000) DBG | I1030 16:13:44.991472    3524 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000 ...
	I1030 16:13:45.320241    3512 main.go:141] libmachine: (auto-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:45.320262    3512 main.go:141] libmachine: (auto-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/auto-996000/hyperkit.pid
	I1030 16:13:45.320292    3512 main.go:141] libmachine: (auto-996000) DBG | Using UUID f8dbc098-7779-11ee-b55b-149d997fca88
	I1030 16:13:45.357729    3512 main.go:141] libmachine: (auto-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:13:45.357811    3512 client.go:171] LocalClient.Create took 849.862666ms
	I1030 16:13:47.360006    3512 start.go:128] duration metric: createHost completed in 2.91031593s
	I1030 16:13:47.360086    3512 start.go:83] releasing machines lock for "auto-996000", held for 2.910531599s
	W1030 16:13:47.360195    3512 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p auto-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p auto-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:13:47.403622    3512 out.go:177] 
	W1030 16:13:47.426912    3512 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:13:47.427000    3512 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:13:47.427018    3512 out.go:239] * Related issues:
	* Related issues:
	W1030 16:13:47.427048    3512 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:13:47.427073    3512 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:13:47.448493    3512 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/auto/Start (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (11.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit : exit status 60 (11.238313576s)

                                                
                                                
-- stdout --
	* [calico-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node calico-996000 in cluster calico-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "calico-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:13:53.167362    3660 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:13:53.167638    3660 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:13:53.167643    3660 out.go:309] Setting ErrFile to fd 2...
	I1030 16:13:53.167647    3660 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:13:53.167820    3660 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:13:53.169250    3660 out.go:303] Setting JSON to false
	I1030 16:13:53.191361    3660 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":808,"bootTime":1698706825,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:13:53.191464    3660 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:13:53.213265    3660 out.go:177] * [calico-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:13:53.256076    3660 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:13:53.256171    3660 notify.go:220] Checking for updates...
	I1030 16:13:53.299786    3660 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:13:53.320919    3660 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:13:53.342914    3660 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:13:53.364844    3660 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:13:53.386027    3660 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:13:53.408958    3660 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:13:53.409138    3660 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:13:53.409292    3660 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:13:53.438992    3660 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:13:53.461085    3660 start.go:298] selected driver: hyperkit
	I1030 16:13:53.461141    3660 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:13:53.461185    3660 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:13:53.465588    3660 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:13:53.465694    3660 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:13:53.473416    3660 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:13:53.477219    3660 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:53.477238    3660 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:13:53.477268    3660 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:13:53.477524    3660 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:13:53.477588    3660 cni.go:84] Creating CNI manager for "calico"
	I1030 16:13:53.477598    3660 start_flags.go:318] Found "Calico" CNI - setting NetworkPlugin=cni
	I1030 16:13:53.477609    3660 start_flags.go:323] config:
	{Name:calico-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:calico-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:13:53.477750    3660 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:13:53.521107    3660 out.go:177] * Starting control plane node calico-996000 in cluster calico-996000
	I1030 16:13:53.547996    3660 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:13:53.548079    3660 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:13:53.548108    3660 cache.go:56] Caching tarball of preloaded images
	I1030 16:13:53.548326    3660 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:13:53.548345    3660 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:13:53.548496    3660 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/calico-996000/config.json ...
	I1030 16:13:53.548530    3660 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/calico-996000/config.json: {Name:mk265a0f69e749f8fcb79f16795aedad93da0f70 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:13:53.549226    3660 start.go:365] acquiring machines lock for calico-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:13:53.549343    3660 start.go:369] acquired machines lock for "calico-996000" in 92.847µs
	I1030 16:13:53.549391    3660 start.go:93] Provisioning new machine with config: &{Name:calico-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:calico-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:13:53.549481    3660 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:13:53.570735    3660 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:13:53.571279    3660 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:53.571329    3660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:53.580567    3660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50496
	I1030 16:13:53.580922    3660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:53.581354    3660 main.go:141] libmachine: Using API Version  1
	I1030 16:13:53.581372    3660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:53.581570    3660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:53.581684    3660 main.go:141] libmachine: (calico-996000) Calling .GetMachineName
	I1030 16:13:53.581775    3660 main.go:141] libmachine: (calico-996000) Calling .DriverName
	I1030 16:13:53.581877    3660 start.go:159] libmachine.API.Create for "calico-996000" (driver="hyperkit")
	I1030 16:13:53.581903    3660 client.go:168] LocalClient.Create starting
	I1030 16:13:53.581930    3660 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:13:53.581975    3660 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:53.581990    3660 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:53.582041    3660 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:13:53.582078    3660 main.go:141] libmachine: Decoding PEM data...
	I1030 16:13:53.582090    3660 main.go:141] libmachine: Parsing certificate...
	I1030 16:13:53.582110    3660 main.go:141] libmachine: Running pre-create checks...
	I1030 16:13:53.582118    3660 main.go:141] libmachine: (calico-996000) Calling .PreCreateCheck
	I1030 16:13:53.582197    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:53.582383    3660 main.go:141] libmachine: (calico-996000) Calling .GetConfigRaw
	I1030 16:13:53.582849    3660 main.go:141] libmachine: Creating machine...
	I1030 16:13:53.582857    3660 main.go:141] libmachine: (calico-996000) Calling .Create
	I1030 16:13:53.582935    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:53.583078    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:13:53.582920    3668 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:13:53.583154    3660 main.go:141] libmachine: (calico-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:13:53.742896    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:13:53.742780    3668 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/id_rsa...
	I1030 16:13:54.078250    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:13:54.078136    3668 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/calico-996000.rawdisk...
	I1030 16:13:54.078266    3660 main.go:141] libmachine: (calico-996000) DBG | Writing magic tar header
	I1030 16:13:54.078275    3660 main.go:141] libmachine: (calico-996000) DBG | Writing SSH key tar header
	I1030 16:13:54.079075    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:13:54.078946    3668 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000 ...
	I1030 16:13:54.407381    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:54.407402    3660 main.go:141] libmachine: (calico-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/hyperkit.pid
	I1030 16:13:54.407443    3660 main.go:141] libmachine: (calico-996000) DBG | Using UUID fe446602-7779-11ee-bc2b-149d997fca88
	I1030 16:13:54.443232    3660 main.go:141] libmachine: (calico-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:13:54.443319    3660 client.go:171] LocalClient.Create took 861.404155ms
	I1030 16:13:56.443908    3660 start.go:128] duration metric: createHost completed in 2.894403726s
	I1030 16:13:56.443971    3660 start.go:83] releasing machines lock for "calico-996000", held for 2.894608836s
	W1030 16:13:56.444000    3660 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:13:56.444551    3660 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:56.444597    3660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:56.454052    3660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50498
	I1030 16:13:56.454645    3660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:56.455161    3660 main.go:141] libmachine: Using API Version  1
	I1030 16:13:56.455170    3660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:56.455384    3660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:56.455743    3660 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:13:56.455768    3660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:13:56.463701    3660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50500
	I1030 16:13:56.464175    3660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:13:56.464534    3660 main.go:141] libmachine: Using API Version  1
	I1030 16:13:56.464562    3660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:13:56.464825    3660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:13:56.464953    3660 main.go:141] libmachine: (calico-996000) Calling .GetState
	I1030 16:13:56.465135    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:56.465157    3660 main.go:141] libmachine: (calico-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/hyperkit.json: no such file or directory
	I1030 16:13:56.465166    3660 main.go:141] libmachine: (calico-996000) DBG | hyperkit pid from json: 0
	I1030 16:13:56.465219    3660 main.go:141] libmachine: (calico-996000) Calling .DriverName
	I1030 16:13:56.511608    3660 out.go:177] * Deleting "calico-996000" in hyperkit ...
	I1030 16:13:56.533797    3660 main.go:141] libmachine: (calico-996000) Calling .Remove
	I1030 16:13:56.534122    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:56.534156    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:13:56.534176    3660 main.go:141] libmachine: (calico-996000) DBG | hyperkit pid from json: 0
	I1030 16:13:56.534206    3660 main.go:141] libmachine: (calico-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/hyperkit.json: no such file or directory
	W1030 16:13:56.549639    3660 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:13:56.549652    3660 start.go:706] Will try again in 5 seconds ...
	I1030 16:14:01.550026    3660 start.go:365] acquiring machines lock for calico-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:01.550185    3660 start.go:369] acquired machines lock for "calico-996000" in 125.494µs
	I1030 16:14:01.550230    3660 start.go:93] Provisioning new machine with config: &{Name:calico-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:calico-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:01.550346    3660 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:01.573332    3660 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:01.573495    3660 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:01.573534    3660 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:01.583121    3660 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50502
	I1030 16:14:01.583690    3660 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:01.584153    3660 main.go:141] libmachine: Using API Version  1
	I1030 16:14:01.584163    3660 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:01.584428    3660 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:01.584558    3660 main.go:141] libmachine: (calico-996000) Calling .GetMachineName
	I1030 16:14:01.584655    3660 main.go:141] libmachine: (calico-996000) Calling .DriverName
	I1030 16:14:01.584767    3660 start.go:159] libmachine.API.Create for "calico-996000" (driver="hyperkit")
	I1030 16:14:01.584790    3660 client.go:168] LocalClient.Create starting
	I1030 16:14:01.584826    3660 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:01.584878    3660 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:01.584890    3660 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:01.584931    3660 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:01.584966    3660 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:01.584977    3660 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:01.584993    3660 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:01.584999    3660 main.go:141] libmachine: (calico-996000) Calling .PreCreateCheck
	I1030 16:14:01.585071    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:01.585099    3660 main.go:141] libmachine: (calico-996000) Calling .GetConfigRaw
	I1030 16:14:01.585518    3660 main.go:141] libmachine: Creating machine...
	I1030 16:14:01.585527    3660 main.go:141] libmachine: (calico-996000) Calling .Create
	I1030 16:14:01.585606    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:01.585753    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:14:01.585602    3672 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:01.585791    3660 main.go:141] libmachine: (calico-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:01.747563    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:14:01.747466    3672 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/id_rsa...
	I1030 16:14:01.829365    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:14:01.829286    3672 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/calico-996000.rawdisk...
	I1030 16:14:01.829378    3660 main.go:141] libmachine: (calico-996000) DBG | Writing magic tar header
	I1030 16:14:01.829386    3660 main.go:141] libmachine: (calico-996000) DBG | Writing SSH key tar header
	I1030 16:14:01.830198    3660 main.go:141] libmachine: (calico-996000) DBG | I1030 16:14:01.830096    3672 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000 ...
	I1030 16:14:02.160106    3660 main.go:141] libmachine: (calico-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:02.160126    3660 main.go:141] libmachine: (calico-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/calico-996000/hyperkit.pid
	I1030 16:14:02.160171    3660 main.go:141] libmachine: (calico-996000) DBG | Using UUID 03097f7e-777a-11ee-bc2b-149d997fca88
	I1030 16:14:02.196714    3660 main.go:141] libmachine: (calico-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:02.196799    3660 client.go:171] LocalClient.Create took 612.002673ms
	I1030 16:14:04.198950    3660 start.go:128] duration metric: createHost completed in 2.648564619s
	I1030 16:14:04.199022    3660 start.go:83] releasing machines lock for "calico-996000", held for 2.648821412s
	W1030 16:14:04.199140    3660 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p calico-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p calico-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:04.221874    3660 out.go:177] 
	W1030 16:14:04.244834    3660 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:14:04.244886    3660 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:14:04.244907    3660 out.go:239] * Related issues:
	* Related issues:
	W1030 16:14:04.245012    3660 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:14:04.245045    3660 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:14:04.288660    3660 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/calico/Start (11.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (11.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-flannel-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-flannel-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit : exit status 60 (11.137989213s)

                                                
                                                
-- stdout --
	* [custom-flannel-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node custom-flannel-996000 in cluster custom-flannel-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "custom-flannel-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:14:10.506158    3817 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:14:10.506449    3817 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:10.506454    3817 out.go:309] Setting ErrFile to fd 2...
	I1030 16:14:10.506458    3817 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:10.506634    3817 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:14:10.508077    3817 out.go:303] Setting JSON to false
	I1030 16:14:10.530343    3817 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":825,"bootTime":1698706825,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:14:10.530447    3817 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:14:10.552655    3817 out.go:177] * [custom-flannel-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:14:10.596264    3817 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:14:10.596374    3817 notify.go:220] Checking for updates...
	I1030 16:14:10.618270    3817 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:14:10.640383    3817 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:14:10.683330    3817 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:14:10.705422    3817 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:10.727096    3817 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:14:10.749171    3817 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:10.749379    3817 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:10.749510    3817 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:14:10.779408    3817 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:14:10.822393    3817 start.go:298] selected driver: hyperkit
	I1030 16:14:10.822423    3817 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:14:10.822445    3817 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:14:10.826984    3817 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:10.827119    3817 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:14:10.835387    3817 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:14:10.839686    3817 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:10.839705    3817 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:14:10.839736    3817 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:14:10.839938    3817 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:14:10.839997    3817 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I1030 16:14:10.840013    3817 start_flags.go:318] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I1030 16:14:10.840032    3817 start_flags.go:323] config:
	{Name:custom-flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:custom-flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GP
Us:}
	I1030 16:14:10.840173    3817 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:10.883180    3817 out.go:177] * Starting control plane node custom-flannel-996000 in cluster custom-flannel-996000
	I1030 16:14:10.904309    3817 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:14:10.904403    3817 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:14:10.904428    3817 cache.go:56] Caching tarball of preloaded images
	I1030 16:14:10.904663    3817 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:14:10.904681    3817 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:14:10.904839    3817 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/custom-flannel-996000/config.json ...
	I1030 16:14:10.904872    3817 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/custom-flannel-996000/config.json: {Name:mkd98fceeff2f70006ad3d5193ba3cb22e9b32e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:14:10.905600    3817 start.go:365] acquiring machines lock for custom-flannel-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:10.905714    3817 start.go:369] acquired machines lock for "custom-flannel-996000" in 83.941µs
	I1030 16:14:10.905759    3817 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.3 ClusterName:custom-flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L Mount
GID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:10.905851    3817 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:10.949087    3817 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:10.949552    3817 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:10.949617    3817 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:10.959076    3817 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50578
	I1030 16:14:10.959447    3817 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:10.959853    3817 main.go:141] libmachine: Using API Version  1
	I1030 16:14:10.959866    3817 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:10.960083    3817 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:10.960194    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .GetMachineName
	I1030 16:14:10.960299    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .DriverName
	I1030 16:14:10.960424    3817 start.go:159] libmachine.API.Create for "custom-flannel-996000" (driver="hyperkit")
	I1030 16:14:10.960448    3817 client.go:168] LocalClient.Create starting
	I1030 16:14:10.960476    3817 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:10.960523    3817 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:10.960538    3817 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:10.960588    3817 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:10.960625    3817 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:10.960638    3817 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:10.960652    3817 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:10.960658    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .PreCreateCheck
	I1030 16:14:10.960745    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:10.960965    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .GetConfigRaw
	I1030 16:14:10.961445    3817 main.go:141] libmachine: Creating machine...
	I1030 16:14:10.961454    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .Create
	I1030 16:14:10.961522    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:10.961671    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:10.961518    3825 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:10.961722    3817 main.go:141] libmachine: (custom-flannel-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:11.121229    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:11.121113    3825 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/id_rsa...
	I1030 16:14:11.205175    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:11.205108    3825 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/custom-flannel-996000.rawdisk...
	I1030 16:14:11.205185    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Writing magic tar header
	I1030 16:14:11.205225    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Writing SSH key tar header
	I1030 16:14:11.206093    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:11.205972    3825 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000 ...
	I1030 16:14:11.537281    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:11.537296    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/hyperkit.pid
	I1030 16:14:11.537336    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Using UUID 08a0210e-777a-11ee-b0ea-149d997fca88
	I1030 16:14:11.572387    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:11.572471    3817 client.go:171] LocalClient.Create took 612.013913ms
	I1030 16:14:13.572937    3817 start.go:128] duration metric: createHost completed in 2.667061196s
	I1030 16:14:13.572964    3817 start.go:83] releasing machines lock for "custom-flannel-996000", held for 2.667237132s
	W1030 16:14:13.572990    3817 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:14:13.573542    3817 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:13.573585    3817 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:13.583461    3817 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50580
	I1030 16:14:13.584010    3817 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:13.584371    3817 main.go:141] libmachine: Using API Version  1
	I1030 16:14:13.584385    3817 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:13.584608    3817 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:13.584965    3817 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:13.584988    3817 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:13.594379    3817 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50582
	I1030 16:14:13.594838    3817 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:13.595229    3817 main.go:141] libmachine: Using API Version  1
	I1030 16:14:13.595242    3817 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:13.595491    3817 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:13.595638    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .GetState
	I1030 16:14:13.595763    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:13.595789    3817 main.go:141] libmachine: (custom-flannel-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/hyperkit.json: no such file or directory
	I1030 16:14:13.595805    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:13.595851    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .DriverName
	I1030 16:14:13.638585    3817 out.go:177] * Deleting "custom-flannel-996000" in hyperkit ...
	I1030 16:14:13.662529    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .Remove
	I1030 16:14:13.662834    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:13.662857    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:13.662878    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:13.662894    3817 main.go:141] libmachine: (custom-flannel-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/hyperkit.json: no such file or directory
	W1030 16:14:13.678081    3817 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:13.678097    3817 start.go:706] Will try again in 5 seconds ...
	I1030 16:14:18.678989    3817 start.go:365] acquiring machines lock for custom-flannel-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:18.679187    3817 start.go:369] acquired machines lock for "custom-flannel-996000" in 159.63µs
	I1030 16:14:18.679215    3817 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.3 ClusterName:custom-flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L Mount
GID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:18.679345    3817 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:18.723865    3817 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:18.724048    3817 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:18.724091    3817 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:18.733642    3817 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50584
	I1030 16:14:18.734297    3817 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:18.734718    3817 main.go:141] libmachine: Using API Version  1
	I1030 16:14:18.734730    3817 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:18.734953    3817 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:18.735047    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .GetMachineName
	I1030 16:14:18.735139    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .DriverName
	I1030 16:14:18.735305    3817 start.go:159] libmachine.API.Create for "custom-flannel-996000" (driver="hyperkit")
	I1030 16:14:18.735338    3817 client.go:168] LocalClient.Create starting
	I1030 16:14:18.735382    3817 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:18.735446    3817 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:18.735482    3817 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:18.735520    3817 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:18.735554    3817 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:18.735567    3817 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:18.735579    3817 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:18.735585    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .PreCreateCheck
	I1030 16:14:18.735671    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:18.735734    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .GetConfigRaw
	I1030 16:14:18.736292    3817 main.go:141] libmachine: Creating machine...
	I1030 16:14:18.736301    3817 main.go:141] libmachine: (custom-flannel-996000) Calling .Create
	I1030 16:14:18.736383    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:18.736523    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:18.736371    3831 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:18.736606    3817 main.go:141] libmachine: (custom-flannel-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:18.896553    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:18.896462    3831 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/id_rsa...
	I1030 16:14:19.069089    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:19.069007    3831 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/custom-flannel-996000.rawdisk...
	I1030 16:14:19.069134    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Writing magic tar header
	I1030 16:14:19.069148    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Writing SSH key tar header
	I1030 16:14:19.069945    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | I1030 16:14:19.069821    3831 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000 ...
	I1030 16:14:19.397271    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:19.397286    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/custom-flannel-996000/hyperkit.pid
	I1030 16:14:19.397318    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | Using UUID 0d42770c-777a-11ee-b0ea-149d997fca88
	I1030 16:14:19.434020    3817 main.go:141] libmachine: (custom-flannel-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:19.434090    3817 client.go:171] LocalClient.Create took 698.744765ms
	I1030 16:14:21.435850    3817 start.go:128] duration metric: createHost completed in 2.756480014s
	I1030 16:14:21.435878    3817 start.go:83] releasing machines lock for "custom-flannel-996000", held for 2.756676947s
	W1030 16:14:21.435992    3817 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:21.479663    3817 out.go:177] 
	W1030 16:14:21.503751    3817 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:14:21.503811    3817 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:14:21.503824    3817 out.go:239] * Related issues:
	* Related issues:
	W1030 16:14:21.503861    3817 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:14:21.503888    3817 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:14:21.525630    3817 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (11.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (11.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p false-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit : exit status 60 (11.170498762s)

                                                
                                                
-- stdout --
	* [false-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node false-996000 in cluster false-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "false-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:14:27.883760    3976 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:14:27.883964    3976 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:27.883969    3976 out.go:309] Setting ErrFile to fd 2...
	I1030 16:14:27.883979    3976 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:27.884157    3976 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:14:27.885514    3976 out.go:303] Setting JSON to false
	I1030 16:14:27.907461    3976 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":842,"bootTime":1698706825,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:14:27.907558    3976 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:14:27.929998    3976 out.go:177] * [false-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:14:27.973712    3976 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:14:27.973809    3976 notify.go:220] Checking for updates...
	I1030 16:14:27.995520    3976 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:14:28.016797    3976 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:14:28.038445    3976 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:14:28.059553    3976 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:28.080672    3976 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:14:28.102496    3976 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:28.102696    3976 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:28.102835    3976 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:14:28.132552    3976 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:14:28.174727    3976 start.go:298] selected driver: hyperkit
	I1030 16:14:28.174754    3976 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:14:28.174776    3976 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:14:28.179110    3976 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:28.179207    3976 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:14:28.186727    3976 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:14:28.190434    3976 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:28.190458    3976 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:14:28.190494    3976 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:14:28.190725    3976 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:14:28.190788    3976 cni.go:84] Creating CNI manager for "false"
	I1030 16:14:28.190801    3976 start_flags.go:323] config:
	{Name:false-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:false-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C
RISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:14:28.190946    3976 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:28.211530    3976 out.go:177] * Starting control plane node false-996000 in cluster false-996000
	I1030 16:14:28.232650    3976 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:14:28.232720    3976 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:14:28.232784    3976 cache.go:56] Caching tarball of preloaded images
	I1030 16:14:28.232982    3976 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:14:28.233000    3976 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:14:28.233148    3976 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/false-996000/config.json ...
	I1030 16:14:28.233182    3976 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/false-996000/config.json: {Name:mk9fa38d6f0bcc26b2520d0ad5770588a18a1850 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:14:28.233837    3976 start.go:365] acquiring machines lock for false-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:28.233952    3976 start.go:369] acquired machines lock for "false-996000" in 91.801µs
	I1030 16:14:28.233999    3976 start.go:93] Provisioning new machine with config: &{Name:false-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.28.3 ClusterName:false-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Moun
tOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:28.234075    3976 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:28.276560    3976 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:28.277005    3976 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:28.277068    3976 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:28.286133    3976 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50664
	I1030 16:14:28.286487    3976 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:28.286917    3976 main.go:141] libmachine: Using API Version  1
	I1030 16:14:28.286931    3976 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:28.287148    3976 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:28.287254    3976 main.go:141] libmachine: (false-996000) Calling .GetMachineName
	I1030 16:14:28.287334    3976 main.go:141] libmachine: (false-996000) Calling .DriverName
	I1030 16:14:28.287435    3976 start.go:159] libmachine.API.Create for "false-996000" (driver="hyperkit")
	I1030 16:14:28.287478    3976 client.go:168] LocalClient.Create starting
	I1030 16:14:28.287505    3976 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:28.287551    3976 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:28.287566    3976 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:28.287620    3976 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:28.287659    3976 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:28.287673    3976 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:28.287685    3976 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:28.287694    3976 main.go:141] libmachine: (false-996000) Calling .PreCreateCheck
	I1030 16:14:28.287781    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:28.287997    3976 main.go:141] libmachine: (false-996000) Calling .GetConfigRaw
	I1030 16:14:28.288455    3976 main.go:141] libmachine: Creating machine...
	I1030 16:14:28.288464    3976 main.go:141] libmachine: (false-996000) Calling .Create
	I1030 16:14:28.288534    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:28.288682    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:28.288528    3984 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:28.288747    3976 main.go:141] libmachine: (false-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:28.448382    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:28.448252    3984 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/id_rsa...
	I1030 16:14:28.507713    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:28.507642    3984 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/false-996000.rawdisk...
	I1030 16:14:28.507753    3976 main.go:141] libmachine: (false-996000) DBG | Writing magic tar header
	I1030 16:14:28.507763    3976 main.go:141] libmachine: (false-996000) DBG | Writing SSH key tar header
	I1030 16:14:28.508554    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:28.508479    3984 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000 ...
	I1030 16:14:28.840417    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:28.840439    3976 main.go:141] libmachine: (false-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/hyperkit.pid
	I1030 16:14:28.840450    3976 main.go:141] libmachine: (false-996000) DBG | Using UUID 12f416f6-777a-11ee-8650-149d997fca88
	I1030 16:14:28.876320    3976 main.go:141] libmachine: (false-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:28.876412    3976 client.go:171] LocalClient.Create took 588.924247ms
	I1030 16:14:30.877234    3976 start.go:128] duration metric: createHost completed in 2.643138583s
	I1030 16:14:30.877261    3976 start.go:83] releasing machines lock for "false-996000", held for 2.643295308s
	W1030 16:14:30.877286    3976 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:14:30.877844    3976 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:30.877878    3976 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:30.886761    3976 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50666
	I1030 16:14:30.887302    3976 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:30.887779    3976 main.go:141] libmachine: Using API Version  1
	I1030 16:14:30.887810    3976 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:30.888069    3976 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:30.888430    3976 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:30.888453    3976 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:30.896699    3976 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50668
	I1030 16:14:30.897093    3976 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:30.897437    3976 main.go:141] libmachine: Using API Version  1
	I1030 16:14:30.897454    3976 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:30.897675    3976 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:30.897767    3976 main.go:141] libmachine: (false-996000) Calling .GetState
	I1030 16:14:30.897844    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:30.897865    3976 main.go:141] libmachine: (false-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:30.897881    3976 main.go:141] libmachine: (false-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/hyperkit.json: no such file or directory
	I1030 16:14:30.897909    3976 main.go:141] libmachine: (false-996000) Calling .DriverName
	I1030 16:14:30.931937    3976 out.go:177] * Deleting "false-996000" in hyperkit ...
	I1030 16:14:30.952477    3976 main.go:141] libmachine: (false-996000) Calling .Remove
	I1030 16:14:30.952792    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:30.952814    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:30.952834    3976 main.go:141] libmachine: (false-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:30.952869    3976 main.go:141] libmachine: (false-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/hyperkit.json: no such file or directory
	W1030 16:14:30.968377    3976 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:30.968391    3976 start.go:706] Will try again in 5 seconds ...
	I1030 16:14:35.969626    3976 start.go:365] acquiring machines lock for false-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:35.969867    3976 start.go:369] acquired machines lock for "false-996000" in 139.035µs
	I1030 16:14:35.969894    3976 start.go:93] Provisioning new machine with config: &{Name:false-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.28.3 ClusterName:false-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Moun
tOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:35.970000    3976 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:35.992952    3976 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:35.993098    3976 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:35.993201    3976 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:36.003218    3976 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50670
	I1030 16:14:36.003783    3976 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:36.004107    3976 main.go:141] libmachine: Using API Version  1
	I1030 16:14:36.004146    3976 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:36.004336    3976 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:36.004442    3976 main.go:141] libmachine: (false-996000) Calling .GetMachineName
	I1030 16:14:36.004529    3976 main.go:141] libmachine: (false-996000) Calling .DriverName
	I1030 16:14:36.004614    3976 start.go:159] libmachine.API.Create for "false-996000" (driver="hyperkit")
	I1030 16:14:36.004630    3976 client.go:168] LocalClient.Create starting
	I1030 16:14:36.004655    3976 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:36.004701    3976 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:36.004716    3976 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:36.004757    3976 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:36.004792    3976 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:36.004804    3976 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:36.004822    3976 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:36.004827    3976 main.go:141] libmachine: (false-996000) Calling .PreCreateCheck
	I1030 16:14:36.004905    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:36.004940    3976 main.go:141] libmachine: (false-996000) Calling .GetConfigRaw
	I1030 16:14:36.005351    3976 main.go:141] libmachine: Creating machine...
	I1030 16:14:36.005360    3976 main.go:141] libmachine: (false-996000) Calling .Create
	I1030 16:14:36.005443    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:36.005592    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:36.005439    3990 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:36.005632    3976 main.go:141] libmachine: (false-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:36.168831    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:36.168675    3990 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/id_rsa...
	I1030 16:14:36.434774    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:36.434666    3990 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/false-996000.rawdisk...
	I1030 16:14:36.434791    3976 main.go:141] libmachine: (false-996000) DBG | Writing magic tar header
	I1030 16:14:36.434800    3976 main.go:141] libmachine: (false-996000) DBG | Writing SSH key tar header
	I1030 16:14:36.435533    3976 main.go:141] libmachine: (false-996000) DBG | I1030 16:14:36.435439    3990 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000 ...
	I1030 16:14:36.763417    3976 main.go:141] libmachine: (false-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:36.763441    3976 main.go:141] libmachine: (false-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/false-996000/hyperkit.pid
	I1030 16:14:36.763464    3976 main.go:141] libmachine: (false-996000) DBG | Using UUID 178d849a-777a-11ee-8650-149d997fca88
	I1030 16:14:36.801117    3976 main.go:141] libmachine: (false-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:36.801199    3976 client.go:171] LocalClient.Create took 796.561232ms
	I1030 16:14:38.803421    3976 start.go:128] duration metric: createHost completed in 2.833402691s
	I1030 16:14:38.803452    3976 start.go:83] releasing machines lock for "false-996000", held for 2.833570948s
	W1030 16:14:38.803563    3976 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p false-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p false-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:38.850059    3976 out.go:177] 
	W1030 16:14:38.872374    3976 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:14:38.872432    3976 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:14:38.872471    3976 out.go:239] * Related issues:
	* Related issues:
	W1030 16:14:38.872502    3976 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:14:38.872526    3976 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:14:38.915030    3976 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/false/Start (11.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (11.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kindnet-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kindnet-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit : exit status 60 (11.338666023s)

                                                
                                                
-- stdout --
	* [kindnet-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node kindnet-996000 in cluster kindnet-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kindnet-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:14:44.804740    4124 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:14:44.805030    4124 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:44.805035    4124 out.go:309] Setting ErrFile to fd 2...
	I1030 16:14:44.805039    4124 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:14:44.805214    4124 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:14:44.806617    4124 out.go:303] Setting JSON to false
	I1030 16:14:44.828864    4124 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":859,"bootTime":1698706825,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:14:44.829252    4124 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:14:44.851450    4124 out.go:177] * [kindnet-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:14:44.916053    4124 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:14:44.894498    4124 notify.go:220] Checking for updates...
	I1030 16:14:44.957977    4124 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:14:44.979013    4124 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:14:45.000434    4124 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:14:45.022178    4124 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:45.043205    4124 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:14:45.065161    4124 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:45.065375    4124 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:14:45.065512    4124 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:14:45.095248    4124 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:14:45.137262    4124 start.go:298] selected driver: hyperkit
	I1030 16:14:45.137311    4124 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:14:45.137351    4124 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:14:45.141941    4124 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:45.142046    4124 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:14:45.149866    4124 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:14:45.153854    4124 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:45.153873    4124 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:14:45.153905    4124 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:14:45.154110    4124 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:14:45.154173    4124 cni.go:84] Creating CNI manager for "kindnet"
	I1030 16:14:45.154181    4124 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I1030 16:14:45.154192    4124 start_flags.go:323] config:
	{Name:kindnet-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:kindnet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:dock
er CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:14:45.154325    4124 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:14:45.196236    4124 out.go:177] * Starting control plane node kindnet-996000 in cluster kindnet-996000
	I1030 16:14:45.217193    4124 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:14:45.217270    4124 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:14:45.217298    4124 cache.go:56] Caching tarball of preloaded images
	I1030 16:14:45.217522    4124 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:14:45.217541    4124 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:14:45.217715    4124 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kindnet-996000/config.json ...
	I1030 16:14:45.217740    4124 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kindnet-996000/config.json: {Name:mk21176a3f7488839485101012b2848b400c769a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:14:45.218310    4124 start.go:365] acquiring machines lock for kindnet-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:45.218418    4124 start.go:369] acquired machines lock for "kindnet-996000" in 77.19µs
	I1030 16:14:45.218460    4124 start.go:93] Provisioning new machine with config: &{Name:kindnet-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:kindnet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:45.218577    4124 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:45.261239    4124 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:45.261718    4124 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:45.261803    4124 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:45.271131    4124 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50745
	I1030 16:14:45.271510    4124 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:45.271947    4124 main.go:141] libmachine: Using API Version  1
	I1030 16:14:45.271960    4124 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:45.272169    4124 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:45.272293    4124 main.go:141] libmachine: (kindnet-996000) Calling .GetMachineName
	I1030 16:14:45.272382    4124 main.go:141] libmachine: (kindnet-996000) Calling .DriverName
	I1030 16:14:45.272480    4124 start.go:159] libmachine.API.Create for "kindnet-996000" (driver="hyperkit")
	I1030 16:14:45.272506    4124 client.go:168] LocalClient.Create starting
	I1030 16:14:45.272534    4124 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:45.272596    4124 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:45.272611    4124 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:45.272662    4124 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:45.272697    4124 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:45.272712    4124 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:45.272724    4124 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:45.272733    4124 main.go:141] libmachine: (kindnet-996000) Calling .PreCreateCheck
	I1030 16:14:45.272815    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:45.273002    4124 main.go:141] libmachine: (kindnet-996000) Calling .GetConfigRaw
	I1030 16:14:45.273428    4124 main.go:141] libmachine: Creating machine...
	I1030 16:14:45.273436    4124 main.go:141] libmachine: (kindnet-996000) Calling .Create
	I1030 16:14:45.273516    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:45.273662    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:45.273510    4135 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:45.273720    4124 main.go:141] libmachine: (kindnet-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:45.435006    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:45.434921    4135 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/id_rsa...
	I1030 16:14:45.729884    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:45.729760    4135 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/kindnet-996000.rawdisk...
	I1030 16:14:45.729905    4124 main.go:141] libmachine: (kindnet-996000) DBG | Writing magic tar header
	I1030 16:14:45.729929    4124 main.go:141] libmachine: (kindnet-996000) DBG | Writing SSH key tar header
	I1030 16:14:45.730887    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:45.730713    4135 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000 ...
	I1030 16:14:46.066078    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:46.066096    4124 main.go:141] libmachine: (kindnet-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/hyperkit.pid
	I1030 16:14:46.066109    4124 main.go:141] libmachine: (kindnet-996000) DBG | Using UUID 1d13bef2-777a-11ee-bf43-149d997fca88
	I1030 16:14:46.101042    4124 main.go:141] libmachine: (kindnet-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:46.101131    4124 client.go:171] LocalClient.Create took 828.613035ms
	I1030 16:14:48.102803    4124 start.go:128] duration metric: createHost completed in 2.884204765s
	I1030 16:14:48.102830    4124 start.go:83] releasing machines lock for "kindnet-996000", held for 2.884400736s
	W1030 16:14:48.102856    4124 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:14:48.103370    4124 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:48.103411    4124 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:48.112976    4124 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50747
	I1030 16:14:48.113420    4124 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:48.113794    4124 main.go:141] libmachine: Using API Version  1
	I1030 16:14:48.113808    4124 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:48.114045    4124 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:48.114390    4124 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:48.114414    4124 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:48.122040    4124 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50749
	I1030 16:14:48.122363    4124 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:48.122704    4124 main.go:141] libmachine: Using API Version  1
	I1030 16:14:48.122713    4124 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:48.122899    4124 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:48.122996    4124 main.go:141] libmachine: (kindnet-996000) Calling .GetState
	I1030 16:14:48.123092    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:48.123109    4124 main.go:141] libmachine: (kindnet-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:48.123122    4124 main.go:141] libmachine: (kindnet-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/hyperkit.json: no such file or directory
	I1030 16:14:48.123189    4124 main.go:141] libmachine: (kindnet-996000) Calling .DriverName
	I1030 16:14:48.166658    4124 out.go:177] * Deleting "kindnet-996000" in hyperkit ...
	I1030 16:14:48.190899    4124 main.go:141] libmachine: (kindnet-996000) Calling .Remove
	I1030 16:14:48.191224    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:48.191249    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:48.191272    4124 main.go:141] libmachine: (kindnet-996000) DBG | hyperkit pid from json: 0
	I1030 16:14:48.191355    4124 main.go:141] libmachine: (kindnet-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/hyperkit.json: no such file or directory
	W1030 16:14:48.207123    4124 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:48.207136    4124 start.go:706] Will try again in 5 seconds ...
	I1030 16:14:53.209242    4124 start.go:365] acquiring machines lock for kindnet-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:14:53.209479    4124 start.go:369] acquired machines lock for "kindnet-996000" in 131.484µs
	I1030 16:14:53.209511    4124 start.go:93] Provisioning new machine with config: &{Name:kindnet-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:kindnet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:14:53.209619    4124 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:14:53.254343    4124 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:14:53.254507    4124 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:14:53.254594    4124 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:14:53.264295    4124 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50751
	I1030 16:14:53.264811    4124 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:14:53.265147    4124 main.go:141] libmachine: Using API Version  1
	I1030 16:14:53.265161    4124 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:14:53.265373    4124 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:14:53.265465    4124 main.go:141] libmachine: (kindnet-996000) Calling .GetMachineName
	I1030 16:14:53.265546    4124 main.go:141] libmachine: (kindnet-996000) Calling .DriverName
	I1030 16:14:53.265644    4124 start.go:159] libmachine.API.Create for "kindnet-996000" (driver="hyperkit")
	I1030 16:14:53.265664    4124 client.go:168] LocalClient.Create starting
	I1030 16:14:53.265695    4124 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:14:53.265744    4124 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:53.265756    4124 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:53.265803    4124 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:14:53.265837    4124 main.go:141] libmachine: Decoding PEM data...
	I1030 16:14:53.265853    4124 main.go:141] libmachine: Parsing certificate...
	I1030 16:14:53.265866    4124 main.go:141] libmachine: Running pre-create checks...
	I1030 16:14:53.265872    4124 main.go:141] libmachine: (kindnet-996000) Calling .PreCreateCheck
	I1030 16:14:53.265956    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:53.265983    4124 main.go:141] libmachine: (kindnet-996000) Calling .GetConfigRaw
	I1030 16:14:53.266385    4124 main.go:141] libmachine: Creating machine...
	I1030 16:14:53.266393    4124 main.go:141] libmachine: (kindnet-996000) Calling .Create
	I1030 16:14:53.266468    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:53.266607    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:53.266456    4139 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:14:53.266677    4124 main.go:141] libmachine: (kindnet-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:14:53.430344    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:53.430241    4139 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/id_rsa...
	I1030 16:14:53.547039    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:53.546961    4139 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/kindnet-996000.rawdisk...
	I1030 16:14:53.547076    4124 main.go:141] libmachine: (kindnet-996000) DBG | Writing magic tar header
	I1030 16:14:53.547084    4124 main.go:141] libmachine: (kindnet-996000) DBG | Writing SSH key tar header
	I1030 16:14:53.547979    4124 main.go:141] libmachine: (kindnet-996000) DBG | I1030 16:14:53.547834    4139 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000 ...
	I1030 16:14:53.876209    4124 main.go:141] libmachine: (kindnet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:14:53.876228    4124 main.go:141] libmachine: (kindnet-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kindnet-996000/hyperkit.pid
	I1030 16:14:53.876264    4124 main.go:141] libmachine: (kindnet-996000) DBG | Using UUID 21d765e2-777a-11ee-bf43-149d997fca88
	I1030 16:14:53.912098    4124 main.go:141] libmachine: (kindnet-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:14:53.912182    4124 client.go:171] LocalClient.Create took 646.511315ms
	I1030 16:14:55.914391    4124 start.go:128] duration metric: createHost completed in 2.704736343s
	I1030 16:14:55.914429    4124 start.go:83] releasing machines lock for "kindnet-996000", held for 2.704930159s
	W1030 16:14:55.914558    4124 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kindnet-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kindnet-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:14:55.959047    4124 out.go:177] 
	W1030 16:14:55.982280    4124 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:14:55.982367    4124 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:14:55.982417    4124 out.go:239] * Related issues:
	* Related issues:
	W1030 16:14:55.982507    4124 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:14:55.982551    4124 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:14:56.026020    4124 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kindnet/Start (11.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (11.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p flannel-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p flannel-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit : exit status 60 (11.070047614s)

                                                
                                                
-- stdout --
	* [flannel-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node flannel-996000 in cluster flannel-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "flannel-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:01.944754    4277 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:01.944966    4277 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:01.944971    4277 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:01.944976    4277 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:01.945159    4277 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:01.946547    4277 out.go:303] Setting JSON to false
	I1030 16:15:01.968547    4277 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":876,"bootTime":1698706825,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:01.968651    4277 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:01.991937    4277 out.go:177] * [flannel-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:02.035177    4277 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:02.035226    4277 notify.go:220] Checking for updates...
	I1030 16:15:02.056886    4277 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:02.078062    4277 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:02.099979    4277 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:02.121856    4277 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:02.142974    4277 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:02.165829    4277 config.go:182] Loaded profile config "cert-expiration-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:02.166026    4277 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:02.166170    4277 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:02.195783    4277 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:02.238007    4277 start.go:298] selected driver: hyperkit
	I1030 16:15:02.238059    4277 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:02.238078    4277 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:02.242529    4277 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:02.242666    4277 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:02.250519    4277 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:02.254917    4277 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:02.254938    4277 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:02.254971    4277 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:15:02.255167    4277 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:02.255197    4277 cni.go:84] Creating CNI manager for "flannel"
	I1030 16:15:02.255207    4277 start_flags.go:318] Found "Flannel" CNI - setting NetworkPlugin=cni
	I1030 16:15:02.255216    4277 start_flags.go:323] config:
	{Name:flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:dock
er CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:02.255355    4277 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:02.298025    4277 out.go:177] * Starting control plane node flannel-996000 in cluster flannel-996000
	I1030 16:15:02.319924    4277 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:15:02.319995    4277 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:15:02.320038    4277 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:02.320229    4277 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:02.320247    4277 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:15:02.320402    4277 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/flannel-996000/config.json ...
	I1030 16:15:02.320440    4277 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/flannel-996000/config.json: {Name:mk89591fc37f57ba51c3063be430e91b3cf4e974 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:02.321119    4277 start.go:365] acquiring machines lock for flannel-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:02.321248    4277 start.go:369] acquired machines lock for "flannel-996000" in 105.23µs
	I1030 16:15:02.321296    4277 start.go:93] Provisioning new machine with config: &{Name:flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:02.321393    4277 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:02.363986    4277 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:02.364432    4277 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:02.364501    4277 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:02.373581    4277 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50827
	I1030 16:15:02.373931    4277 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:02.374357    4277 main.go:141] libmachine: Using API Version  1
	I1030 16:15:02.374372    4277 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:02.374584    4277 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:02.374696    4277 main.go:141] libmachine: (flannel-996000) Calling .GetMachineName
	I1030 16:15:02.374791    4277 main.go:141] libmachine: (flannel-996000) Calling .DriverName
	I1030 16:15:02.374896    4277 start.go:159] libmachine.API.Create for "flannel-996000" (driver="hyperkit")
	I1030 16:15:02.374933    4277 client.go:168] LocalClient.Create starting
	I1030 16:15:02.374961    4277 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:02.375008    4277 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:02.375023    4277 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:02.375074    4277 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:02.375108    4277 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:02.375118    4277 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:02.375137    4277 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:02.375143    4277 main.go:141] libmachine: (flannel-996000) Calling .PreCreateCheck
	I1030 16:15:02.375229    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:02.375402    4277 main.go:141] libmachine: (flannel-996000) Calling .GetConfigRaw
	I1030 16:15:02.375881    4277 main.go:141] libmachine: Creating machine...
	I1030 16:15:02.375890    4277 main.go:141] libmachine: (flannel-996000) Calling .Create
	I1030 16:15:02.375979    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:02.376122    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:02.375967    4285 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:02.376177    4277 main.go:141] libmachine: (flannel-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:02.535924    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:02.535842    4285 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/id_rsa...
	I1030 16:15:02.621321    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:02.621218    4285 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/flannel-996000.rawdisk...
	I1030 16:15:02.621334    4277 main.go:141] libmachine: (flannel-996000) DBG | Writing magic tar header
	I1030 16:15:02.621357    4277 main.go:141] libmachine: (flannel-996000) DBG | Writing SSH key tar header
	I1030 16:15:02.622111    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:02.622047    4285 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000 ...
	I1030 16:15:02.952676    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:02.952699    4277 main.go:141] libmachine: (flannel-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/hyperkit.pid
	I1030 16:15:02.952732    4277 main.go:141] libmachine: (flannel-996000) DBG | Using UUID 27456a74-777a-11ee-a12d-149d997fca88
	I1030 16:15:02.991284    4277 main.go:141] libmachine: (flannel-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:02.991382    4277 client.go:171] LocalClient.Create took 616.436527ms
	I1030 16:15:04.992259    4277 start.go:128] duration metric: createHost completed in 2.670846176s
	I1030 16:15:04.992286    4277 start.go:83] releasing machines lock for "flannel-996000", held for 2.671023847s
	W1030 16:15:04.992312    4277 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:04.992819    4277 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:04.992878    4277 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:05.002519    4277 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50829
	I1030 16:15:05.003057    4277 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:05.003448    4277 main.go:141] libmachine: Using API Version  1
	I1030 16:15:05.003464    4277 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:05.003676    4277 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:05.004000    4277 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:05.004041    4277 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:05.012449    4277 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50831
	I1030 16:15:05.012871    4277 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:05.013200    4277 main.go:141] libmachine: Using API Version  1
	I1030 16:15:05.013214    4277 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:05.013431    4277 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:05.013533    4277 main.go:141] libmachine: (flannel-996000) Calling .GetState
	I1030 16:15:05.013618    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:05.013631    4277 main.go:141] libmachine: (flannel-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:05.013649    4277 main.go:141] libmachine: (flannel-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/hyperkit.json: no such file or directory
	I1030 16:15:05.013684    4277 main.go:141] libmachine: (flannel-996000) Calling .DriverName
	I1030 16:15:05.075304    4277 out.go:177] * Deleting "flannel-996000" in hyperkit ...
	I1030 16:15:05.098192    4277 main.go:141] libmachine: (flannel-996000) Calling .Remove
	I1030 16:15:05.098498    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:05.098517    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:05.098538    4277 main.go:141] libmachine: (flannel-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:05.098587    4277 main.go:141] libmachine: (flannel-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/hyperkit.json: no such file or directory
	W1030 16:15:05.113732    4277 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:05.113744    4277 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:10.115331    4277 start.go:365] acquiring machines lock for flannel-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:10.115499    4277 start.go:369] acquired machines lock for "flannel-996000" in 106.943µs
	I1030 16:15:10.115529    4277 start.go:93] Provisioning new machine with config: &{Name:flannel-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:flannel-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26
2144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:10.115644    4277 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:10.137563    4277 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:10.137713    4277 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:10.137749    4277 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:10.146591    4277 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50840
	I1030 16:15:10.147275    4277 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:10.147812    4277 main.go:141] libmachine: Using API Version  1
	I1030 16:15:10.147827    4277 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:10.148106    4277 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:10.148235    4277 main.go:141] libmachine: (flannel-996000) Calling .GetMachineName
	I1030 16:15:10.148315    4277 main.go:141] libmachine: (flannel-996000) Calling .DriverName
	I1030 16:15:10.148418    4277 start.go:159] libmachine.API.Create for "flannel-996000" (driver="hyperkit")
	I1030 16:15:10.148438    4277 client.go:168] LocalClient.Create starting
	I1030 16:15:10.148464    4277 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:10.148510    4277 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:10.148524    4277 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:10.148563    4277 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:10.148601    4277 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:10.148613    4277 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:10.148627    4277 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:10.148633    4277 main.go:141] libmachine: (flannel-996000) Calling .PreCreateCheck
	I1030 16:15:10.148757    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:10.148776    4277 main.go:141] libmachine: (flannel-996000) Calling .GetConfigRaw
	I1030 16:15:10.149245    4277 main.go:141] libmachine: Creating machine...
	I1030 16:15:10.149255    4277 main.go:141] libmachine: (flannel-996000) Calling .Create
	I1030 16:15:10.149362    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:10.149530    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:10.149353    4301 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:10.149612    4277 main.go:141] libmachine: (flannel-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:10.315967    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:10.315864    4301 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/id_rsa...
	I1030 16:15:10.401816    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:10.401738    4301 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/flannel-996000.rawdisk...
	I1030 16:15:10.401828    4277 main.go:141] libmachine: (flannel-996000) DBG | Writing magic tar header
	I1030 16:15:10.401836    4277 main.go:141] libmachine: (flannel-996000) DBG | Writing SSH key tar header
	I1030 16:15:10.402682    4277 main.go:141] libmachine: (flannel-996000) DBG | I1030 16:15:10.402620    4301 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000 ...
	I1030 16:15:10.730297    4277 main.go:141] libmachine: (flannel-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:10.730325    4277 main.go:141] libmachine: (flannel-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/flannel-996000/hyperkit.pid
	I1030 16:15:10.730379    4277 main.go:141] libmachine: (flannel-996000) DBG | Using UUID 2be791b0-777a-11ee-a12d-149d997fca88
	I1030 16:15:10.765087    4277 main.go:141] libmachine: (flannel-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:10.765175    4277 client.go:171] LocalClient.Create took 616.7299ms
	I1030 16:15:12.767455    4277 start.go:128] duration metric: createHost completed in 2.651746573s
	I1030 16:15:12.767493    4277 start.go:83] releasing machines lock for "flannel-996000", held for 2.651980581s
	W1030 16:15:12.767642    4277 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p flannel-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p flannel-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:12.813193    4277 out.go:177] 
	W1030 16:15:12.835036    4277 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:12.835112    4277 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:12.835160    4277 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:12.835213    4277 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:12.835268    4277 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:12.878141    4277 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/flannel/Start (11.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (11.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit : exit status 60 (11.641623221s)

                                                
                                                
-- stdout --
	* [enable-default-cni-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node enable-default-cni-996000 in cluster enable-default-cni-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "enable-default-cni-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:13.929757    4334 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:13.951092    4334 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:13.951131    4334 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:13.951143    4334 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:13.951542    4334 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:13.972649    4334 out.go:303] Setting JSON to false
	I1030 16:15:13.996803    4334 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":888,"bootTime":1698706825,"procs":443,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:13.996906    4334 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:14.018141    4334 out.go:177] * [enable-default-cni-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:14.081018    4334 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:14.060429    4334 notify.go:220] Checking for updates...
	I1030 16:15:14.164962    4334 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:14.207207    4334 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:14.227970    4334 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:14.248997    4334 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:14.270089    4334 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:14.291406    4334 config.go:182] Loaded profile config "flannel-996000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:14.291526    4334 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:14.291615    4334 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:14.319967    4334 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:14.361951    4334 start.go:298] selected driver: hyperkit
	I1030 16:15:14.361967    4334 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:14.361978    4334 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:14.364892    4334 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:14.364998    4334 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:14.372868    4334 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:14.376745    4334 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:14.376765    4334 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:14.376798    4334 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	E1030 16:15:14.376993    4334 start_flags.go:465] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I1030 16:15:14.377011    4334 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:14.377078    4334 cni.go:84] Creating CNI manager for "bridge"
	I1030 16:15:14.377086    4334 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:15:14.377094    4334 start_flags.go:323] config:
	{Name:enable-default-cni-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:enable-default-cni-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:14.377243    4334 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:14.419121    4334 out.go:177] * Starting control plane node enable-default-cni-996000 in cluster enable-default-cni-996000
	I1030 16:15:14.439921    4334 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:15:14.439963    4334 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:15:14.439981    4334 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:14.440112    4334 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:14.440122    4334 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:15:14.440203    4334 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/enable-default-cni-996000/config.json ...
	I1030 16:15:14.440220    4334 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/enable-default-cni-996000/config.json: {Name:mk7723fddc6b1b4232987b64e3f6f4216818a0f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:14.440529    4334 start.go:365] acquiring machines lock for enable-default-cni-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:14.440584    4334 start.go:369] acquired machines lock for "enable-default-cni-996000" in 40.772µs
	I1030 16:15:14.440607    4334 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:enable-default-cni-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker M
ountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:14.440656    4334 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:14.482963    4334 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:14.483191    4334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:14.483229    4334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:14.491353    4334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50862
	I1030 16:15:14.491771    4334 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:14.492208    4334 main.go:141] libmachine: Using API Version  1
	I1030 16:15:14.492219    4334 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:14.492485    4334 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:14.492597    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .GetMachineName
	I1030 16:15:14.492691    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .DriverName
	I1030 16:15:14.492802    4334 start.go:159] libmachine.API.Create for "enable-default-cni-996000" (driver="hyperkit")
	I1030 16:15:14.492827    4334 client.go:168] LocalClient.Create starting
	I1030 16:15:14.492860    4334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:14.492912    4334 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:14.492930    4334 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:14.492981    4334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:14.493022    4334 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:14.493033    4334 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:14.493046    4334 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:14.493055    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .PreCreateCheck
	I1030 16:15:14.493141    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:14.493346    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .GetConfigRaw
	I1030 16:15:14.493811    4334 main.go:141] libmachine: Creating machine...
	I1030 16:15:14.493820    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .Create
	I1030 16:15:14.493902    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:14.494054    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:14.493896    4355 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:14.494102    4334 main.go:141] libmachine: (enable-default-cni-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:14.869765    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:14.869648    4355 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/id_rsa...
	I1030 16:15:15.014047    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:15.013984    4355 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/enable-default-cni-996000.rawdisk...
	I1030 16:15:15.014064    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Writing magic tar header
	I1030 16:15:15.014079    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Writing SSH key tar header
	I1030 16:15:15.014584    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:15.014543    4355 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000 ...
	I1030 16:15:15.341389    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:15.341411    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/hyperkit.pid
	I1030 16:15:15.341424    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Using UUID 2e7e9f7c-777a-11ee-938b-149d997fca88
	I1030 16:15:15.381023    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:15.381105    4334 client.go:171] LocalClient.Create took 888.266486ms
	I1030 16:15:17.382216    4334 start.go:128] duration metric: createHost completed in 2.941548337s
	I1030 16:15:17.382234    4334 start.go:83] releasing machines lock for "enable-default-cni-996000", held for 2.941643341s
	W1030 16:15:17.382247    4334 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:17.382529    4334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:17.382553    4334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:17.390727    4334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50900
	I1030 16:15:17.391100    4334 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:17.391478    4334 main.go:141] libmachine: Using API Version  1
	I1030 16:15:17.391490    4334 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:17.391747    4334 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:17.392151    4334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:17.392176    4334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:17.400172    4334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50902
	I1030 16:15:17.400519    4334 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:17.401031    4334 main.go:141] libmachine: Using API Version  1
	I1030 16:15:17.401051    4334 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:17.401294    4334 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:17.401398    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .GetState
	I1030 16:15:17.401483    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:17.401519    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:17.401530    4334 main.go:141] libmachine: (enable-default-cni-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/hyperkit.json: no such file or directory
	I1030 16:15:17.401608    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .DriverName
	I1030 16:15:17.444386    4334 out.go:177] * Deleting "enable-default-cni-996000" in hyperkit ...
	I1030 16:15:17.465385    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .Remove
	I1030 16:15:17.465695    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:17.465718    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:17.465759    4334 main.go:141] libmachine: (enable-default-cni-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/hyperkit.json: no such file or directory
	I1030 16:15:17.465803    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | hyperkit pid from json: 0
	W1030 16:15:17.544681    4334 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:17.544705    4334 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:22.544945    4334 start.go:365] acquiring machines lock for enable-default-cni-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:22.564864    4334 start.go:369] acquired machines lock for "enable-default-cni-996000" in 19.825728ms
	I1030 16:15:22.564931    4334 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22
KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:enable-default-cni-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker M
ountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:22.565088    4334 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:22.599790    4334 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:22.599915    4334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:22.599964    4334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:22.610065    4334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50942
	I1030 16:15:22.610607    4334 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:22.611067    4334 main.go:141] libmachine: Using API Version  1
	I1030 16:15:22.611102    4334 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:22.611429    4334 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:22.611531    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .GetMachineName
	I1030 16:15:22.611628    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .DriverName
	I1030 16:15:22.611720    4334 start.go:159] libmachine.API.Create for "enable-default-cni-996000" (driver="hyperkit")
	I1030 16:15:22.611745    4334 client.go:168] LocalClient.Create starting
	I1030 16:15:22.611768    4334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:22.611801    4334 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:22.611812    4334 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:22.611854    4334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:22.611885    4334 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:22.611893    4334 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:22.611907    4334 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:22.611913    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .PreCreateCheck
	I1030 16:15:22.612001    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:22.612039    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .GetConfigRaw
	I1030 16:15:22.642076    4334 main.go:141] libmachine: Creating machine...
	I1030 16:15:22.642100    4334 main.go:141] libmachine: (enable-default-cni-996000) Calling .Create
	I1030 16:15:22.642377    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:22.642671    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:22.642330    4486 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:22.642786    4334 main.go:141] libmachine: (enable-default-cni-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:22.898120    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:22.897987    4486 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/id_rsa...
	I1030 16:15:22.951263    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:22.951182    4486 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/enable-default-cni-996000.rawdisk...
	I1030 16:15:22.951304    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Writing magic tar header
	I1030 16:15:22.951315    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Writing SSH key tar header
	I1030 16:15:22.953471    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | I1030 16:15:22.953388    4486 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000 ...
	I1030 16:15:23.283311    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:23.283329    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/enable-default-cni-996000/hyperkit.pid
	I1030 16:15:23.283358    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | Using UUID 3355278c-777a-11ee-938b-149d997fca88
	I1030 16:15:23.323055    4334 main.go:141] libmachine: (enable-default-cni-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:23.323135    4334 client.go:171] LocalClient.Create took 711.383564ms
	I1030 16:15:25.325374    4334 start.go:128] duration metric: createHost completed in 2.760267953s
	I1030 16:15:25.325434    4334 start.go:83] releasing machines lock for "enable-default-cni-996000", held for 2.760548178s
	W1030 16:15:25.325564    4334 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:25.347558    4334 out.go:177] 
	W1030 16:15:25.372083    4334 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:25.372142    4334 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:25.372155    4334 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:25.372231    4334 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:25.372288    4334 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:25.416178    4334 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (11.64s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (11.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p bridge-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p bridge-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit : exit status 60 (11.599362947s)

                                                
                                                
-- stdout --
	* [bridge-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node bridge-996000 in cluster bridge-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "bridge-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:19.525899    4467 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:19.526185    4467 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:19.526192    4467 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:19.526196    4467 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:19.526393    4467 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:19.527804    4467 out.go:303] Setting JSON to false
	I1030 16:15:19.550065    4467 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":894,"bootTime":1698706825,"procs":476,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:19.550166    4467 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:19.571729    4467 out.go:177] * [bridge-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:19.614666    4467 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:19.614810    4467 notify.go:220] Checking for updates...
	I1030 16:15:19.657488    4467 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:19.679464    4467 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:19.700424    4467 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:19.721652    4467 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:19.743662    4467 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:19.766409    4467 config.go:182] Loaded profile config "enable-default-cni-996000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:19.766591    4467 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:19.766731    4467 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:19.796648    4467 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:19.840360    4467 start.go:298] selected driver: hyperkit
	I1030 16:15:19.840389    4467 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:19.840406    4467 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:19.844833    4467 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:19.844970    4467 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:19.853184    4467 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:19.857767    4467 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:19.857796    4467 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:19.857827    4467 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:15:19.858031    4467 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:19.858090    4467 cni.go:84] Creating CNI manager for "bridge"
	I1030 16:15:19.858098    4467 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:15:19.858106    4467 start_flags.go:323] config:
	{Name:bridge-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:bridge-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:19.858281    4467 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:19.901755    4467 out.go:177] * Starting control plane node bridge-996000 in cluster bridge-996000
	I1030 16:15:19.924675    4467 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:15:19.924755    4467 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:15:19.924782    4467 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:19.924997    4467 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:19.925015    4467 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:15:19.925155    4467 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/bridge-996000/config.json ...
	I1030 16:15:19.925186    4467 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/bridge-996000/config.json: {Name:mk5d597b3f46cadbab38c59bf7ce3d5ce21a7d7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:19.925842    4467 start.go:365] acquiring machines lock for bridge-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:19.925981    4467 start.go:369] acquired machines lock for "bridge-996000" in 92.611µs
	I1030 16:15:19.926029    4467 start.go:93] Provisioning new machine with config: &{Name:bridge-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:bridge-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:19.926112    4467 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:19.976072    4467 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:19.976554    4467 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:19.976624    4467 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:19.985774    4467 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50936
	I1030 16:15:19.986156    4467 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:19.986582    4467 main.go:141] libmachine: Using API Version  1
	I1030 16:15:19.986599    4467 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:19.986804    4467 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:19.986920    4467 main.go:141] libmachine: (bridge-996000) Calling .GetMachineName
	I1030 16:15:19.987012    4467 main.go:141] libmachine: (bridge-996000) Calling .DriverName
	I1030 16:15:19.987128    4467 start.go:159] libmachine.API.Create for "bridge-996000" (driver="hyperkit")
	I1030 16:15:19.987154    4467 client.go:168] LocalClient.Create starting
	I1030 16:15:19.987189    4467 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:19.987238    4467 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:19.987253    4467 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:19.987309    4467 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:19.987346    4467 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:19.987376    4467 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:19.987397    4467 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:19.987404    4467 main.go:141] libmachine: (bridge-996000) Calling .PreCreateCheck
	I1030 16:15:19.987485    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:19.987684    4467 main.go:141] libmachine: (bridge-996000) Calling .GetConfigRaw
	I1030 16:15:19.988157    4467 main.go:141] libmachine: Creating machine...
	I1030 16:15:19.988165    4467 main.go:141] libmachine: (bridge-996000) Calling .Create
	I1030 16:15:19.988234    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:19.988386    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:19.988230    4475 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:19.988437    4467 main.go:141] libmachine: (bridge-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:20.146994    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:20.146926    4475 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/id_rsa...
	I1030 16:15:20.193824    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:20.193702    4475 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/bridge-996000.rawdisk...
	I1030 16:15:20.193845    4467 main.go:141] libmachine: (bridge-996000) DBG | Writing magic tar header
	I1030 16:15:20.193854    4467 main.go:141] libmachine: (bridge-996000) DBG | Writing SSH key tar header
	I1030 16:15:20.194352    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:20.194312    4475 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000 ...
	I1030 16:15:20.524653    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:20.524673    4467 main.go:141] libmachine: (bridge-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/hyperkit.pid
	I1030 16:15:20.524686    4467 main.go:141] libmachine: (bridge-996000) DBG | Using UUID 31c4ce90-777a-11ee-98d0-149d997fca88
	I1030 16:15:20.562370    4467 main.go:141] libmachine: (bridge-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:20.562460    4467 client.go:171] LocalClient.Create took 575.295211ms
	I1030 16:15:22.564719    4467 start.go:128] duration metric: createHost completed in 2.638558341s
	I1030 16:15:22.564780    4467 start.go:83] releasing machines lock for "bridge-996000", held for 2.63878507s
	W1030 16:15:22.564808    4467 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:22.565354    4467 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:22.565410    4467 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:22.575194    4467 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50938
	I1030 16:15:22.575811    4467 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:22.576281    4467 main.go:141] libmachine: Using API Version  1
	I1030 16:15:22.576299    4467 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:22.576533    4467 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:22.576861    4467 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:22.576903    4467 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:22.584978    4467 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50940
	I1030 16:15:22.585360    4467 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:22.585761    4467 main.go:141] libmachine: Using API Version  1
	I1030 16:15:22.585790    4467 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:22.586063    4467 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:22.586213    4467 main.go:141] libmachine: (bridge-996000) Calling .GetState
	I1030 16:15:22.586325    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:22.586349    4467 main.go:141] libmachine: (bridge-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/hyperkit.json: no such file or directory
	I1030 16:15:22.586357    4467 main.go:141] libmachine: (bridge-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:22.586401    4467 main.go:141] libmachine: (bridge-996000) Calling .DriverName
	I1030 16:15:22.641765    4467 out.go:177] * Deleting "bridge-996000" in hyperkit ...
	I1030 16:15:22.664805    4467 main.go:141] libmachine: (bridge-996000) Calling .Remove
	I1030 16:15:22.665095    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:22.665119    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:22.665138    4467 main.go:141] libmachine: (bridge-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/hyperkit.json: no such file or directory
	I1030 16:15:22.665163    4467 main.go:141] libmachine: (bridge-996000) DBG | hyperkit pid from json: 0
	W1030 16:15:22.718331    4467 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:22.718349    4467 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:27.720219    4467 start.go:365] acquiring machines lock for bridge-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:27.720434    4467 start.go:369] acquired machines lock for "bridge-996000" in 175.184µs
	I1030 16:15:27.720473    4467 start.go:93] Provisioning new machine with config: &{Name:bridge-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.3 ClusterName:bridge-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:27.720596    4467 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:27.778963    4467 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:27.779103    4467 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:27.779149    4467 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:27.788203    4467 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50966
	I1030 16:15:27.788546    4467 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:27.788879    4467 main.go:141] libmachine: Using API Version  1
	I1030 16:15:27.788889    4467 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:27.789129    4467 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:27.789257    4467 main.go:141] libmachine: (bridge-996000) Calling .GetMachineName
	I1030 16:15:27.789348    4467 main.go:141] libmachine: (bridge-996000) Calling .DriverName
	I1030 16:15:27.789456    4467 start.go:159] libmachine.API.Create for "bridge-996000" (driver="hyperkit")
	I1030 16:15:27.789477    4467 client.go:168] LocalClient.Create starting
	I1030 16:15:27.789505    4467 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:27.789550    4467 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:27.789562    4467 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:27.789610    4467 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:27.789644    4467 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:27.789654    4467 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:27.789668    4467 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:27.789674    4467 main.go:141] libmachine: (bridge-996000) Calling .PreCreateCheck
	I1030 16:15:27.789757    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:27.789818    4467 main.go:141] libmachine: (bridge-996000) Calling .GetConfigRaw
	I1030 16:15:27.800658    4467 main.go:141] libmachine: Creating machine...
	I1030 16:15:27.800685    4467 main.go:141] libmachine: (bridge-996000) Calling .Create
	I1030 16:15:27.800933    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:27.801273    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:27.800923    4543 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:27.801369    4467 main.go:141] libmachine: (bridge-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:28.174883    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:28.174818    4543 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/id_rsa...
	I1030 16:15:28.330834    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:28.330779    4543 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/bridge-996000.rawdisk...
	I1030 16:15:28.330847    4467 main.go:141] libmachine: (bridge-996000) DBG | Writing magic tar header
	I1030 16:15:28.330862    4467 main.go:141] libmachine: (bridge-996000) DBG | Writing SSH key tar header
	I1030 16:15:28.331360    4467 main.go:141] libmachine: (bridge-996000) DBG | I1030 16:15:28.331290    4543 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000 ...
	I1030 16:15:28.793546    4467 main.go:141] libmachine: (bridge-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:28.793572    4467 main.go:141] libmachine: (bridge-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/bridge-996000/hyperkit.pid
	I1030 16:15:28.793591    4467 main.go:141] libmachine: (bridge-996000) DBG | Using UUID 366b6eea-777a-11ee-98d0-149d997fca88
	I1030 16:15:28.876543    4467 main.go:141] libmachine: (bridge-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:28.876639    4467 client.go:171] LocalClient.Create took 1.087154764s
	I1030 16:15:30.877694    4467 start.go:128] duration metric: createHost completed in 3.157055228s
	I1030 16:15:30.877713    4467 start.go:83] releasing machines lock for "bridge-996000", held for 3.157264898s
	W1030 16:15:30.877796    4467 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p bridge-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p bridge-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:30.922011    4467 out.go:177] 
	W1030 16:15:30.943438    4467 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:30.943506    4467 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:30.943522    4467 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:30.943545    4467 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:30.943576    4467 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:30.986030    4467 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/bridge/Start (11.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (11.88s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kubenet-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubenet-996000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit : exit status 60 (11.879595804s)

                                                
                                                
-- stdout --
	* [kubenet-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node kubenet-996000 in cluster kubenet-996000
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kubenet-996000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:31.623254    4635 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:31.623857    4635 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:31.623869    4635 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:31.623878    4635 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:31.624234    4635 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:31.626686    4635 out.go:303] Setting JSON to false
	I1030 16:15:31.649980    4635 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":906,"bootTime":1698706825,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:31.650099    4635 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:31.671324    4635 out.go:177] * [kubenet-996000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:31.734394    4635 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:31.713618    4635 notify.go:220] Checking for updates...
	I1030 16:15:31.820651    4635 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:31.884551    4635 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:31.905316    4635 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:31.926350    4635 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:31.968522    4635 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:31.990239    4635 config.go:182] Loaded profile config "bridge-996000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:31.990448    4635 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:31.990585    4635 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:32.052422    4635 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:32.094551    4635 start.go:298] selected driver: hyperkit
	I1030 16:15:32.094575    4635 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:32.094594    4635 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:32.099010    4635 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:32.099120    4635 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:32.106751    4635 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:32.110475    4635 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:32.110504    4635 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:32.110540    4635 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:15:32.110727    4635 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:32.110791    4635 cni.go:80] network plugin configured as "kubenet", returning disabled
	I1030 16:15:32.110800    4635 start_flags.go:323] config:
	{Name:kubenet-996000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:kubenet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:dock
er CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:32.110938    4635 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:32.159269    4635 out.go:177] * Starting control plane node kubenet-996000 in cluster kubenet-996000
	I1030 16:15:32.180402    4635 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:15:32.180441    4635 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:15:32.180455    4635 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:32.180595    4635 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:32.180605    4635 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:15:32.180691    4635 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubenet-996000/config.json ...
	I1030 16:15:32.180707    4635 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/kubenet-996000/config.json: {Name:mk93fcdc4b8b0933050ec7f27fed8931c810e2d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:32.181016    4635 start.go:365] acquiring machines lock for kubenet-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:32.181063    4635 start.go:369] acquired machines lock for "kubenet-996000" in 38.234µs
	I1030 16:15:32.181089    4635 start.go:93] Provisioning new machine with config: &{Name:kubenet-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:kubenet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:32.181133    4635 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:32.202438    4635 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:32.202680    4635 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:32.202722    4635 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:32.210693    4635 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51026
	I1030 16:15:32.211056    4635 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:32.211483    4635 main.go:141] libmachine: Using API Version  1
	I1030 16:15:32.211494    4635 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:32.211707    4635 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:32.211797    4635 main.go:141] libmachine: (kubenet-996000) Calling .GetMachineName
	I1030 16:15:32.211873    4635 main.go:141] libmachine: (kubenet-996000) Calling .DriverName
	I1030 16:15:32.211954    4635 start.go:159] libmachine.API.Create for "kubenet-996000" (driver="hyperkit")
	I1030 16:15:32.211977    4635 client.go:168] LocalClient.Create starting
	I1030 16:15:32.212002    4635 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:32.212046    4635 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:32.212062    4635 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:32.212112    4635 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:32.212147    4635 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:32.212161    4635 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:32.212180    4635 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:32.212190    4635 main.go:141] libmachine: (kubenet-996000) Calling .PreCreateCheck
	I1030 16:15:32.212265    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:32.212467    4635 main.go:141] libmachine: (kubenet-996000) Calling .GetConfigRaw
	I1030 16:15:32.223946    4635 main.go:141] libmachine: Creating machine...
	I1030 16:15:32.223971    4635 main.go:141] libmachine: (kubenet-996000) Calling .Create
	I1030 16:15:32.224246    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:32.224550    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:32.224217    4652 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:32.224658    4635 main.go:141] libmachine: (kubenet-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:32.587288    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:32.587223    4652 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/id_rsa...
	I1030 16:15:32.702678    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:32.702568    4652 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/kubenet-996000.rawdisk...
	I1030 16:15:32.702700    4635 main.go:141] libmachine: (kubenet-996000) DBG | Writing magic tar header
	I1030 16:15:32.702712    4635 main.go:141] libmachine: (kubenet-996000) DBG | Writing SSH key tar header
	I1030 16:15:32.703021    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:32.702979    4652 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000 ...
	I1030 16:15:33.110053    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:33.110069    4635 main.go:141] libmachine: (kubenet-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/hyperkit.pid
	I1030 16:15:33.110112    4635 main.go:141] libmachine: (kubenet-996000) DBG | Using UUID 390e6652-777a-11ee-b97f-149d997fca88
	I1030 16:15:33.148518    4635 main.go:141] libmachine: (kubenet-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:33.148606    4635 client.go:171] LocalClient.Create took 936.617034ms
	I1030 16:15:35.150176    4635 start.go:128] duration metric: createHost completed in 2.969024436s
	I1030 16:15:35.150204    4635 start.go:83] releasing machines lock for "kubenet-996000", held for 2.969132292s
	W1030 16:15:35.150230    4635 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:35.150830    4635 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:35.150885    4635 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:35.160273    4635 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51064
	I1030 16:15:35.160681    4635 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:35.161029    4635 main.go:141] libmachine: Using API Version  1
	I1030 16:15:35.161040    4635 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:35.161281    4635 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:35.161613    4635 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:35.161635    4635 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:35.169874    4635 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51066
	I1030 16:15:35.170286    4635 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:35.170636    4635 main.go:141] libmachine: Using API Version  1
	I1030 16:15:35.170655    4635 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:35.170883    4635 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:35.170976    4635 main.go:141] libmachine: (kubenet-996000) Calling .GetState
	I1030 16:15:35.171057    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:35.171074    4635 main.go:141] libmachine: (kubenet-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:35.171101    4635 main.go:141] libmachine: (kubenet-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/hyperkit.json: no such file or directory
	I1030 16:15:35.171137    4635 main.go:141] libmachine: (kubenet-996000) Calling .DriverName
	I1030 16:15:35.213752    4635 out.go:177] * Deleting "kubenet-996000" in hyperkit ...
	I1030 16:15:35.234918    4635 main.go:141] libmachine: (kubenet-996000) Calling .Remove
	I1030 16:15:35.235228    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:35.235249    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:35.235278    4635 main.go:141] libmachine: (kubenet-996000) DBG | hyperkit pid from json: 0
	I1030 16:15:35.235308    4635 main.go:141] libmachine: (kubenet-996000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/hyperkit.json: no such file or directory
	W1030 16:15:35.312079    4635 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:35.312100    4635 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:40.314248    4635 start.go:365] acquiring machines lock for kubenet-996000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:40.362357    4635 start.go:369] acquired machines lock for "kubenet-996000" in 48.001022ms
	I1030 16:15:40.362414    4635 start.go:93] Provisioning new machine with config: &{Name:kubenet-996000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.3 ClusterName:kubenet-996000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:40.362581    4635 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:40.396162    4635 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I1030 16:15:40.396296    4635 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:40.396348    4635 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:40.406089    4635 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51106
	I1030 16:15:40.406634    4635 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:40.406998    4635 main.go:141] libmachine: Using API Version  1
	I1030 16:15:40.407012    4635 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:40.407310    4635 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:40.407459    4635 main.go:141] libmachine: (kubenet-996000) Calling .GetMachineName
	I1030 16:15:40.407596    4635 main.go:141] libmachine: (kubenet-996000) Calling .DriverName
	I1030 16:15:40.407694    4635 start.go:159] libmachine.API.Create for "kubenet-996000" (driver="hyperkit")
	I1030 16:15:40.407717    4635 client.go:168] LocalClient.Create starting
	I1030 16:15:40.407741    4635 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:40.407774    4635 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:40.407790    4635 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:40.407831    4635 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:40.407855    4635 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:40.407867    4635 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:40.407879    4635 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:40.407885    4635 main.go:141] libmachine: (kubenet-996000) Calling .PreCreateCheck
	I1030 16:15:40.407965    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:40.407978    4635 main.go:141] libmachine: (kubenet-996000) Calling .GetConfigRaw
	I1030 16:15:40.441786    4635 main.go:141] libmachine: Creating machine...
	I1030 16:15:40.441830    4635 main.go:141] libmachine: (kubenet-996000) Calling .Create
	I1030 16:15:40.442025    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:40.442239    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:40.442002    4778 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:40.442295    4635 main.go:141] libmachine: (kubenet-996000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:40.658625    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:40.658559    4778 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/id_rsa...
	I1030 16:15:40.914101    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:40.913991    4778 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/kubenet-996000.rawdisk...
	I1030 16:15:40.914122    4635 main.go:141] libmachine: (kubenet-996000) DBG | Writing magic tar header
	I1030 16:15:40.914131    4635 main.go:141] libmachine: (kubenet-996000) DBG | Writing SSH key tar header
	I1030 16:15:40.914946    4635 main.go:141] libmachine: (kubenet-996000) DBG | I1030 16:15:40.914825    4778 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000 ...
	I1030 16:15:41.242916    4635 main.go:141] libmachine: (kubenet-996000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:41.242934    4635 main.go:141] libmachine: (kubenet-996000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/kubenet-996000/hyperkit.pid
	I1030 16:15:41.242972    4635 main.go:141] libmachine: (kubenet-996000) DBG | Using UUID 3df0aa5e-777a-11ee-b97f-149d997fca88
	I1030 16:15:41.279355    4635 main.go:141] libmachine: (kubenet-996000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:41.279433    4635 client.go:171] LocalClient.Create took 871.708987ms
	I1030 16:15:43.281604    4635 start.go:128] duration metric: createHost completed in 2.918992298s
	I1030 16:15:43.281658    4635 start.go:83] releasing machines lock for "kubenet-996000", held for 2.919278306s
	W1030 16:15:43.281803    4635 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubenet-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubenet-996000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:43.306865    4635 out.go:177] 
	W1030 16:15:43.331453    4635 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:43.331538    4635 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:43.331560    4635 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:43.331579    4635 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:43.331602    4635 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:43.375477    4635 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kubenet/Start (11.88s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (11.7s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0: exit status 60 (11.620866537s)

                                                
                                                
-- stdout --
	* [old-k8s-version-295000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node old-k8s-version-295000 in cluster old-k8s-version-295000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "old-k8s-version-295000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:37.258101    4766 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:37.258285    4766 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:37.258291    4766 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:37.258295    4766 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:37.258470    4766 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:37.259947    4766 out.go:303] Setting JSON to false
	I1030 16:15:37.282404    4766 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":912,"bootTime":1698706825,"procs":494,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:37.282498    4766 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:37.304976    4766 out.go:177] * [old-k8s-version-295000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:37.347718    4766 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:37.347796    4766 notify.go:220] Checking for updates...
	I1030 16:15:37.390570    4766 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:37.432345    4766 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:37.453530    4766 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:37.474512    4766 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:37.495625    4766 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:37.518267    4766 config.go:182] Loaded profile config "kubenet-996000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:37.518468    4766 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:37.518617    4766 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:37.548539    4766 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:37.591282    4766 start.go:298] selected driver: hyperkit
	I1030 16:15:37.591313    4766 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:37.591335    4766 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:37.595734    4766 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:37.595825    4766 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:37.603423    4766 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:37.607210    4766 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:37.607231    4766 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:37.607262    4766 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:15:37.607491    4766 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:37.607523    4766 cni.go:84] Creating CNI manager for ""
	I1030 16:15:37.607537    4766 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 16:15:37.607542    4766 start_flags.go:323] config:
	{Name:old-k8s-version-295000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-295000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contai
nerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:37.607689    4766 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:37.650474    4766 out.go:177] * Starting control plane node old-k8s-version-295000 in cluster old-k8s-version-295000
	I1030 16:15:37.671379    4766 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:15:37.671448    4766 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
	I1030 16:15:37.671474    4766 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:37.671698    4766 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:37.671716    4766 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1030 16:15:37.671866    4766 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/old-k8s-version-295000/config.json ...
	I1030 16:15:37.671901    4766 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/old-k8s-version-295000/config.json: {Name:mk74c0ed98ec442cae7fcd091c0a7bf1b6c5fdb0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:37.672493    4766 start.go:365] acquiring machines lock for old-k8s-version-295000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:37.672606    4766 start.go:369] acquired machines lock for "old-k8s-version-295000" in 80.842µs
	I1030 16:15:37.672651    4766 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-295000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz
e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:37.672738    4766 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:37.694529    4766 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:15:37.695036    4766 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:37.695102    4766 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:37.704164    4766 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51100
	I1030 16:15:37.704516    4766 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:37.704925    4766 main.go:141] libmachine: Using API Version  1
	I1030 16:15:37.704937    4766 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:37.705140    4766 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:37.705293    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetMachineName
	I1030 16:15:37.705392    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:37.705495    4766 start.go:159] libmachine.API.Create for "old-k8s-version-295000" (driver="hyperkit")
	I1030 16:15:37.705519    4766 client.go:168] LocalClient.Create starting
	I1030 16:15:37.705546    4766 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:37.705596    4766 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:37.705614    4766 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:37.705669    4766 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:37.705705    4766 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:37.705717    4766 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:37.705732    4766 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:37.705741    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .PreCreateCheck
	I1030 16:15:37.705827    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:37.706026    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetConfigRaw
	I1030 16:15:37.716010    4766 main.go:141] libmachine: Creating machine...
	I1030 16:15:37.716048    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .Create
	I1030 16:15:37.716292    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:37.716599    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:37.716265    4774 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:37.716704    4766 main.go:141] libmachine: (old-k8s-version-295000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:37.881892    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:37.881822    4774 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/id_rsa...
	I1030 16:15:37.990975    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:37.990879    4774 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/old-k8s-version-295000.rawdisk...
	I1030 16:15:37.990989    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Writing magic tar header
	I1030 16:15:37.991002    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Writing SSH key tar header
	I1030 16:15:37.991631    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:37.991592    4774 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000 ...
	I1030 16:15:38.325931    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:38.325962    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.pid
	I1030 16:15:38.325995    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Using UUID 3c546e74-777a-11ee-9ec9-149d997fca88
	I1030 16:15:38.361283    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:38.361319    4766 client.go:171] LocalClient.Create took 655.787796ms
	I1030 16:15:40.362226    4766 start.go:128] duration metric: createHost completed in 2.689466784s
	I1030 16:15:40.362255    4766 start.go:83] releasing machines lock for "old-k8s-version-295000", held for 2.689636352s
	W1030 16:15:40.362282    4766 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:40.362879    4766 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:40.362922    4766 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:40.372453    4766 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51102
	I1030 16:15:40.372966    4766 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:40.373339    4766 main.go:141] libmachine: Using API Version  1
	I1030 16:15:40.373353    4766 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:40.373587    4766 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:40.373927    4766 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:40.373949    4766 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:40.382039    4766 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51104
	I1030 16:15:40.382443    4766 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:40.382821    4766 main.go:141] libmachine: Using API Version  1
	I1030 16:15:40.382838    4766 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:40.383026    4766 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:40.383133    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetState
	I1030 16:15:40.383211    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:40.383237    4766 main.go:141] libmachine: (old-k8s-version-295000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.json: no such file or directory
	I1030 16:15:40.383244    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | hyperkit pid from json: 0
	I1030 16:15:40.383278    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:40.439324    4766 out.go:177] * Deleting "old-k8s-version-295000" in hyperkit ...
	I1030 16:15:40.463205    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .Remove
	I1030 16:15:40.463521    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:40.463598    4766 main.go:141] libmachine: (old-k8s-version-295000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.json: no such file or directory
	I1030 16:15:40.463617    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:40.463643    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | hyperkit pid from json: 0
	W1030 16:15:40.480274    4766 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:40.480308    4766 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:45.482139    4766 start.go:365] acquiring machines lock for old-k8s-version-295000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:45.482229    4766 start.go:369] acquired machines lock for "old-k8s-version-295000" in 65.231µs
	I1030 16:15:45.482256    4766 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-295000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz
e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:45.482328    4766 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:45.524652    4766 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:15:45.524744    4766 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:45.524776    4766 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:45.532958    4766 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51128
	I1030 16:15:45.533332    4766 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:45.533713    4766 main.go:141] libmachine: Using API Version  1
	I1030 16:15:45.533724    4766 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:45.533953    4766 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:45.534079    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetMachineName
	I1030 16:15:45.534179    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:45.534288    4766 start.go:159] libmachine.API.Create for "old-k8s-version-295000" (driver="hyperkit")
	I1030 16:15:45.534307    4766 client.go:168] LocalClient.Create starting
	I1030 16:15:45.534335    4766 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:45.534388    4766 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:45.534398    4766 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:45.534438    4766 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:45.534475    4766 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:45.534487    4766 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:45.534501    4766 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:45.534507    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .PreCreateCheck
	I1030 16:15:45.534605    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:45.534648    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetConfigRaw
	I1030 16:15:45.535105    4766 main.go:141] libmachine: Creating machine...
	I1030 16:15:45.535114    4766 main.go:141] libmachine: (old-k8s-version-295000) Calling .Create
	I1030 16:15:45.535186    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:45.535334    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:45.535180    4834 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:45.535392    4766 main.go:141] libmachine: (old-k8s-version-295000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:45.803204    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:45.803111    4834 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/id_rsa...
	I1030 16:15:46.159817    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:46.159643    4834 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/old-k8s-version-295000.rawdisk...
	I1030 16:15:46.159866    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Writing magic tar header
	I1030 16:15:46.159967    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Writing SSH key tar header
	I1030 16:15:46.181918    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | I1030 16:15:46.181814    4834 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000 ...
	I1030 16:15:46.573604    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:46.573620    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.pid
	I1030 16:15:46.573662    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | Using UUID 40ff356c-777a-11ee-9ec9-149d997fca88
	I1030 16:15:46.612379    4766 main.go:141] libmachine: (old-k8s-version-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:46.612459    4766 client.go:171] LocalClient.Create took 1.078144972s
	I1030 16:15:48.705112    4766 start.go:128] duration metric: createHost completed in 3.130277716s
	I1030 16:15:48.705130    4766 start.go:83] releasing machines lock for "old-k8s-version-295000", held for 3.130394151s
	W1030 16:15:48.705198    4766 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:48.747031    4766 out.go:177] 
	W1030 16:15:48.768186    4766 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:48.768277    4766 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:48.768323    4766 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:48.768362    4766 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:48.768391    4766 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:48.833480    4766 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (76.031854ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (11.70s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-295000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-295000 create -f testdata/busybox.yaml: exit status 1 (35.964254ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-295000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (94.794039ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (68.523837ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p old-k8s-version-295000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-295000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-295000 describe deploy/metrics-server -n kube-system: exit status 1 (35.34741ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-295000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-295000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (98.668786ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.39s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (12.49s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (12.418444229s)

                                                
                                                
-- stdout --
	* [no-preload-257000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node no-preload-257000 in cluster no-preload-257000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "no-preload-257000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:49.748104    4941 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:49.748756    4941 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:49.748770    4941 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:49.748778    4941 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:49.749123    4941 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:49.791255    4941 out.go:303] Setting JSON to false
	I1030 16:15:49.815325    4941 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":924,"bootTime":1698706825,"procs":478,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:49.815435    4941 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:49.836681    4941 out.go:177] * [no-preload-257000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:49.899581    4941 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:49.878757    4941 notify.go:220] Checking for updates...
	I1030 16:15:49.943431    4941 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:49.985371    4941 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:50.027536    4941 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:50.069483    4941 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:50.111477    4941 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:50.133533    4941 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:15:50.133730    4941 config.go:182] Loaded profile config "old-k8s-version-295000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1030 16:15:50.133876    4941 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:50.199379    4941 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:15:50.220629    4941 start.go:298] selected driver: hyperkit
	I1030 16:15:50.220659    4941 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:15:50.220680    4941 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:50.225256    4941 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.225363    4941 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:50.233120    4941 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:50.237181    4941 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:50.237203    4941 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:50.237235    4941 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:15:50.237442    4941 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:50.237507    4941 cni.go:84] Creating CNI manager for ""
	I1030 16:15:50.237519    4941 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:15:50.237528    4941 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:15:50.237542    4941 start_flags.go:323] config:
	{Name:no-preload-257000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:no-preload-257000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:50.237694    4941 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.258252    4941 out.go:177] * Starting control plane node no-preload-257000 in cluster no-preload-257000
	I1030 16:15:50.300729    4941 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:15:50.300991    4941 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/no-preload-257000/config.json ...
	I1030 16:15:50.301054    4941 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/no-preload-257000/config.json: {Name:mkf4c6605831b1cb05bbfae3c5b87b03bcd1356e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:15:50.301076    4941 cache.go:107] acquiring lock: {Name:mke062db5e61ff1e367259314e8f23567df815d2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301095    4941 cache.go:107] acquiring lock: {Name:mk6c499210060b4302dc796a7ea52c3b59113c91 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301184    4941 cache.go:107] acquiring lock: {Name:mk47b8b3a20e3774e2c9400b862d9bb22a387739 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301304    4941 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1030 16:15:50.301350    4941 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 280.536µs
	I1030 16:15:50.301375    4941 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1030 16:15:50.301373    4941 cache.go:107] acquiring lock: {Name:mk959a5f24d8c777f2c12a8e615a986496a02ba4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301378    4941 cache.go:107] acquiring lock: {Name:mk013a7157a2a3e1afe17fb6e2908faaf68f4d43 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301475    4941 cache.go:107] acquiring lock: {Name:mk9307c8013cde9f38cd799d35a032c3d9d57a2b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301503    4941 cache.go:107] acquiring lock: {Name:mk20580b68f86666cf19549b71d0ef50cd3e64fe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301568    4941 cache.go:107] acquiring lock: {Name:mk76465ea12a80a45633618c663a9470dc4e991d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:50.301693    4941 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.28.3
	I1030 16:15:50.301758    4941 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.28.3
	I1030 16:15:50.302049    4941 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.9-0
	I1030 16:15:50.302110    4941 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I1030 16:15:50.302172    4941 start.go:365] acquiring machines lock for no-preload-257000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:50.302208    4941 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.28.3
	I1030 16:15:50.302312    4941 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.28.3
	I1030 16:15:50.302319    4941 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.10.1
	I1030 16:15:50.302344    4941 start.go:369] acquired machines lock for "no-preload-257000" in 139.872µs
	I1030 16:15:50.302413    4941 start.go:93] Provisioning new machine with config: &{Name:no-preload-257000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:no-preload-257000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:50.302613    4941 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:50.345641    4941 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:15:50.346136    4941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:50.346258    4941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:50.355833    4941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51209
	I1030 16:15:50.356193    4941 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:50.356604    4941 main.go:141] libmachine: Using API Version  1
	I1030 16:15:50.356615    4941 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:50.356869    4941 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:50.356980    4941 main.go:141] libmachine: (no-preload-257000) Calling .GetMachineName
	I1030 16:15:50.357068    4941 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:15:50.357165    4941 start.go:159] libmachine.API.Create for "no-preload-257000" (driver="hyperkit")
	I1030 16:15:50.357201    4941 client.go:168] LocalClient.Create starting
	I1030 16:15:50.357230    4941 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:50.357277    4941 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:50.357299    4941 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:50.357355    4941 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:50.357391    4941 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:50.357405    4941 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:50.357421    4941 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:50.357429    4941 main.go:141] libmachine: (no-preload-257000) Calling .PreCreateCheck
	I1030 16:15:50.357509    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:50.357676    4941 main.go:141] libmachine: (no-preload-257000) Calling .GetConfigRaw
	I1030 16:15:50.367809    4941 main.go:141] libmachine: Creating machine...
	I1030 16:15:50.367847    4941 main.go:141] libmachine: (no-preload-257000) Calling .Create
	I1030 16:15:50.368175    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:50.368542    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:50.368121    4955 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:50.368703    4941 main.go:141] libmachine: (no-preload-257000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:50.389907    4941 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.10.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.10.1
	I1030 16:15:50.389988    4941 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.28.3: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.28.3
	I1030 16:15:50.390114    4941 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I1030 16:15:50.390135    4941 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.28.3: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.28.3
	I1030 16:15:50.390264    4941 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.28.3: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.28.3
	I1030 16:15:50.390298    4941 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.9-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.9-0
	I1030 16:15:50.390394    4941 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.28.3: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.28.3
	I1030 16:15:50.842284    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1
	I1030 16:15:50.843872    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9
	I1030 16:15:50.844311    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3
	I1030 16:15:50.883143    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3
	I1030 16:15:50.934428    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3
	I1030 16:15:50.997223    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I1030 16:15:50.997251    4941 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 695.977389ms
	I1030 16:15:50.997266    4941 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I1030 16:15:51.006497    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.9-0
	I1030 16:15:51.056963    4941 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3
	I1030 16:15:51.178708    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:51.178647    4955 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/id_rsa...
	I1030 16:15:51.220150    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:51.220078    4955 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/no-preload-257000.rawdisk...
	I1030 16:15:51.220163    4941 main.go:141] libmachine: (no-preload-257000) DBG | Writing magic tar header
	I1030 16:15:51.220171    4941 main.go:141] libmachine: (no-preload-257000) DBG | Writing SSH key tar header
	I1030 16:15:51.220621    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:51.220580    4955 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000 ...
	I1030 16:15:51.546758    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:51.546780    4941 main.go:141] libmachine: (no-preload-257000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.pid
	I1030 16:15:51.546858    4941 main.go:141] libmachine: (no-preload-257000) DBG | Using UUID 43ded5c6-777a-11ee-a20d-149d997fca88
	I1030 16:15:51.580843    4941 main.go:141] libmachine: (no-preload-257000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:51.580955    4941 client.go:171] LocalClient.Create took 1.223720164s
	I1030 16:15:53.581096    4941 start.go:128] duration metric: createHost completed in 3.278386029s
	I1030 16:15:53.581112    4941 start.go:83] releasing machines lock for "no-preload-257000", held for 3.278693123s
	W1030 16:15:53.581130    4941 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:15:53.581406    4941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:53.581423    4941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:53.589659    4941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51230
	I1030 16:15:53.590002    4941 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:53.590331    4941 main.go:141] libmachine: Using API Version  1
	I1030 16:15:53.590341    4941 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:53.590558    4941 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:53.590931    4941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:53.590946    4941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:53.605117    4941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51233
	I1030 16:15:53.605459    4941 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:53.605780    4941 main.go:141] libmachine: Using API Version  1
	I1030 16:15:53.605791    4941 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:53.606048    4941 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:53.606167    4941 main.go:141] libmachine: (no-preload-257000) Calling .GetState
	I1030 16:15:53.606249    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:53.606268    4941 main.go:141] libmachine: (no-preload-257000) DBG | hyperkit pid from json: 0
	I1030 16:15:53.606286    4941 main.go:141] libmachine: (no-preload-257000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.json: no such file or directory
	I1030 16:15:53.606355    4941 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:15:53.680479    4941 out.go:177] * Deleting "no-preload-257000" in hyperkit ...
	I1030 16:15:53.722571    4941 main.go:141] libmachine: (no-preload-257000) Calling .Remove
	I1030 16:15:53.722728    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:53.722750    4941 main.go:141] libmachine: (no-preload-257000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.json: no such file or directory
	I1030 16:15:53.722763    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:53.722777    4941 main.go:141] libmachine: (no-preload-257000) DBG | hyperkit pid from json: 0
	W1030 16:15:53.756847    4941 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:53.756866    4941 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:53.816244    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3 exists
	I1030 16:15:53.816262    4941 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3" took 3.514801905s
	I1030 16:15:53.816274    4941 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3 succeeded
	I1030 16:15:55.202394    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1 exists
	I1030 16:15:55.202412    4941 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.10.1" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1" took 4.90091007s
	I1030 16:15:55.202421    4941 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.10.1 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1 succeeded
	I1030 16:15:55.784718    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3 exists
	I1030 16:15:55.784743    4941 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3" took 5.483169125s
	I1030 16:15:55.784755    4941 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3 succeeded
	I1030 16:15:56.005580    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3 exists
	I1030 16:15:56.005597    4941 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3" took 5.704430893s
	I1030 16:15:56.005607    4941 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3 succeeded
	I1030 16:15:57.669238    4941 cache.go:157] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3 exists
	I1030 16:15:57.669256    4941 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3" took 7.36797761s
	I1030 16:15:57.669265    4941 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3 succeeded
	I1030 16:15:58.758181    4941 start.go:365] acquiring machines lock for no-preload-257000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:58.824523    4941 start.go:369] acquired machines lock for "no-preload-257000" in 66.308627ms
	I1030 16:15:58.824549    4941 start.go:93] Provisioning new machine with config: &{Name:no-preload-257000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:no-preload-257000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:15:58.824628    4941 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:15:58.904460    4941 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:15:58.904545    4941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:58.904573    4941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:58.912921    4941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51237
	I1030 16:15:58.913281    4941 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:58.913605    4941 main.go:141] libmachine: Using API Version  1
	I1030 16:15:58.913615    4941 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:58.913829    4941 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:58.913943    4941 main.go:141] libmachine: (no-preload-257000) Calling .GetMachineName
	I1030 16:15:58.914015    4941 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:15:58.914121    4941 start.go:159] libmachine.API.Create for "no-preload-257000" (driver="hyperkit")
	I1030 16:15:58.914139    4941 client.go:168] LocalClient.Create starting
	I1030 16:15:58.914164    4941 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:15:58.914212    4941 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:58.914228    4941 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:58.914279    4941 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:15:58.914313    4941 main.go:141] libmachine: Decoding PEM data...
	I1030 16:15:58.914325    4941 main.go:141] libmachine: Parsing certificate...
	I1030 16:15:58.914339    4941 main.go:141] libmachine: Running pre-create checks...
	I1030 16:15:58.914344    4941 main.go:141] libmachine: (no-preload-257000) Calling .PreCreateCheck
	I1030 16:15:58.914430    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:58.914474    4941 main.go:141] libmachine: (no-preload-257000) Calling .GetConfigRaw
	I1030 16:15:58.925660    4941 main.go:141] libmachine: Creating machine...
	I1030 16:15:58.925668    4941 main.go:141] libmachine: (no-preload-257000) Calling .Create
	I1030 16:15:58.925770    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:58.925937    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:58.925764    5002 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:58.925996    4941 main.go:141] libmachine: (no-preload-257000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:15:59.201912    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:59.201830    5002 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/id_rsa...
	I1030 16:15:59.385840    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:59.385695    5002 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/no-preload-257000.rawdisk...
	I1030 16:15:59.385875    4941 main.go:141] libmachine: (no-preload-257000) DBG | Writing magic tar header
	I1030 16:15:59.385896    4941 main.go:141] libmachine: (no-preload-257000) DBG | Writing SSH key tar header
	I1030 16:15:59.418257    4941 main.go:141] libmachine: (no-preload-257000) DBG | I1030 16:15:59.407920    5002 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000 ...
	I1030 16:15:59.845221    4941 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:59.845270    4941 main.go:141] libmachine: (no-preload-257000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.pid
	I1030 16:15:59.845379    4941 main.go:141] libmachine: (no-preload-257000) DBG | Using UUID 48f8ce36-777a-11ee-a20d-149d997fca88
	I1030 16:15:59.884459    4941 main.go:141] libmachine: (no-preload-257000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:59.884545    4941 client.go:171] LocalClient.Create took 970.381941ms
	I1030 16:16:01.884804    4941 start.go:128] duration metric: createHost completed in 3.06011306s
	I1030 16:16:01.884848    4941 start.go:83] releasing machines lock for "no-preload-257000", held for 3.060253198s
	W1030 16:16:01.884954    4941 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-257000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-257000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:01.929402    4941 out.go:177] 
	W1030 16:16:01.972476    4941 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:01.972543    4941 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:01.972581    4941 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:01.972616    4941 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:01.972746    4941 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:02.036583    4941 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (67.908976ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (12.49s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (8.56s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0: exit status 60 (8.490051463s)

                                                
                                                
-- stdout --
	* [old-k8s-version-295000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.3
	* Using the hyperkit driver based on existing profile
	* Starting control plane node old-k8s-version-295000 in cluster old-k8s-version-295000
	* Restarting existing hyperkit VM for "old-k8s-version-295000" ...
	* Restarting existing hyperkit VM for "old-k8s-version-295000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:50.596110    4968 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:50.596305    4968 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:50.596310    4968 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:50.596315    4968 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:50.596507    4968 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:50.598004    4968 out.go:303] Setting JSON to false
	I1030 16:15:50.622091    4968 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":925,"bootTime":1698706825,"procs":479,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:15:50.622196    4968 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:15:50.657353    4968 out.go:177] * [old-k8s-version-295000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:15:50.720466    4968 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:15:50.698530    4968 notify.go:220] Checking for updates...
	I1030 16:15:50.762309    4968 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:15:50.804365    4968 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:15:50.846564    4968 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:15:50.889560    4968 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:15:50.935245    4968 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:15:50.957267    4968 config.go:182] Loaded profile config "old-k8s-version-295000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1030 16:15:50.957738    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:50.957798    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:50.966651    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51223
	I1030 16:15:50.966994    4968 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:50.967414    4968 main.go:141] libmachine: Using API Version  1
	I1030 16:15:50.967425    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:50.967630    4968 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:50.967738    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:50.996149    4968 out.go:177] * Kubernetes 1.28.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.3
	I1030 16:15:51.017525    4968 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:15:51.017942    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:51.018002    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:51.026696    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51227
	I1030 16:15:51.027059    4968 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:51.027439    4968 main.go:141] libmachine: Using API Version  1
	I1030 16:15:51.027454    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:51.027684    4968 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:51.027791    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:51.061889    4968 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:15:51.083475    4968 start.go:298] selected driver: hyperkit
	I1030 16:15:51.083517    4968 start.go:902] validating driver "hyperkit" against &{Name:old-k8s-version-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-295000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:
false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:51.083747    4968 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:15:51.088350    4968 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:51.088451    4968 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:15:51.096487    4968 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:15:51.100467    4968 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:51.100493    4968 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:15:51.100642    4968 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:15:51.100705    4968 cni.go:84] Creating CNI manager for ""
	I1030 16:15:51.100724    4968 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 16:15:51.100740    4968 start_flags.go:323] config:
	{Name:old-k8s-version-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-295000 Namespa
ce:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minik
ube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:15:51.100870    4968 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:15:51.149385    4968 out.go:177] * Starting control plane node old-k8s-version-295000 in cluster old-k8s-version-295000
	I1030 16:15:51.171519    4968 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:15:51.171601    4968 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
	I1030 16:15:51.171659    4968 cache.go:56] Caching tarball of preloaded images
	I1030 16:15:51.171936    4968 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:15:51.171960    4968 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1030 16:15:51.172152    4968 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/old-k8s-version-295000/config.json ...
	I1030 16:15:51.173094    4968 start.go:365] acquiring machines lock for old-k8s-version-295000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:53.581160    4968 start.go:369] acquired machines lock for "old-k8s-version-295000" in 2.407997932s
	I1030 16:15:53.581200    4968 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:15:53.581211    4968 fix.go:54] fixHost starting: 
	I1030 16:15:53.581424    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:53.581446    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:53.589754    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51229
	I1030 16:15:53.590043    4968 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:53.590361    4968 main.go:141] libmachine: Using API Version  1
	I1030 16:15:53.590374    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:53.590598    4968 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:53.590719    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:53.590807    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetState
	I1030 16:15:53.590892    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:53.590917    4968 main.go:141] libmachine: (old-k8s-version-295000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.json: no such file or directory
	I1030 16:15:53.590929    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | hyperkit pid from json: 0
	I1030 16:15:53.590936    4968 fix.go:102] recreateIfNeeded on old-k8s-version-295000: state=Stopped err=<nil>
	I1030 16:15:53.590956    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	W1030 16:15:53.591050    4968 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:15:53.636626    4968 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-295000" ...
	I1030 16:15:53.701544    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .Start
	I1030 16:15:53.701749    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:53.701779    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.pid
	I1030 16:15:53.701870    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | Using UUID 40ff356c-777a-11ee-9ec9-149d997fca88
	I1030 16:15:53.703671    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:53.703806    4968 fix.go:56] fixHost completed within 122.593585ms
	I1030 16:15:53.703822    4968 start.go:83] releasing machines lock for "old-k8s-version-295000", held for 122.645793ms
	W1030 16:15:53.703835    4968 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:15:53.703876    4968 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:53.703882    4968 start.go:706] Will try again in 5 seconds ...
	I1030 16:15:58.706051    4968 start.go:365] acquiring machines lock for old-k8s-version-295000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:15:58.706243    4968 start.go:369] acquired machines lock for "old-k8s-version-295000" in 125.609µs
	I1030 16:15:58.706275    4968 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:15:58.706283    4968 fix.go:54] fixHost starting: 
	I1030 16:15:58.706719    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:58.706761    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:58.716659    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51235
	I1030 16:15:58.717001    4968 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:58.717322    4968 main.go:141] libmachine: Using API Version  1
	I1030 16:15:58.717334    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:58.717534    4968 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:58.717642    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:58.717728    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetState
	I1030 16:15:58.717806    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:58.717817    4968 main.go:141] libmachine: (old-k8s-version-295000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.json: no such file or directory
	I1030 16:15:58.717854    4968 fix.go:102] recreateIfNeeded on old-k8s-version-295000: state=Stopped err=<nil>
	I1030 16:15:58.717863    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .DriverName
	I1030 16:15:58.717879    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | hyperkit pid from json: 0
	W1030 16:15:58.717946    4968 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:15:58.763255    4968 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-295000" ...
	I1030 16:15:58.784441    4968 main.go:141] libmachine: (old-k8s-version-295000) Calling .Start
	I1030 16:15:58.784780    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:58.784821    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.pid
	I1030 16:15:58.784846    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | Using UUID 40ff356c-777a-11ee-9ec9-149d997fca88
	I1030 16:15:58.824400    4968 main.go:141] libmachine: (old-k8s-version-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:15:58.824477    4968 fix.go:56] fixHost completed within 118.189563ms
	I1030 16:15:58.824488    4968 start.go:83] releasing machines lock for "old-k8s-version-295000", held for 118.230899ms
	W1030 16:15:58.824576    4968 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-295000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-295000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:15:58.883231    4968 out.go:177] 
	W1030 16:15:58.925375    4968 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:15:58.925418    4968 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:15:58.925428    4968 out.go:239] * Related issues:
	* Related issues:
	W1030 16:15:58.925479    4968 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:15:58.925502    4968 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:15:58.967364    4968 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-295000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (67.817781ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (8.56s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-295000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (67.347057ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-295000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-295000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-295000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (35.445348ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-295000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-295000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (66.169263ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p old-k8s-version-295000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p old-k8s-version-295000 "sudo crictl images -o json": exit status 89 (163.326594ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p old-k8s-version-295000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p old-k8s-version-295000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p old-k8s-version-295000"
start_stop_delete_test.go:304: v1.16.0 images missing (-want +got):
[]string{
- 	"k8s.gcr.io/coredns:1.6.2",
- 	"k8s.gcr.io/etcd:3.3.15-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.16.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.16.0",
- 	"k8s.gcr.io/kube-proxy:v1.16.0",
- 	"k8s.gcr.io/kube-scheduler:v1.16.0",
- 	"k8s.gcr.io/pause:3.1",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (68.813357ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-295000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-295000 --alsologtostderr -v=1: exit status 89 (154.868329ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p old-k8s-version-295000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:15:59.556691    5019 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:15:59.556907    5019 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:59.556912    5019 out.go:309] Setting ErrFile to fd 2...
	I1030 16:15:59.556917    5019 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:15:59.557114    5019 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:15:59.557433    5019 out.go:303] Setting JSON to false
	I1030 16:15:59.557451    5019 mustload.go:65] Loading cluster: old-k8s-version-295000
	I1030 16:15:59.557746    5019 config.go:182] Loaded profile config "old-k8s-version-295000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	I1030 16:15:59.558124    5019 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:15:59.558174    5019 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:15:59.565929    5019 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51253
	I1030 16:15:59.566318    5019 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:15:59.566727    5019 main.go:141] libmachine: Using API Version  1
	I1030 16:15:59.566739    5019 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:15:59.566970    5019 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:15:59.567072    5019 main.go:141] libmachine: (old-k8s-version-295000) Calling .GetState
	I1030 16:15:59.567164    5019 main.go:141] libmachine: (old-k8s-version-295000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:15:59.567186    5019 main.go:141] libmachine: (old-k8s-version-295000) DBG | hyperkit pid from json: 0
	I1030 16:15:59.567208    5019 main.go:141] libmachine: (old-k8s-version-295000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/old-k8s-version-295000/hyperkit.json: no such file or directory
	I1030 16:15:59.591135    5019 out.go:177] * The control plane node must be running for this command
	I1030 16:15:59.633528    5019 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-295000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-295000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (69.626252ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (134.139945ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.36s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (12.59s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (12.523048694s)

                                                
                                                
-- stdout --
	* [embed-certs-750000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node embed-certs-750000 in cluster embed-certs-750000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "embed-certs-750000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:00.584804    5048 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:00.584995    5048 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:00.585000    5048 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:00.585004    5048 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:00.585178    5048 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:00.586626    5048 out.go:303] Setting JSON to false
	I1030 16:16:00.608805    5048 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":935,"bootTime":1698706825,"procs":447,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:00.608922    5048 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:00.631152    5048 out.go:177] * [embed-certs-750000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:00.694765    5048 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:00.673978    5048 notify.go:220] Checking for updates...
	I1030 16:16:00.736604    5048 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:00.778653    5048 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:00.820560    5048 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:00.862693    5048 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:00.904742    5048 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:00.926534    5048 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:00.926706    5048 config.go:182] Loaded profile config "no-preload-257000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:00.926854    5048 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:00.956696    5048 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:16:00.998723    5048 start.go:298] selected driver: hyperkit
	I1030 16:16:00.998751    5048 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:16:00.998771    5048 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:01.003146    5048 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:01.003240    5048 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:01.010797    5048 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:01.014506    5048 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:01.014526    5048 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:01.014561    5048 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:16:01.014767    5048 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:16:01.014827    5048 cni.go:84] Creating CNI manager for ""
	I1030 16:16:01.014841    5048 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:01.014859    5048 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:16:01.014868    5048 start_flags.go:323] config:
	{Name:embed-certs-750000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:embed-certs-750000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:01.015003    5048 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:01.056668    5048 out.go:177] * Starting control plane node embed-certs-750000 in cluster embed-certs-750000
	I1030 16:16:01.077547    5048 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:01.077576    5048 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:01.077587    5048 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:01.077685    5048 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:01.077694    5048 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:01.077771    5048 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/embed-certs-750000/config.json ...
	I1030 16:16:01.077787    5048 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/embed-certs-750000/config.json: {Name:mk859f05bfbffad625944e5321cac400848f381d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:16:01.078057    5048 start.go:365] acquiring machines lock for embed-certs-750000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:01.884983    5048 start.go:369] acquired machines lock for "embed-certs-750000" in 806.876361ms
	I1030 16:16:01.885057    5048 start.go:93] Provisioning new machine with config: &{Name:embed-certs-750000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:embed-certs-750000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:01.885156    5048 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:01.950637    5048 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:01.951128    5048 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:01.951181    5048 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:01.960354    5048 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51266
	I1030 16:16:01.960724    5048 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:01.961139    5048 main.go:141] libmachine: Using API Version  1
	I1030 16:16:01.961152    5048 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:01.961381    5048 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:01.961498    5048 main.go:141] libmachine: (embed-certs-750000) Calling .GetMachineName
	I1030 16:16:01.961569    5048 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:01.961674    5048 start.go:159] libmachine.API.Create for "embed-certs-750000" (driver="hyperkit")
	I1030 16:16:01.961702    5048 client.go:168] LocalClient.Create starting
	I1030 16:16:01.961731    5048 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:01.961782    5048 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:01.961798    5048 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:01.961858    5048 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:01.961895    5048 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:01.961910    5048 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:01.961922    5048 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:01.961931    5048 main.go:141] libmachine: (embed-certs-750000) Calling .PreCreateCheck
	I1030 16:16:01.962011    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:01.962200    5048 main.go:141] libmachine: (embed-certs-750000) Calling .GetConfigRaw
	I1030 16:16:01.972802    5048 main.go:141] libmachine: Creating machine...
	I1030 16:16:01.972848    5048 main.go:141] libmachine: (embed-certs-750000) Calling .Create
	I1030 16:16:01.973019    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:01.973439    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:01.973017    5056 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:01.973543    5048 main.go:141] libmachine: (embed-certs-750000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:02.270558    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:02.270502    5056 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/id_rsa...
	I1030 16:16:02.330719    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:02.330679    5056 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/embed-certs-750000.rawdisk...
	I1030 16:16:02.330735    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Writing magic tar header
	I1030 16:16:02.330745    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Writing SSH key tar header
	I1030 16:16:02.331314    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:02.331285    5056 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000 ...
	I1030 16:16:02.663096    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:02.663116    5048 main.go:141] libmachine: (embed-certs-750000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.pid
	I1030 16:16:02.663149    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Using UUID 4ac99eca-777a-11ee-854d-149d997fca88
	I1030 16:16:02.701643    5048 main.go:141] libmachine: (embed-certs-750000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:02.701728    5048 client.go:171] LocalClient.Create took 740.004203ms
	I1030 16:16:04.704006    5048 start.go:128] duration metric: createHost completed in 2.818783833s
	I1030 16:16:04.704035    5048 start.go:83] releasing machines lock for "embed-certs-750000", held for 2.81898735s
	W1030 16:16:04.704061    5048 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:16:04.704619    5048 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:04.704676    5048 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:04.714018    5048 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51306
	I1030 16:16:04.714372    5048 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:04.714731    5048 main.go:141] libmachine: Using API Version  1
	I1030 16:16:04.714744    5048 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:04.714977    5048 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:04.715324    5048 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:04.715352    5048 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:04.723019    5048 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51309
	I1030 16:16:04.723352    5048 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:04.723688    5048 main.go:141] libmachine: Using API Version  1
	I1030 16:16:04.723699    5048 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:04.723898    5048 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:04.724000    5048 main.go:141] libmachine: (embed-certs-750000) Calling .GetState
	I1030 16:16:04.724078    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:04.724094    5048 main.go:141] libmachine: (embed-certs-750000) DBG | hyperkit pid from json: 0
	I1030 16:16:04.724104    5048 main.go:141] libmachine: (embed-certs-750000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.json: no such file or directory
	I1030 16:16:04.724139    5048 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:04.779983    5048 out.go:177] * Deleting "embed-certs-750000" in hyperkit ...
	I1030 16:16:04.821974    5048 main.go:141] libmachine: (embed-certs-750000) Calling .Remove
	I1030 16:16:04.822270    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:04.822300    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:04.822323    5048 main.go:141] libmachine: (embed-certs-750000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.json: no such file or directory
	I1030 16:16:04.822404    5048 main.go:141] libmachine: (embed-certs-750000) DBG | hyperkit pid from json: 0
	W1030 16:16:04.857611    5048 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:04.857625    5048 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:09.858000    5048 start.go:365] acquiring machines lock for embed-certs-750000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:09.901735    5048 start.go:369] acquired machines lock for "embed-certs-750000" in 43.670049ms
	I1030 16:16:09.901756    5048 start.go:93] Provisioning new machine with config: &{Name:embed-certs-750000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:embed-certs-750000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262
144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:09.901826    5048 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:09.987211    5048 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:09.987337    5048 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:09.987381    5048 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:09.996718    5048 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51313
	I1030 16:16:09.997084    5048 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:09.997474    5048 main.go:141] libmachine: Using API Version  1
	I1030 16:16:09.997491    5048 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:09.997687    5048 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:09.997793    5048 main.go:141] libmachine: (embed-certs-750000) Calling .GetMachineName
	I1030 16:16:09.997874    5048 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:09.997976    5048 start.go:159] libmachine.API.Create for "embed-certs-750000" (driver="hyperkit")
	I1030 16:16:09.997998    5048 client.go:168] LocalClient.Create starting
	I1030 16:16:09.998023    5048 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:09.998079    5048 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:09.998096    5048 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:09.998142    5048 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:09.998178    5048 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:09.998190    5048 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:09.998207    5048 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:09.998213    5048 main.go:141] libmachine: (embed-certs-750000) Calling .PreCreateCheck
	I1030 16:16:09.998293    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:09.998348    5048 main.go:141] libmachine: (embed-certs-750000) Calling .GetConfigRaw
	I1030 16:16:10.008820    5048 main.go:141] libmachine: Creating machine...
	I1030 16:16:10.008841    5048 main.go:141] libmachine: (embed-certs-750000) Calling .Create
	I1030 16:16:10.009034    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:10.009298    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:10.009011    5107 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:10.009474    5048 main.go:141] libmachine: (embed-certs-750000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:10.289060    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:10.288991    5107 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/id_rsa...
	I1030 16:16:10.419015    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:10.418974    5107 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/embed-certs-750000.rawdisk...
	I1030 16:16:10.419038    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Writing magic tar header
	I1030 16:16:10.419051    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Writing SSH key tar header
	I1030 16:16:10.419330    5048 main.go:141] libmachine: (embed-certs-750000) DBG | I1030 16:16:10.419305    5107 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000 ...
	I1030 16:16:10.800283    5048 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:10.800306    5048 main.go:141] libmachine: (embed-certs-750000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.pid
	I1030 16:16:10.800318    5048 main.go:141] libmachine: (embed-certs-750000) DBG | Using UUID 4f93e6a4-777a-11ee-854d-149d997fca88
	I1030 16:16:10.836833    5048 main.go:141] libmachine: (embed-certs-750000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:10.836916    5048 client.go:171] LocalClient.Create took 838.897388ms
	I1030 16:16:12.839175    5048 start.go:128] duration metric: createHost completed in 2.937289497s
	I1030 16:16:12.839242    5048 start.go:83] releasing machines lock for "embed-certs-750000", held for 2.937449586s
	W1030 16:16:12.839340    5048 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-750000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-750000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:12.882831    5048 out.go:177] 
	W1030 16:16:12.925802    5048 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:12.925848    5048 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:12.925864    5048 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:12.925888    5048 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:12.925956    5048 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:12.991751    5048 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (68.917642ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (12.59s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-257000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-257000 create -f testdata/busybox.yaml: exit status 1 (36.160626ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-257000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (67.563375ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (66.02584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.17s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p no-preload-257000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-257000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-257000 describe deploy/metrics-server -n kube-system: exit status 1 (35.648581ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-257000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-257000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (69.005655ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (6.99s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (6.918405951s)

                                                
                                                
-- stdout --
	* [no-preload-257000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node no-preload-257000 in cluster no-preload-257000
	* Restarting existing hyperkit VM for "no-preload-257000" ...
	* Restarting existing hyperkit VM for "no-preload-257000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:03.256340    5088 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:03.256541    5088 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:03.256546    5088 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:03.256550    5088 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:03.256779    5088 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:03.258454    5088 out.go:303] Setting JSON to false
	I1030 16:16:03.281255    5088 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":938,"bootTime":1698706825,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:03.281353    5088 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:03.302892    5088 out.go:177] * [no-preload-257000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:03.344774    5088 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:03.344899    5088 notify.go:220] Checking for updates...
	I1030 16:16:03.366781    5088 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:03.388790    5088 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:03.410768    5088 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:03.431780    5088 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:03.452786    5088 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:03.476356    5088 config.go:182] Loaded profile config "no-preload-257000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:03.477006    5088 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:03.477080    5088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:03.486339    5088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51298
	I1030 16:16:03.486702    5088 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:03.487130    5088 main.go:141] libmachine: Using API Version  1
	I1030 16:16:03.487143    5088 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:03.487417    5088 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:03.487525    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:16:03.487714    5088 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:03.487948    5088 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:03.487972    5088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:03.495628    5088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51300
	I1030 16:16:03.495954    5088 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:03.496287    5088 main.go:141] libmachine: Using API Version  1
	I1030 16:16:03.496308    5088 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:03.496525    5088 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:03.496633    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:16:03.525567    5088 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:16:03.567558    5088 start.go:298] selected driver: hyperkit
	I1030 16:16:03.567585    5088 start.go:902] validating driver "hyperkit" against &{Name:no-preload-257000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:no-preload-257000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false
ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:03.567781    5088 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:03.572069    5088 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.572152    5088 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:03.579813    5088 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:03.583605    5088 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:03.583625    5088 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:03.583764    5088 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:16:03.583819    5088 cni.go:84] Creating CNI manager for ""
	I1030 16:16:03.583831    5088 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:03.583841    5088 start_flags.go:323] config:
	{Name:no-preload-257000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:no-preload-257000 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho
st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:03.583974    5088 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.626843    5088 out.go:177] * Starting control plane node no-preload-257000 in cluster no-preload-257000
	I1030 16:16:03.648679    5088 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:03.648870    5088 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/no-preload-257000/config.json ...
	I1030 16:16:03.649022    5088 cache.go:107] acquiring lock: {Name:mke062db5e61ff1e367259314e8f23567df815d2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649053    5088 cache.go:107] acquiring lock: {Name:mk6c499210060b4302dc796a7ea52c3b59113c91 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649083    5088 cache.go:107] acquiring lock: {Name:mk9307c8013cde9f38cd799d35a032c3d9d57a2b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649233    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1030 16:16:03.649253    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3 exists
	I1030 16:16:03.649039    5088 cache.go:107] acquiring lock: {Name:mk76465ea12a80a45633618c663a9470dc4e991d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649251    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3 exists
	I1030 16:16:03.649269    5088 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 258.098µs
	I1030 16:16:03.649296    5088 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1030 16:16:03.649293    5088 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3" took 214.141µs
	I1030 16:16:03.649317    5088 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.28.3 succeeded
	I1030 16:16:03.649276    5088 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3" took 247.935µs
	I1030 16:16:03.649249    5088 cache.go:107] acquiring lock: {Name:mk47b8b3a20e3774e2c9400b862d9bb22a387739 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649346    5088 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.28.3 succeeded
	I1030 16:16:03.649310    5088 cache.go:107] acquiring lock: {Name:mk959a5f24d8c777f2c12a8e615a986496a02ba4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649393    5088 cache.go:107] acquiring lock: {Name:mk20580b68f86666cf19549b71d0ef50cd3e64fe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649415    5088 cache.go:107] acquiring lock: {Name:mk013a7157a2a3e1afe17fb6e2908faaf68f4d43 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:03.649621    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1 exists
	I1030 16:16:03.649624    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3 exists
	I1030 16:16:03.649622    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3 exists
	I1030 16:16:03.649639    5088 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.10.1" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1" took 319.007µs
	I1030 16:16:03.649659    5088 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.10.1 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1 succeeded
	I1030 16:16:03.649657    5088 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3" took 643.709µs
	I1030 16:16:03.649661    5088 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.28.3" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3" took 465.416µs
	I1030 16:16:03.649673    5088 cache.go:115] /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I1030 16:16:03.649672    5088 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.28.3 succeeded
	I1030 16:16:03.649679    5088 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.28.3 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.28.3 succeeded
	I1030 16:16:03.649690    5088 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 390.071µs
	I1030 16:16:03.649719    5088 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I1030 16:16:03.649694    5088 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.9-0
	I1030 16:16:03.649908    5088 start.go:365] acquiring machines lock for no-preload-257000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:03.654468    5088 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.9-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.9-0
	I1030 16:16:04.111535    5088 cache.go:162] opening:  /Users/jenkins/minikube-integration/17527-929/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.9-0
	I1030 16:16:04.704168    5088 start.go:369] acquired machines lock for "no-preload-257000" in 1.054192763s
	I1030 16:16:04.704238    5088 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:04.704264    5088 fix.go:54] fixHost starting: 
	I1030 16:16:04.704706    5088 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:04.704754    5088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:04.714120    5088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51305
	I1030 16:16:04.714515    5088 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:04.714822    5088 main.go:141] libmachine: Using API Version  1
	I1030 16:16:04.714833    5088 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:04.715043    5088 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:04.715157    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:16:04.715259    5088 main.go:141] libmachine: (no-preload-257000) Calling .GetState
	I1030 16:16:04.715357    5088 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:04.715366    5088 main.go:141] libmachine: (no-preload-257000) DBG | hyperkit pid from json: 0
	I1030 16:16:04.715374    5088 main.go:141] libmachine: (no-preload-257000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.json: no such file or directory
	I1030 16:16:04.715388    5088 fix.go:102] recreateIfNeeded on no-preload-257000: state=Stopped err=<nil>
	I1030 16:16:04.715412    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	W1030 16:16:04.715531    5088 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:04.737125    5088 out.go:177] * Restarting existing hyperkit VM for "no-preload-257000" ...
	I1030 16:16:04.801019    5088 main.go:141] libmachine: (no-preload-257000) Calling .Start
	I1030 16:16:04.801288    5088 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:04.801344    5088 main.go:141] libmachine: (no-preload-257000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.pid
	I1030 16:16:04.801517    5088 main.go:141] libmachine: (no-preload-257000) DBG | Using UUID 48f8ce36-777a-11ee-a20d-149d997fca88
	I1030 16:16:04.803740    5088 main.go:141] libmachine: (no-preload-257000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:04.803858    5088 fix.go:56] fixHost completed within 99.599351ms
	I1030 16:16:04.803872    5088 start.go:83] releasing machines lock for "no-preload-257000", held for 99.681308ms
	W1030 16:16:04.803892    5088 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:16:04.803944    5088 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:04.803953    5088 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:09.805515    5088 start.go:365] acquiring machines lock for no-preload-257000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:09.805679    5088 start.go:369] acquired machines lock for "no-preload-257000" in 136.581µs
	I1030 16:16:09.805711    5088 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:09.805718    5088 fix.go:54] fixHost starting: 
	I1030 16:16:09.806148    5088 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:09.806188    5088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:09.815411    5088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51311
	I1030 16:16:09.815801    5088 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:09.816153    5088 main.go:141] libmachine: Using API Version  1
	I1030 16:16:09.816165    5088 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:09.816386    5088 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:09.816501    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	I1030 16:16:09.816585    5088 main.go:141] libmachine: (no-preload-257000) Calling .GetState
	I1030 16:16:09.816708    5088 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:09.816728    5088 main.go:141] libmachine: (no-preload-257000) DBG | hyperkit pid from json: 0
	I1030 16:16:09.816743    5088 main.go:141] libmachine: (no-preload-257000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.json: no such file or directory
	I1030 16:16:09.816766    5088 fix.go:102] recreateIfNeeded on no-preload-257000: state=Stopped err=<nil>
	I1030 16:16:09.816777    5088 main.go:141] libmachine: (no-preload-257000) Calling .DriverName
	W1030 16:16:09.816860    5088 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:09.840575    5088 out.go:177] * Restarting existing hyperkit VM for "no-preload-257000" ...
	I1030 16:16:09.862271    5088 main.go:141] libmachine: (no-preload-257000) Calling .Start
	I1030 16:16:09.862524    5088 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:09.862587    5088 main.go:141] libmachine: (no-preload-257000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.pid
	I1030 16:16:09.862705    5088 main.go:141] libmachine: (no-preload-257000) DBG | Using UUID 48f8ce36-777a-11ee-a20d-149d997fca88
	I1030 16:16:09.901592    5088 main.go:141] libmachine: (no-preload-257000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:09.901681    5088 fix.go:56] fixHost completed within 95.9612ms
	I1030 16:16:09.901692    5088 start.go:83] releasing machines lock for "no-preload-257000", held for 95.999483ms
	W1030 16:16:09.901763    5088 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-257000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-257000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:09.944305    5088 out.go:177] 
	W1030 16:16:10.008172    5088 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:10.008305    5088 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:10.008366    5088 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:10.008490    5088 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:10.008522    5088 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:10.056181    5088 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-257000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (69.201061ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (6.99s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-257000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (66.397959ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-257000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-257000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-257000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (36.094813ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-257000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-257000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (65.500452ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p no-preload-257000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p no-preload-257000 "sudo crictl images -o json": exit status 89 (156.733698ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p no-preload-257000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p no-preload-257000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p no-preload-257000"
start_stop_delete_test.go:304: v1.28.3 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.3",
- 	"registry.k8s.io/kube-controller-manager:v1.28.3",
- 	"registry.k8s.io/kube-proxy:v1.28.3",
- 	"registry.k8s.io/kube-scheduler:v1.28.3",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (68.575601ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-257000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-257000 --alsologtostderr -v=1: exit status 89 (130.195478ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p no-preload-257000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:10.639764    5124 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:10.640039    5124 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:10.640045    5124 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:10.640049    5124 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:10.640222    5124 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:10.640533    5124 out.go:303] Setting JSON to false
	I1030 16:16:10.640560    5124 mustload.go:65] Loading cluster: no-preload-257000
	I1030 16:16:10.640846    5124 config.go:182] Loaded profile config "no-preload-257000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:10.641198    5124 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:10.641260    5124 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:10.649176    5124 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51329
	I1030 16:16:10.649573    5124 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:10.650000    5124 main.go:141] libmachine: Using API Version  1
	I1030 16:16:10.650012    5124 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:10.650219    5124 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:10.650324    5124 main.go:141] libmachine: (no-preload-257000) Calling .GetState
	I1030 16:16:10.650405    5124 main.go:141] libmachine: (no-preload-257000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:10.650423    5124 main.go:141] libmachine: (no-preload-257000) DBG | hyperkit pid from json: 0
	I1030 16:16:10.650438    5124 main.go:141] libmachine: (no-preload-257000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/no-preload-257000/hyperkit.json: no such file or directory
	I1030 16:16:10.671521    5124 out.go:177] * The control plane node must be running for this command
	I1030 16:16:10.692670    5124 out.go:177]   To start a cluster, run: "minikube start -p no-preload-257000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-257000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (68.060036ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (70.345092ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-257000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.27s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (12.21s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (12.137715752s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-376000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node default-k8s-diff-port-376000 in cluster default-k8s-diff-port-376000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "default-k8s-diff-port-376000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:11.975523    5168 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:11.975720    5168 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:11.975725    5168 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:11.975730    5168 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:11.975915    5168 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:11.977376    5168 out.go:303] Setting JSON to false
	I1030 16:16:11.999596    5168 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":946,"bootTime":1698706825,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:11.999693    5168 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:12.021824    5168 out.go:177] * [default-k8s-diff-port-376000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:12.064307    5168 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:12.064408    5168 notify.go:220] Checking for updates...
	I1030 16:16:12.085562    5168 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:12.106522    5168 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:12.127399    5168 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:12.148674    5168 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:12.171456    5168 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:12.193351    5168 config.go:182] Loaded profile config "embed-certs-750000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:12.193517    5168 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:12.193671    5168 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:12.223485    5168 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:16:12.244490    5168 start.go:298] selected driver: hyperkit
	I1030 16:16:12.244538    5168 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:16:12.244556    5168 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:12.248949    5168 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:12.249064    5168 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:12.256727    5168 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:12.260548    5168 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:12.260568    5168 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:12.260595    5168 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:16:12.260849    5168 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:16:12.260913    5168 cni.go:84] Creating CNI manager for ""
	I1030 16:16:12.260925    5168 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:12.260935    5168 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:16:12.260943    5168 start_flags.go:323] config:
	{Name:default-k8s-diff-port-376000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:default-k8s-diff-port-376000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster
.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:12.261073    5168 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:12.303612    5168 out.go:177] * Starting control plane node default-k8s-diff-port-376000 in cluster default-k8s-diff-port-376000
	I1030 16:16:12.325630    5168 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:12.325699    5168 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:12.325739    5168 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:12.325930    5168 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:12.325948    5168 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:12.326113    5168 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/default-k8s-diff-port-376000/config.json ...
	I1030 16:16:12.326147    5168 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/default-k8s-diff-port-376000/config.json: {Name:mk09ee7907da38ab493862bde37aa9f20de4c8b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:16:12.326732    5168 start.go:365] acquiring machines lock for default-k8s-diff-port-376000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:12.839345    5168 start.go:369] acquired machines lock for "default-k8s-diff-port-376000" in 512.568501ms
	I1030 16:16:12.839462    5168 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-376000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:
22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:default-k8s-diff-port-376000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:12.839554    5168 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:12.904169    5168 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:12.904640    5168 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:12.904725    5168 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:12.914138    5168 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51342
	I1030 16:16:12.914532    5168 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:12.914953    5168 main.go:141] libmachine: Using API Version  1
	I1030 16:16:12.914965    5168 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:12.915180    5168 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:12.915287    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetMachineName
	I1030 16:16:12.915366    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:12.915474    5168 start.go:159] libmachine.API.Create for "default-k8s-diff-port-376000" (driver="hyperkit")
	I1030 16:16:12.915503    5168 client.go:168] LocalClient.Create starting
	I1030 16:16:12.915530    5168 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:12.915581    5168 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:12.915600    5168 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:12.915650    5168 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:12.915685    5168 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:12.915695    5168 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:12.915707    5168 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:12.915717    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .PreCreateCheck
	I1030 16:16:12.915798    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:12.915977    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetConfigRaw
	I1030 16:16:12.926506    5168 main.go:141] libmachine: Creating machine...
	I1030 16:16:12.926525    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .Create
	I1030 16:16:12.926716    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:12.927004    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:12.926688    5176 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:12.927105    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:13.226413    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:13.226343    5176 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/id_rsa...
	I1030 16:16:13.299104    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:13.299035    5176 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/default-k8s-diff-port-376000.rawdisk...
	I1030 16:16:13.299119    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Writing magic tar header
	I1030 16:16:13.299149    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Writing SSH key tar header
	I1030 16:16:13.299390    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:13.299360    5176 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000 ...
	I1030 16:16:13.628412    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:13.628431    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.pid
	I1030 16:16:13.628446    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Using UUID 5150fef0-777a-11ee-adf5-149d997fca88
	I1030 16:16:13.669230    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:13.669318    5168 client.go:171] LocalClient.Create took 753.792918ms
	I1030 16:16:15.670573    5168 start.go:128] duration metric: createHost completed in 2.830950225s
	I1030 16:16:15.670603    5168 start.go:83] releasing machines lock for "default-k8s-diff-port-376000", held for 2.831197326s
	W1030 16:16:15.670629    5168 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:16:15.671215    5168 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:15.671262    5168 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:15.680680    5168 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51378
	I1030 16:16:15.681199    5168 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:15.681540    5168 main.go:141] libmachine: Using API Version  1
	I1030 16:16:15.681552    5168 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:15.681811    5168 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:15.682169    5168 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:15.682194    5168 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:15.690049    5168 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51382
	I1030 16:16:15.690684    5168 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:15.691162    5168 main.go:141] libmachine: Using API Version  1
	I1030 16:16:15.691177    5168 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:15.691431    5168 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:15.691537    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetState
	I1030 16:16:15.691628    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:15.691643    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | hyperkit pid from json: 0
	I1030 16:16:15.691655    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.json: no such file or directory
	I1030 16:16:15.691688    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:15.747928    5168 out.go:177] * Deleting "default-k8s-diff-port-376000" in hyperkit ...
	I1030 16:16:15.790779    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .Remove
	I1030 16:16:15.791102    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:15.791129    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:15.791160    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.json: no such file or directory
	I1030 16:16:15.791173    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | hyperkit pid from json: 0
	W1030 16:16:15.827688    5168 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:15.827704    5168 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:20.829916    5168 start.go:365] acquiring machines lock for default-k8s-diff-port-376000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:20.888661    5168 start.go:369] acquired machines lock for "default-k8s-diff-port-376000" in 58.700822ms
	I1030 16:16:20.888683    5168 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-376000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:
22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:default-k8s-diff-port-376000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mo
untIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:20.888758    5168 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:20.953464    5168 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:20.953618    5168 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:20.953671    5168 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:20.962855    5168 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51386
	I1030 16:16:20.963383    5168 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:20.963762    5168 main.go:141] libmachine: Using API Version  1
	I1030 16:16:20.963774    5168 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:20.963985    5168 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:20.964109    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetMachineName
	I1030 16:16:20.964203    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:20.964316    5168 start.go:159] libmachine.API.Create for "default-k8s-diff-port-376000" (driver="hyperkit")
	I1030 16:16:20.964331    5168 client.go:168] LocalClient.Create starting
	I1030 16:16:20.964359    5168 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:20.964405    5168 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:20.964416    5168 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:20.964452    5168 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:20.964488    5168 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:20.964497    5168 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:20.964511    5168 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:20.964517    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .PreCreateCheck
	I1030 16:16:20.964588    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:20.964626    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetConfigRaw
	I1030 16:16:20.997421    5168 main.go:141] libmachine: Creating machine...
	I1030 16:16:20.997448    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .Create
	I1030 16:16:20.997708    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:20.998005    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:20.997665    5223 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:20.998111    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:21.233935    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:21.233838    5223 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/id_rsa...
	I1030 16:16:21.444029    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:21.443901    5223 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/default-k8s-diff-port-376000.rawdisk...
	I1030 16:16:21.444062    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Writing magic tar header
	I1030 16:16:21.444097    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Writing SSH key tar header
	I1030 16:16:21.445718    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | I1030 16:16:21.445660    5223 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000 ...
	I1030 16:16:21.778095    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:21.778128    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.pid
	I1030 16:16:21.778159    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Using UUID 561d37dc-777a-11ee-adf5-149d997fca88
	I1030 16:16:21.818133    5168 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:21.818228    5168 client.go:171] LocalClient.Create took 853.877169ms
	I1030 16:16:23.819986    5168 start.go:128] duration metric: createHost completed in 2.931151068s
	I1030 16:16:23.820014    5168 start.go:83] releasing machines lock for "default-k8s-diff-port-376000", held for 2.931297031s
	W1030 16:16:23.820124    5168 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-376000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-376000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:23.863942    5168 out.go:177] 
	W1030 16:16:23.928871    5168 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:23.928931    5168 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:23.928953    5168 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:23.928985    5168 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:23.929013    5168 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:23.972803    5168 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (68.86233ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (12.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-750000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-750000 create -f testdata/busybox.yaml: exit status 1 (35.542896ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-750000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (67.172908ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (65.269413ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.17s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p embed-certs-750000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-750000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-750000 describe deploy/metrics-server -n kube-system: exit status 1 (35.514178ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-750000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-750000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (69.99788ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (6.95s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (6.87586765s)

                                                
                                                
-- stdout --
	* [embed-certs-750000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node embed-certs-750000 in cluster embed-certs-750000
	* Restarting existing hyperkit VM for "embed-certs-750000" ...
	* Restarting existing hyperkit VM for "embed-certs-750000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:14.238806    5208 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:14.239091    5208 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:14.239096    5208 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:14.239100    5208 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:14.239298    5208 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:14.240685    5208 out.go:303] Setting JSON to false
	I1030 16:16:14.262540    5208 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":949,"bootTime":1698706825,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:14.262647    5208 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:14.284415    5208 out.go:177] * [embed-certs-750000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:14.328093    5208 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:14.328217    5208 notify.go:220] Checking for updates...
	I1030 16:16:14.371959    5208 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:14.393954    5208 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:14.414849    5208 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:14.435896    5208 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:14.457027    5208 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:14.480617    5208 config.go:182] Loaded profile config "embed-certs-750000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:14.481284    5208 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:14.481392    5208 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:14.490353    5208 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51374
	I1030 16:16:14.490713    5208 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:14.491128    5208 main.go:141] libmachine: Using API Version  1
	I1030 16:16:14.491141    5208 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:14.491431    5208 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:14.491543    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:14.491731    5208 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:14.491960    5208 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:14.491985    5208 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:14.499669    5208 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51376
	I1030 16:16:14.499982    5208 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:14.500363    5208 main.go:141] libmachine: Using API Version  1
	I1030 16:16:14.500380    5208 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:14.500570    5208 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:14.500671    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:14.528889    5208 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:16:14.573057    5208 start.go:298] selected driver: hyperkit
	I1030 16:16:14.573091    5208 start.go:902] validating driver "hyperkit" against &{Name:embed-certs-750000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:embed-certs-750000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false
ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:14.573280    5208 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:14.577535    5208 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:14.577616    5208 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:14.585291    5208 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:14.589126    5208 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:14.589144    5208 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:14.589294    5208 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:16:14.589347    5208 cni.go:84] Creating CNI manager for ""
	I1030 16:16:14.589358    5208 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:14.589369    5208 start_flags.go:323] config:
	{Name:embed-certs-750000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:embed-certs-750000 Namespace:defau
lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-h
ost Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:14.589487    5208 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:14.632009    5208 out.go:177] * Starting control plane node embed-certs-750000 in cluster embed-certs-750000
	I1030 16:16:14.653153    5208 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:14.653224    5208 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:14.653269    5208 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:14.653425    5208 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:14.653442    5208 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:14.653627    5208 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/embed-certs-750000/config.json ...
	I1030 16:16:14.654526    5208 start.go:365] acquiring machines lock for embed-certs-750000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:15.670723    5208 start.go:369] acquired machines lock for "embed-certs-750000" in 1.016118375s
	I1030 16:16:15.670776    5208 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:15.670797    5208 fix.go:54] fixHost starting: 
	I1030 16:16:15.671224    5208 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:15.671265    5208 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:15.680675    5208 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51379
	I1030 16:16:15.681186    5208 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:15.681540    5208 main.go:141] libmachine: Using API Version  1
	I1030 16:16:15.681551    5208 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:15.681792    5208 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:15.681916    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:15.682013    5208 main.go:141] libmachine: (embed-certs-750000) Calling .GetState
	I1030 16:16:15.682096    5208 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:15.682123    5208 main.go:141] libmachine: (embed-certs-750000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.json: no such file or directory
	I1030 16:16:15.682131    5208 main.go:141] libmachine: (embed-certs-750000) DBG | hyperkit pid from json: 0
	I1030 16:16:15.682164    5208 fix.go:102] recreateIfNeeded on embed-certs-750000: state=Stopped err=<nil>
	I1030 16:16:15.682182    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	W1030 16:16:15.682270    5208 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:15.703885    5208 out.go:177] * Restarting existing hyperkit VM for "embed-certs-750000" ...
	I1030 16:16:15.769677    5208 main.go:141] libmachine: (embed-certs-750000) Calling .Start
	I1030 16:16:15.769941    5208 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:15.770019    5208 main.go:141] libmachine: (embed-certs-750000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.pid
	I1030 16:16:15.770112    5208 main.go:141] libmachine: (embed-certs-750000) DBG | Using UUID 4f93e6a4-777a-11ee-854d-149d997fca88
	I1030 16:16:15.772418    5208 main.go:141] libmachine: (embed-certs-750000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:15.772539    5208 fix.go:56] fixHost completed within 101.744863ms
	I1030 16:16:15.772554    5208 start.go:83] releasing machines lock for "embed-certs-750000", held for 101.811361ms
	W1030 16:16:15.772570    5208 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:16:15.772635    5208 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:15.772644    5208 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:20.774278    5208 start.go:365] acquiring machines lock for embed-certs-750000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:20.774486    5208 start.go:369] acquired machines lock for "embed-certs-750000" in 170.987µs
	I1030 16:16:20.774523    5208 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:20.774531    5208 fix.go:54] fixHost starting: 
	I1030 16:16:20.775014    5208 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:20.775054    5208 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:20.784689    5208 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51384
	I1030 16:16:20.785229    5208 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:20.785591    5208 main.go:141] libmachine: Using API Version  1
	I1030 16:16:20.785632    5208 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:20.785823    5208 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:20.785936    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	I1030 16:16:20.786025    5208 main.go:141] libmachine: (embed-certs-750000) Calling .GetState
	I1030 16:16:20.786102    5208 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:20.786146    5208 main.go:141] libmachine: (embed-certs-750000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.json: no such file or directory
	I1030 16:16:20.786148    5208 fix.go:102] recreateIfNeeded on embed-certs-750000: state=Stopped err=<nil>
	I1030 16:16:20.786156    5208 main.go:141] libmachine: (embed-certs-750000) DBG | hyperkit pid from json: 0
	I1030 16:16:20.786161    5208 main.go:141] libmachine: (embed-certs-750000) Calling .DriverName
	W1030 16:16:20.786239    5208 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:20.829876    5208 out.go:177] * Restarting existing hyperkit VM for "embed-certs-750000" ...
	I1030 16:16:20.851622    5208 main.go:141] libmachine: (embed-certs-750000) Calling .Start
	I1030 16:16:20.851941    5208 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:20.852005    5208 main.go:141] libmachine: (embed-certs-750000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.pid
	I1030 16:16:20.852079    5208 main.go:141] libmachine: (embed-certs-750000) DBG | Using UUID 4f93e6a4-777a-11ee-854d-149d997fca88
	I1030 16:16:20.888501    5208 main.go:141] libmachine: (embed-certs-750000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:20.888610    5208 fix.go:56] fixHost completed within 114.077598ms
	I1030 16:16:20.888618    5208 start.go:83] releasing machines lock for "embed-certs-750000", held for 114.118428ms
	W1030 16:16:20.888682    5208 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-750000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-750000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:20.953484    5208 out.go:177] 
	W1030 16:16:20.975004    5208 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:20.975073    5208 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:20.975100    5208 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:20.975123    5208 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:20.975141    5208 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:20.996898    5208 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p embed-certs-750000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (68.853123ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (6.95s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-750000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (67.775265ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-750000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-750000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-750000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (35.455949ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-750000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-750000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (66.404ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p embed-certs-750000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p embed-certs-750000 "sudo crictl images -o json": exit status 89 (142.722383ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p embed-certs-750000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p embed-certs-750000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p embed-certs-750000"
start_stop_delete_test.go:304: v1.28.3 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.3",
- 	"registry.k8s.io/kube-controller-manager:v1.28.3",
- 	"registry.k8s.io/kube-proxy:v1.28.3",
- 	"registry.k8s.io/kube-scheduler:v1.28.3",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (70.303842ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p embed-certs-750000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p embed-certs-750000 --alsologtostderr -v=1: exit status 89 (133.881905ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p embed-certs-750000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:21.572299    5240 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:21.572608    5240 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:21.572615    5240 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:21.572619    5240 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:21.572805    5240 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:21.573144    5240 out.go:303] Setting JSON to false
	I1030 16:16:21.573164    5240 mustload.go:65] Loading cluster: embed-certs-750000
	I1030 16:16:21.573463    5240 config.go:182] Loaded profile config "embed-certs-750000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:21.573811    5240 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:21.573860    5240 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:21.581606    5240 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51402
	I1030 16:16:21.582012    5240 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:21.582465    5240 main.go:141] libmachine: Using API Version  1
	I1030 16:16:21.582482    5240 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:21.582736    5240 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:21.582853    5240 main.go:141] libmachine: (embed-certs-750000) Calling .GetState
	I1030 16:16:21.582930    5240 main.go:141] libmachine: (embed-certs-750000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:21.582959    5240 main.go:141] libmachine: (embed-certs-750000) DBG | hyperkit pid from json: 0
	I1030 16:16:21.582976    5240 main.go:141] libmachine: (embed-certs-750000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/embed-certs-750000/hyperkit.json: no such file or directory
	I1030 16:16:21.606882    5240 out.go:177] * The control plane node must be running for this command
	I1030 16:16:21.628394    5240 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-750000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p embed-certs-750000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (68.23322ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (69.586054ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-750000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (12.85s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (12.7849535s)

                                                
                                                
-- stdout --
	* [newest-cni-164000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting control plane node newest-cni-164000 in cluster newest-cni-164000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "newest-cni-164000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:22.560256    5269 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:22.560442    5269 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:22.560448    5269 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:22.560452    5269 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:22.560641    5269 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:22.562016    5269 out.go:303] Setting JSON to false
	I1030 16:16:22.584075    5269 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":957,"bootTime":1698706825,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:22.584158    5269 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:22.606667    5269 out.go:177] * [newest-cni-164000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:22.650443    5269 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:22.650560    5269 notify.go:220] Checking for updates...
	I1030 16:16:22.672447    5269 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:22.694256    5269 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:22.716392    5269 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:22.738248    5269 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:22.759258    5269 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:22.781176    5269 config.go:182] Loaded profile config "default-k8s-diff-port-376000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:22.781349    5269 config.go:182] Loaded profile config "multinode-337000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:22.781505    5269 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:22.811421    5269 out.go:177] * Using the hyperkit driver based on user configuration
	I1030 16:16:22.853332    5269 start.go:298] selected driver: hyperkit
	I1030 16:16:22.853358    5269 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:16:22.853379    5269 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:22.857851    5269 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:22.857949    5269 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:22.865778    5269 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:22.869529    5269 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:22.869549    5269 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:22.869579    5269 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	W1030 16:16:22.869604    5269 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I1030 16:16:22.869826    5269 start_flags.go:953] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1030 16:16:22.869892    5269 cni.go:84] Creating CNI manager for ""
	I1030 16:16:22.869908    5269 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:22.869917    5269 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I1030 16:16:22.869928    5269 start_flags.go:323] config:
	{Name:newest-cni-164000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:newest-cni-164000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:22.870068    5269 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:22.934317    5269 out.go:177] * Starting control plane node newest-cni-164000 in cluster newest-cni-164000
	I1030 16:16:22.956332    5269 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:22.956420    5269 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:22.956456    5269 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:22.956668    5269 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:22.956685    5269 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:22.956846    5269 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/newest-cni-164000/config.json ...
	I1030 16:16:22.956883    5269 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/newest-cni-164000/config.json: {Name:mke08d511c30aa51f8b897c1c1776d9906315778 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:16:22.957617    5269 start.go:365] acquiring machines lock for newest-cni-164000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:23.820106    5269 start.go:369] acquired machines lock for "newest-cni-164000" in 862.448152ms
	I1030 16:16:23.820221    5269 start.go:93] Provisioning new machine with config: &{Name:newest-cni-164000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:newest-cni-164000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Us
ers:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:23.820356    5269 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:23.907721    5269 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:23.908190    5269 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:23.908262    5269 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:23.918424    5269 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51415
	I1030 16:16:23.918857    5269 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:23.919299    5269 main.go:141] libmachine: Using API Version  1
	I1030 16:16:23.919314    5269 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:23.919533    5269 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:23.919633    5269 main.go:141] libmachine: (newest-cni-164000) Calling .GetMachineName
	I1030 16:16:23.919721    5269 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:23.919829    5269 start.go:159] libmachine.API.Create for "newest-cni-164000" (driver="hyperkit")
	I1030 16:16:23.919856    5269 client.go:168] LocalClient.Create starting
	I1030 16:16:23.919882    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:23.919932    5269 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:23.919948    5269 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:23.919998    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:23.920041    5269 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:23.920053    5269 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:23.920065    5269 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:23.920072    5269 main.go:141] libmachine: (newest-cni-164000) Calling .PreCreateCheck
	I1030 16:16:23.920154    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:23.920352    5269 main.go:141] libmachine: (newest-cni-164000) Calling .GetConfigRaw
	I1030 16:16:23.951559    5269 main.go:141] libmachine: Creating machine...
	I1030 16:16:23.951590    5269 main.go:141] libmachine: (newest-cni-164000) Calling .Create
	I1030 16:16:23.951835    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:23.952162    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:23.951821    5277 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:23.952259    5269 main.go:141] libmachine: (newest-cni-164000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:24.232768    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:24.232712    5277 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/id_rsa...
	I1030 16:16:24.420744    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:24.420621    5277 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/newest-cni-164000.rawdisk...
	I1030 16:16:24.420776    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Writing magic tar header
	I1030 16:16:24.420822    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Writing SSH key tar header
	I1030 16:16:24.421454    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:24.421329    5277 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000 ...
	I1030 16:16:24.820383    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:24.820408    5269 main.go:141] libmachine: (newest-cni-164000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.pid
	I1030 16:16:24.820418    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Using UUID 57e001d0-777a-11ee-bc22-149d997fca88
	I1030 16:16:24.906814    5269 main.go:141] libmachine: (newest-cni-164000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:24.906919    5269 client.go:171] LocalClient.Create took 987.038755ms
	I1030 16:16:26.908552    5269 start.go:128] duration metric: createHost completed in 3.088129669s
	I1030 16:16:26.908583    5269 start.go:83] releasing machines lock for "newest-cni-164000", held for 3.088413771s
	W1030 16:16:26.908608    5269 start.go:691] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I1030 16:16:26.909162    5269 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:26.909221    5269 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:26.918933    5269 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51451
	I1030 16:16:26.919302    5269 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:26.919684    5269 main.go:141] libmachine: Using API Version  1
	I1030 16:16:26.919698    5269 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:26.919897    5269 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:26.920250    5269 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:26.920270    5269 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:26.928280    5269 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51455
	I1030 16:16:26.928601    5269 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:26.928963    5269 main.go:141] libmachine: Using API Version  1
	I1030 16:16:26.928982    5269 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:26.929165    5269 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:26.929263    5269 main.go:141] libmachine: (newest-cni-164000) Calling .GetState
	I1030 16:16:26.929347    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:26.929379    5269 main.go:141] libmachine: (newest-cni-164000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.json: no such file or directory
	I1030 16:16:26.929386    5269 main.go:141] libmachine: (newest-cni-164000) DBG | hyperkit pid from json: 0
	I1030 16:16:26.929460    5269 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:27.005832    5269 out.go:177] * Deleting "newest-cni-164000" in hyperkit ...
	I1030 16:16:27.026711    5269 main.go:141] libmachine: (newest-cni-164000) Calling .Remove
	I1030 16:16:27.027035    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:27.027069    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:27.027110    5269 main.go:141] libmachine: (newest-cni-164000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.json: no such file or directory
	I1030 16:16:27.027131    5269 main.go:141] libmachine: (newest-cni-164000) DBG | hyperkit pid from json: 0
	W1030 16:16:27.063181    5269 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:27.063195    5269 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:32.065249    5269 start.go:365] acquiring machines lock for newest-cni-164000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:32.105736    5269 start.go:369] acquired machines lock for "newest-cni-164000" in 40.42006ms
	I1030 16:16:32.105758    5269 start.go:93] Provisioning new machine with config: &{Name:newest-cni-164000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:newest-cni-164000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Us
ers:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I1030 16:16:32.105857    5269 start.go:125] createHost starting for "" (driver="hyperkit")
	I1030 16:16:32.192762    5269 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I1030 16:16:32.192920    5269 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:32.192970    5269 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:32.202430    5269 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51459
	I1030 16:16:32.202773    5269 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:32.203132    5269 main.go:141] libmachine: Using API Version  1
	I1030 16:16:32.203145    5269 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:32.203368    5269 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:32.203484    5269 main.go:141] libmachine: (newest-cni-164000) Calling .GetMachineName
	I1030 16:16:32.203569    5269 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:32.203671    5269 start.go:159] libmachine.API.Create for "newest-cni-164000" (driver="hyperkit")
	I1030 16:16:32.203694    5269 client.go:168] LocalClient.Create starting
	I1030 16:16:32.203718    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/ca.pem
	I1030 16:16:32.203762    5269 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:32.203774    5269 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:32.203820    5269 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17527-929/.minikube/certs/cert.pem
	I1030 16:16:32.203855    5269 main.go:141] libmachine: Decoding PEM data...
	I1030 16:16:32.203869    5269 main.go:141] libmachine: Parsing certificate...
	I1030 16:16:32.203885    5269 main.go:141] libmachine: Running pre-create checks...
	I1030 16:16:32.203891    5269 main.go:141] libmachine: (newest-cni-164000) Calling .PreCreateCheck
	I1030 16:16:32.203980    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:32.204006    5269 main.go:141] libmachine: (newest-cni-164000) Calling .GetConfigRaw
	I1030 16:16:32.236174    5269 main.go:141] libmachine: Creating machine...
	I1030 16:16:32.236201    5269 main.go:141] libmachine: (newest-cni-164000) Calling .Create
	I1030 16:16:32.236447    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:32.236770    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:32.236399    5326 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:32.236911    5269 main.go:141] libmachine: (newest-cni-164000) Downloading /Users/jenkins/minikube-integration/17527-929/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso...
	I1030 16:16:32.489813    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:32.489750    5326 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/id_rsa...
	I1030 16:16:32.709182    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:32.709011    5326 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/newest-cni-164000.rawdisk...
	I1030 16:16:32.709236    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Writing magic tar header
	I1030 16:16:32.709280    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Writing SSH key tar header
	I1030 16:16:32.709927    5269 main.go:141] libmachine: (newest-cni-164000) DBG | I1030 16:16:32.709825    5326 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000 ...
	I1030 16:16:33.056820    5269 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:33.056839    5269 main.go:141] libmachine: (newest-cni-164000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.pid
	I1030 16:16:33.056876    5269 main.go:141] libmachine: (newest-cni-164000) DBG | Using UUID 5cd03318-777a-11ee-bc22-149d997fca88
	I1030 16:16:33.097067    5269 main.go:141] libmachine: (newest-cni-164000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:33.097155    5269 client.go:171] LocalClient.Create took 893.440728ms
	I1030 16:16:35.099405    5269 start.go:128] duration metric: createHost completed in 2.993473698s
	I1030 16:16:35.099500    5269 start.go:83] releasing machines lock for "newest-cni-164000", held for 2.993702133s
	W1030 16:16:35.099611    5269 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-164000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-164000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:35.143354    5269 out.go:177] 
	W1030 16:16:35.165230    5269 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:35.165318    5269 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:35.165346    5269 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:35.165390    5269 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:35.165425    5269 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:35.229036    5269 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.760312ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-164000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (12.85s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-376000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-376000 create -f testdata/busybox.yaml: exit status 1 (35.675766ms)

                                                
                                                
** stderr ** 
	error: no openapi getter

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-376000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (67.294654ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (66.071835ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.17s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p default-k8s-diff-port-376000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-376000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-376000 describe deploy/metrics-server -n kube-system: exit status 1 (36.474539ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-376000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-376000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (67.53025ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.31s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (7.131440927s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-376000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node default-k8s-diff-port-376000 in cluster default-k8s-diff-port-376000
	* Restarting existing hyperkit VM for "default-k8s-diff-port-376000" ...
	* Restarting existing hyperkit VM for "default-k8s-diff-port-376000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:25.241194    5309 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:25.241479    5309 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:25.241484    5309 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:25.241488    5309 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:25.241685    5309 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:25.243073    5309 out.go:303] Setting JSON to false
	I1030 16:16:25.265098    5309 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":960,"bootTime":1698706825,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:25.265198    5309 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:25.286665    5309 out.go:177] * [default-k8s-diff-port-376000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:25.329298    5309 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:25.329486    5309 notify.go:220] Checking for updates...
	I1030 16:16:25.351440    5309 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:25.373423    5309 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:25.394207    5309 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:25.415336    5309 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:25.458132    5309 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:25.480004    5309 config.go:182] Loaded profile config "default-k8s-diff-port-376000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:25.480643    5309 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:25.480722    5309 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:25.490037    5309 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51447
	I1030 16:16:25.490392    5309 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:25.490821    5309 main.go:141] libmachine: Using API Version  1
	I1030 16:16:25.490834    5309 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:25.491048    5309 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:25.491154    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:25.491335    5309 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:25.491558    5309 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:25.491587    5309 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:25.499362    5309 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51449
	I1030 16:16:25.499686    5309 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:25.499999    5309 main.go:141] libmachine: Using API Version  1
	I1030 16:16:25.500009    5309 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:25.500220    5309 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:25.500315    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:25.528357    5309 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:16:25.570323    5309 start.go:298] selected driver: hyperkit
	I1030 16:16:25.570353    5309 start.go:902] validating driver "hyperkit" against &{Name:default-k8s-diff-port-376000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:
22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:default-k8s-diff-port-376000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: Mul
tiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:25.570540    5309 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:25.574803    5309 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:25.574896    5309 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:25.582506    5309 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:25.586350    5309 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:25.586371    5309 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:25.586500    5309 start_flags.go:934] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1030 16:16:25.586565    5309 cni.go:84] Creating CNI manager for ""
	I1030 16:16:25.586576    5309 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:25.586591    5309 start_flags.go:323] config:
	{Name:default-k8s-diff-port-376000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:default-k8s-diff-port-3
76000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStri
ng:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:25.586752    5309 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:25.629107    5309 out.go:177] * Starting control plane node default-k8s-diff-port-376000 in cluster default-k8s-diff-port-376000
	I1030 16:16:25.650238    5309 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:25.650383    5309 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:25.650408    5309 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:25.650585    5309 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:25.650604    5309 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:25.650753    5309 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/default-k8s-diff-port-376000/config.json ...
	I1030 16:16:25.651692    5309 start.go:365] acquiring machines lock for default-k8s-diff-port-376000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:26.908692    5309 start.go:369] acquired machines lock for "default-k8s-diff-port-376000" in 1.256933193s
	I1030 16:16:26.908751    5309 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:26.908786    5309 fix.go:54] fixHost starting: 
	I1030 16:16:26.909188    5309 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:26.909233    5309 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:26.918874    5309 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51452
	I1030 16:16:26.919317    5309 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:26.919680    5309 main.go:141] libmachine: Using API Version  1
	I1030 16:16:26.919694    5309 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:26.919900    5309 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:26.920015    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:26.920109    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetState
	I1030 16:16:26.920193    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:26.920205    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | hyperkit pid from json: 0
	I1030 16:16:26.920227    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.json: no such file or directory
	I1030 16:16:26.920271    5309 fix.go:102] recreateIfNeeded on default-k8s-diff-port-376000: state=Stopped err=<nil>
	I1030 16:16:26.920295    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	W1030 16:16:26.920376    5309 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:26.941154    5309 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-376000" ...
	I1030 16:16:27.005831    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .Start
	I1030 16:16:27.006184    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:27.006245    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.pid
	I1030 16:16:27.006351    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Using UUID 561d37dc-777a-11ee-adf5-149d997fca88
	I1030 16:16:27.008617    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:27.008751    5309 fix.go:56] fixHost completed within 99.961182ms
	I1030 16:16:27.008764    5309 start.go:83] releasing machines lock for "default-k8s-diff-port-376000", held for 100.052666ms
	W1030 16:16:27.008781    5309 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:16:27.008849    5309 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:27.008857    5309 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:32.011140    5309 start.go:365] acquiring machines lock for default-k8s-diff-port-376000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:32.011348    5309 start.go:369] acquired machines lock for "default-k8s-diff-port-376000" in 171.389µs
	I1030 16:16:32.011381    5309 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:32.011389    5309 fix.go:54] fixHost starting: 
	I1030 16:16:32.011832    5309 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:32.011874    5309 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:32.021409    5309 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51457
	I1030 16:16:32.021989    5309 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:32.022490    5309 main.go:141] libmachine: Using API Version  1
	I1030 16:16:32.022516    5309 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:32.022804    5309 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:32.022911    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	I1030 16:16:32.023000    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetState
	I1030 16:16:32.023114    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:32.023129    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | hyperkit pid from json: 0
	I1030 16:16:32.023148    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.json: no such file or directory
	I1030 16:16:32.023178    5309 fix.go:102] recreateIfNeeded on default-k8s-diff-port-376000: state=Stopped err=<nil>
	I1030 16:16:32.023189    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .DriverName
	W1030 16:16:32.023266    5309 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:32.045204    5309 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-376000" ...
	I1030 16:16:32.066564    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .Start
	I1030 16:16:32.066832    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:32.066861    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.pid
	I1030 16:16:32.066898    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | Using UUID 561d37dc-777a-11ee-adf5-149d997fca88
	I1030 16:16:32.105590    5309 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:32.105677    5309 fix.go:56] fixHost completed within 94.28719ms
	I1030 16:16:32.105688    5309 start.go:83] releasing machines lock for "default-k8s-diff-port-376000", held for 94.326753ms
	W1030 16:16:32.105773    5309 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-376000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-376000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:32.148980    5309 out.go:177] 
	W1030 16:16:32.213833    5309 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:32.213924    5309 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:32.213943    5309 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:32.213981    5309 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:32.214018    5309 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:32.256639    5309 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-376000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (68.043142ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-376000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (67.828192ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-376000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-376000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-376000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (35.306417ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-376000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-376000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (65.947687ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p default-k8s-diff-port-376000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p default-k8s-diff-port-376000 "sudo crictl images -o json": exit status 89 (152.286729ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-376000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p default-k8s-diff-port-376000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p default-k8s-diff-port-376000"
start_stop_delete_test.go:304: v1.28.3 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.3",
- 	"registry.k8s.io/kube-controller-manager:v1.28.3",
- 	"registry.k8s.io/kube-proxy:v1.28.3",
- 	"registry.k8s.io/kube-scheduler:v1.28.3",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (73.618277ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p default-k8s-diff-port-376000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-376000 --alsologtostderr -v=1: exit status 89 (161.743818ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-376000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:32.849949    5343 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:32.850250    5343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:32.850255    5343 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:32.850259    5343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:32.850446    5343 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:32.850772    5343 out.go:303] Setting JSON to false
	I1030 16:16:32.850791    5343 mustload.go:65] Loading cluster: default-k8s-diff-port-376000
	I1030 16:16:32.851083    5343 config.go:182] Loaded profile config "default-k8s-diff-port-376000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:32.851438    5343 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:32.851487    5343 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:32.859263    5343 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51475
	I1030 16:16:32.859672    5343 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:32.860110    5343 main.go:141] libmachine: Using API Version  1
	I1030 16:16:32.860141    5343 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:32.860367    5343 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:32.860488    5343 main.go:141] libmachine: (default-k8s-diff-port-376000) Calling .GetState
	I1030 16:16:32.860579    5343 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:32.860620    5343 main.go:141] libmachine: (default-k8s-diff-port-376000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/default-k8s-diff-port-376000/hyperkit.json: no such file or directory
	I1030 16:16:32.881044    5343 out.go:177] * The control plane node must be running for this command
	I1030 16:16:32.860633    5343 main.go:141] libmachine: (default-k8s-diff-port-376000) DBG | hyperkit pid from json: 0
	I1030 16:16:32.922732    5343 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-376000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-376000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (69.791826ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (71.374365ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-376000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.30s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.86s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3: exit status 60 (5.795738945s)

                                                
                                                
-- stdout --
	* [newest-cni-164000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting control plane node newest-cni-164000 in cluster newest-cni-164000
	* Restarting existing hyperkit VM for "newest-cni-164000" ...
	* Restarting existing hyperkit VM for "newest-cni-164000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:36.141119    5391 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:36.141844    5391 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:36.141858    5391 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:36.141865    5391 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:36.142453    5391 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:36.143906    5391 out.go:303] Setting JSON to false
	I1030 16:16:36.166070    5391 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":971,"bootTime":1698706825,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:16:36.166187    5391 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:16:36.188350    5391 out.go:177] * [newest-cni-164000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:16:36.231269    5391 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:16:36.231414    5391 notify.go:220] Checking for updates...
	I1030 16:16:36.274163    5391 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:16:36.297143    5391 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:16:36.318003    5391 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:16:36.361178    5391 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:16:36.382001    5391 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:16:36.403921    5391 config.go:182] Loaded profile config "newest-cni-164000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:36.404614    5391 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:36.404703    5391 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:36.413799    5391 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51508
	I1030 16:16:36.414144    5391 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:36.414591    5391 main.go:141] libmachine: Using API Version  1
	I1030 16:16:36.414609    5391 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:36.414881    5391 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:36.414994    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:36.415172    5391 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:16:36.415402    5391 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:36.415430    5391 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:36.423021    5391 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51510
	I1030 16:16:36.423365    5391 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:36.423724    5391 main.go:141] libmachine: Using API Version  1
	I1030 16:16:36.423735    5391 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:36.423957    5391 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:36.424064    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:36.452239    5391 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:16:36.494155    5391 start.go:298] selected driver: hyperkit
	I1030 16:16:36.494182    5391 start.go:902] validating driver "hyperkit" against &{Name:newest-cni-164000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:newest-cni-164000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledS
top:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:36.494400    5391 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:16:36.498522    5391 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:36.498613    5391 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:16:36.506270    5391 install.go:137] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:16:36.510116    5391 install.go:79] stdout: /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:36.510134    5391 install.go:81] /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit looks good
	I1030 16:16:36.510272    5391 start_flags.go:953] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I1030 16:16:36.510328    5391 cni.go:84] Creating CNI manager for ""
	I1030 16:16:36.510339    5391 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:16:36.510349    5391 start_flags.go:323] config:
	{Name:newest-cni-164000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:newest-cni-164000 Namespace:defaul
t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false
ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:16:36.510480    5391 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:16:36.554018    5391 out.go:177] * Starting control plane node newest-cni-164000 in cluster newest-cni-164000
	I1030 16:16:36.575198    5391 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:16:36.575270    5391 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:16:36.575297    5391 cache.go:56] Caching tarball of preloaded images
	I1030 16:16:36.575468    5391 preload.go:174] Found /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I1030 16:16:36.575486    5391 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:16:36.575651    5391 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/newest-cni-164000/config.json ...
	I1030 16:16:36.576509    5391 start.go:365] acquiring machines lock for newest-cni-164000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:36.576623    5391 start.go:369] acquired machines lock for "newest-cni-164000" in 88.853µs
	I1030 16:16:36.576663    5391 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:36.576679    5391 fix.go:54] fixHost starting: 
	I1030 16:16:36.577127    5391 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:36.577167    5391 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:36.585664    5391 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51512
	I1030 16:16:36.585998    5391 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:36.586374    5391 main.go:141] libmachine: Using API Version  1
	I1030 16:16:36.586388    5391 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:36.586606    5391 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:36.586715    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:36.586819    5391 main.go:141] libmachine: (newest-cni-164000) Calling .GetState
	I1030 16:16:36.586897    5391 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:36.586918    5391 main.go:141] libmachine: (newest-cni-164000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.json: no such file or directory
	I1030 16:16:36.586926    5391 main.go:141] libmachine: (newest-cni-164000) DBG | hyperkit pid from json: 0
	I1030 16:16:36.586969    5391 fix.go:102] recreateIfNeeded on newest-cni-164000: state=Stopped err=<nil>
	I1030 16:16:36.586990    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	W1030 16:16:36.587072    5391 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:36.628892    5391 out.go:177] * Restarting existing hyperkit VM for "newest-cni-164000" ...
	I1030 16:16:36.650263    5391 main.go:141] libmachine: (newest-cni-164000) Calling .Start
	I1030 16:16:36.650526    5391 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:36.650587    5391 main.go:141] libmachine: (newest-cni-164000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.pid
	I1030 16:16:36.650688    5391 main.go:141] libmachine: (newest-cni-164000) DBG | Using UUID 5cd03318-777a-11ee-bc22-149d997fca88
	I1030 16:16:36.653114    5391 main.go:141] libmachine: (newest-cni-164000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:36.653193    5391 fix.go:56] fixHost completed within 76.513305ms
	I1030 16:16:36.653207    5391 start.go:83] releasing machines lock for "newest-cni-164000", held for 76.570208ms
	W1030 16:16:36.653223    5391 start.go:691] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W1030 16:16:36.653287    5391 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:36.653296    5391 start.go:706] Will try again in 5 seconds ...
	I1030 16:16:41.655578    5391 start.go:365] acquiring machines lock for newest-cni-164000: {Name:mkb8225866f91ad591c0e998ff78d812535cbe75 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I1030 16:16:41.655736    5391 start.go:369] acquired machines lock for "newest-cni-164000" in 127.557µs
	I1030 16:16:41.655771    5391 start.go:96] Skipping create...Using existing machine configuration
	I1030 16:16:41.655778    5391 fix.go:54] fixHost starting: 
	I1030 16:16:41.656175    5391 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:41.656214    5391 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:41.665941    5391 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51514
	I1030 16:16:41.666464    5391 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:41.666894    5391 main.go:141] libmachine: Using API Version  1
	I1030 16:16:41.666905    5391 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:41.667200    5391 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:41.667400    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	I1030 16:16:41.667496    5391 main.go:141] libmachine: (newest-cni-164000) Calling .GetState
	I1030 16:16:41.667590    5391 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:41.667605    5391 main.go:141] libmachine: (newest-cni-164000) DBG | hyperkit pid from json: 0
	I1030 16:16:41.667625    5391 main.go:141] libmachine: (newest-cni-164000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.json: no such file or directory
	I1030 16:16:41.667668    5391 fix.go:102] recreateIfNeeded on newest-cni-164000: state=Stopped err=<nil>
	I1030 16:16:41.667684    5391 main.go:141] libmachine: (newest-cni-164000) Calling .DriverName
	W1030 16:16:41.667759    5391 fix.go:128] unexpected machine state, will restart: <nil>
	I1030 16:16:41.689517    5391 out.go:177] * Restarting existing hyperkit VM for "newest-cni-164000" ...
	I1030 16:16:41.732364    5391 main.go:141] libmachine: (newest-cni-164000) Calling .Start
	I1030 16:16:41.732645    5391 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:41.732694    5391 main.go:141] libmachine: (newest-cni-164000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.pid
	I1030 16:16:41.732773    5391 main.go:141] libmachine: (newest-cni-164000) DBG | Using UUID 5cd03318-777a-11ee-bc22-149d997fca88
	I1030 16:16:41.735072    5391 main.go:141] libmachine: (newest-cni-164000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I1030 16:16:41.735183    5391 fix.go:56] fixHost completed within 79.403154ms
	I1030 16:16:41.735194    5391 start.go:83] releasing machines lock for "newest-cni-164000", held for 79.444052ms
	W1030 16:16:41.735276    5391 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-164000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-164000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I1030 16:16:41.778076    5391 out.go:177] 
	W1030 16:16:41.799288    5391 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W1030 16:16:41.799345    5391 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W1030 16:16:41.799364    5391 out.go:239] * Related issues:
	* Related issues:
	W1030 16:16:41.799410    5391 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W1030 16:16:41.799444    5391 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I1030 16:16:41.821319    5391 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p newest-cni-164000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.28.3": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.011875ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-164000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.86s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p newest-cni-164000 "sudo crictl images -o json"
start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p newest-cni-164000 "sudo crictl images -o json": exit status 89 (152.923662ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p newest-cni-164000"

                                                
                                                
-- /stdout --
start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p newest-cni-164000 \"sudo crictl images -o json\"": exit status 89
start_stop_delete_test.go:304: failed to decode images json invalid character '*' looking for beginning of value. output:
* The control plane node must be running for this command
To start a cluster, run: "minikube start -p newest-cni-164000"
start_stop_delete_test.go:304: v1.28.3 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.3",
- 	"registry.k8s.io/kube-controller-manager:v1.28.3",
- 	"registry.k8s.io/kube-proxy:v1.28.3",
- 	"registry.k8s.io/kube-scheduler:v1.28.3",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.521103ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-164000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p newest-cni-164000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p newest-cni-164000 --alsologtostderr -v=1: exit status 89 (132.673011ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p newest-cni-164000"

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:16:42.227265    5412 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:16:42.227550    5412 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:42.227555    5412 out.go:309] Setting ErrFile to fd 2...
	I1030 16:16:42.227560    5412 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:16:42.227733    5412 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:16:42.228039    5412 out.go:303] Setting JSON to false
	I1030 16:16:42.228057    5412 mustload.go:65] Loading cluster: newest-cni-164000
	I1030 16:16:42.228347    5412 config.go:182] Loaded profile config "newest-cni-164000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:16:42.228688    5412 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit
	I1030 16:16:42.228734    5412 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:16:42.236232    5412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51524
	I1030 16:16:42.236607    5412 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:16:42.237012    5412 main.go:141] libmachine: Using API Version  1
	I1030 16:16:42.237032    5412 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:16:42.237340    5412 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:16:42.237461    5412 main.go:141] libmachine: (newest-cni-164000) Calling .GetState
	I1030 16:16:42.237543    5412 main.go:141] libmachine: (newest-cni-164000) DBG | exe=/Users/jenkins/minikube-integration/17527-929/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I1030 16:16:42.237558    5412 main.go:141] libmachine: (newest-cni-164000) DBG | hyperkit pid from json: 0
	I1030 16:16:42.237577    5412 main.go:141] libmachine: (newest-cni-164000) Error reading pid file: open /Users/jenkins/minikube-integration/17527-929/.minikube/machines/newest-cni-164000/hyperkit.json: no such file or directory
	I1030 16:16:42.258995    5412 out.go:177] * The control plane node must be running for this command
	I1030 16:16:42.280935    5412 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-164000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p newest-cni-164000 --alsologtostderr -v=1 failed: exit status 89
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.477107ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-164000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.510826ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-164000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.27s)

                                                
                                    

Test pass (77/240)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 17.14
4 TestDownloadOnly/v1.16.0/preload-exists 0
7 TestDownloadOnly/v1.16.0/kubectl 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.29
11 TestDownloadOnly/v1.28.3/preload-exists 0
15 TestDownloadOnly/v1.28.3/LogsDuration 0.3
16 TestDownloadOnly/DeleteAll 0.39
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.37
23 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.19
24 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.21
33 TestHyperKitDriverInstallOrUpdate 10.22
37 TestErrorSpam/start 1.25
38 TestErrorSpam/status 0.23
39 TestErrorSpam/pause 0.4
40 TestErrorSpam/unpause 0.39
41 TestErrorSpam/stop 0.62
44 TestFunctional/serial/CopySyncFile 0
46 TestFunctional/serial/AuditLog 0
52 TestFunctional/serial/CacheCmd/cache/add_remote 2.08
53 TestFunctional/serial/CacheCmd/cache/add_local 1.35
54 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.08
55 TestFunctional/serial/CacheCmd/cache/list 0.08
58 TestFunctional/serial/CacheCmd/cache/delete 0.16
67 TestFunctional/parallel/ConfigCmd 0.5
69 TestFunctional/parallel/DryRun 0.92
70 TestFunctional/parallel/InternationalLanguage 0.47
76 TestFunctional/parallel/AddonsCmd 0.25
91 TestFunctional/parallel/License 0.49
97 TestFunctional/parallel/ImageCommands/Setup 2.23
105 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
112 TestFunctional/parallel/ImageCommands/ImageRemove 0.18
114 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.2
121 TestFunctional/parallel/ProfileCmd/profile_not_create 0.24
122 TestFunctional/parallel/ProfileCmd/profile_list 0.22
123 TestFunctional/parallel/ProfileCmd/profile_json_output 0.22
127 TestFunctional/parallel/Version/short 0.1
130 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.03
132 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.13
133 TestFunctional/delete_addon-resizer_images 0.13
134 TestFunctional/delete_my-image_image 0.05
135 TestFunctional/delete_minikube_cached_images 0.05
144 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.2
149 TestJSONOutput/start/Audit 0
155 TestJSONOutput/pause/Audit 0
157 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
158 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
161 TestJSONOutput/unpause/Audit 0
163 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
164 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
166 TestJSONOutput/stop/Command 0.14
167 TestJSONOutput/stop/Audit 0
169 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
170 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
171 TestErrorJSONOutput 0.77
176 TestMainNoArgs 0.08
220 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 2.52
221 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 5.92
222 TestStoppedBinaryUpgrade/Setup 1.07
235 TestNoKubernetes/serial/StartNoK8sWithVersion 0.38
239 TestNoKubernetes/serial/VerifyK8sNotRunning 0.13
240 TestNoKubernetes/serial/ProfileList 0.31
241 TestNoKubernetes/serial/Stop 0.2
243 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.13
257 TestStartStop/group/old-k8s-version/serial/Stop 0.57
260 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.38
270 TestStartStop/group/no-preload/serial/Stop 0.22
271 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.32
281 TestStartStop/group/embed-certs/serial/Stop 0.26
282 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.31
292 TestStartStop/group/default-k8s-diff-port/serial/Stop 0.26
293 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.32
299 TestStartStop/group/newest-cni/serial/DeployApp 0
300 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.2
301 TestStartStop/group/newest-cni/serial/Stop 0.21
302 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.31
304 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
305 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.16.0/json-events (17.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-255000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:69: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-255000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit : (17.137764704s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (17.14s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
--- PASS: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.29s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-255000
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-255000: exit status 85 (289.723744ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   |    Version     |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |          |
	|         | -p download-only-255000        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=hyperkit              |                      |         |                |                     |          |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 16:03:00
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.21.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 16:03:00.565265    1480 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:03:00.565479    1480 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:00.565485    1480 out.go:309] Setting ErrFile to fd 2...
	I1030 16:03:00.565489    1480 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:00.565671    1480 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	W1030 16:03:00.565763    1480 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: no such file or directory
	I1030 16:03:00.567432    1480 out.go:303] Setting JSON to true
	I1030 16:03:00.591419    1480 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":155,"bootTime":1698706825,"procs":420,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:03:00.591520    1480 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:03:00.613973    1480 out.go:97] [download-only-255000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:03:00.635583    1480 out.go:169] MINIKUBE_LOCATION=17527
	W1030 16:03:00.614239    1480 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball: no such file or directory
	I1030 16:03:00.614240    1480 notify.go:220] Checking for updates...
	I1030 16:03:00.678787    1480 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:03:00.700548    1480 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:03:00.721828    1480 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:03:00.743713    1480 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	W1030 16:03:00.788686    1480 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1030 16:03:00.789182    1480 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:03:00.866728    1480 out.go:97] Using the hyperkit driver based on user configuration
	I1030 16:03:00.866773    1480 start.go:298] selected driver: hyperkit
	I1030 16:03:00.866788    1480 start.go:902] validating driver "hyperkit" against <nil>
	I1030 16:03:00.866985    1480 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:00.867342    1480 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:03:01.004257    1480 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:03:01.008708    1480 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:01.008728    1480 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:03:01.008753    1480 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I1030 16:03:01.013681    1480 start_flags.go:394] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I1030 16:03:01.013847    1480 start_flags.go:916] Wait components to verify : map[apiserver:true system_pods:true]
	I1030 16:03:01.013878    1480 cni.go:84] Creating CNI manager for ""
	I1030 16:03:01.013890    1480 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I1030 16:03:01.013899    1480 start_flags.go:323] config:
	{Name:download-only-255000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-255000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container
Runtime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:01.014166    1480 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:01.035331    1480 out.go:97] Downloading VM boot image ...
	I1030 16:03:01.035421    1480 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/iso/amd64/minikube-v1.32.0-1698684775-17527-amd64.iso
	I1030 16:03:06.111050    1480 out.go:97] Starting control plane node download-only-255000 in cluster download-only-255000
	I1030 16:03:06.111082    1480 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:03:06.163224    1480 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
	I1030 16:03:06.163253    1480 cache.go:56] Caching tarball of preloaded images
	I1030 16:03:06.163601    1480 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:03:06.187584    1480 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I1030 16:03:06.187611    1480 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:06.267855    1480 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4?checksum=md5:326f3ce331abb64565b50b8c9e791244 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
	I1030 16:03:11.345781    1480 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:11.345970    1480 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:11.882450    1480 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on docker
	I1030 16:03:11.882675    1480 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/download-only-255000/config.json ...
	I1030 16:03:11.882700    1480 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/download-only-255000/config.json: {Name:mk5b43b5ca576c43a7dd24694faa21e6746a17fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1030 16:03:11.883051    1480 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I1030 16:03:11.883372    1480 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/amd64/kubectl.sha1 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-255000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.29s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/preload-exists
--- PASS: TestDownloadOnly/v1.28.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/LogsDuration (0.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/LogsDuration
aaa_download_only_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-255000
aaa_download_only_test.go:172: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-255000: exit status 85 (297.00769ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   |    Version     |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |          |
	|         | -p download-only-255000        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=hyperkit              |                      |         |                |                     |          |
	| start   | -o=json --download-only        | download-only-255000 | jenkins | v1.32.0-beta.0 | 30 Oct 23 16:03 PDT |          |
	|         | -p download-only-255000        |                      |         |                |                     |          |
	|         | --force --alsologtostderr      |                      |         |                |                     |          |
	|         | --kubernetes-version=v1.28.3   |                      |         |                |                     |          |
	|         | --container-runtime=docker     |                      |         |                |                     |          |
	|         | --driver=hyperkit              |                      |         |                |                     |          |
	|---------|--------------------------------|----------------------|---------|----------------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/10/30 16:03:17
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.21.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1030 16:03:17.999362    1494 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:03:17.999645    1494 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:17.999650    1494 out.go:309] Setting ErrFile to fd 2...
	I1030 16:03:17.999654    1494 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:03:17.999840    1494 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	W1030 16:03:17.999933    1494 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17527-929/.minikube/config/config.json: no such file or directory
	I1030 16:03:18.001360    1494 out.go:303] Setting JSON to true
	I1030 16:03:18.023451    1494 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":173,"bootTime":1698706825,"procs":421,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:03:18.023556    1494 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:03:18.044722    1494 out.go:97] [download-only-255000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:03:18.065502    1494 out.go:169] MINIKUBE_LOCATION=17527
	I1030 16:03:18.044861    1494 notify.go:220] Checking for updates...
	I1030 16:03:18.107564    1494 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:03:18.128421    1494 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:03:18.149457    1494 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:03:18.170596    1494 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	W1030 16:03:18.212414    1494 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1030 16:03:18.213134    1494 config.go:182] Loaded profile config "download-only-255000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W1030 16:03:18.213215    1494 start.go:810] api.Load failed for download-only-255000: filestore "download-only-255000": Docker machine "download-only-255000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 16:03:18.213349    1494 driver.go:378] Setting default libvirt URI to qemu:///system
	W1030 16:03:18.213391    1494 start.go:810] api.Load failed for download-only-255000: filestore "download-only-255000": Docker machine "download-only-255000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I1030 16:03:18.243538    1494 out.go:97] Using the hyperkit driver based on existing profile
	I1030 16:03:18.243629    1494 start.go:298] selected driver: hyperkit
	I1030 16:03:18.243642    1494 start.go:902] validating driver "hyperkit" against &{Name:download-only-255000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuber
netesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-255000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro
r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:18.244019    1494 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:18.244182    1494 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17527-929/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I1030 16:03:18.253714    1494 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0-beta.0
	I1030 16:03:18.257718    1494 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:03:18.257744    1494 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I1030 16:03:18.260556    1494 cni.go:84] Creating CNI manager for ""
	I1030 16:03:18.260590    1494 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I1030 16:03:18.260602    1494 start_flags.go:323] config:
	{Name:download-only-255000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:download-only-255000 Namespace:
default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketV
MnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:03:18.260746    1494 iso.go:125] acquiring lock: {Name:mk40805ad643ddf42624ec33aed5def0b4b08495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1030 16:03:18.281494    1494 out.go:97] Starting control plane node download-only-255000 in cluster download-only-255000
	I1030 16:03:18.281524    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:18.332173    1494 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:03:18.332214    1494 cache.go:56] Caching tarball of preloaded images
	I1030 16:03:18.332610    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:18.356149    1494 out.go:97] Downloading Kubernetes v1.28.3 preload ...
	I1030 16:03:18.356193    1494 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:18.433566    1494 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.3/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4?checksum=md5:82104bbf889ff8b69d5c141ce86c05ac -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4
	I1030 16:03:24.132818    1494 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:24.133030    1494 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17527-929/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 ...
	I1030 16:03:24.744561    1494 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.3 on docker
	I1030 16:03:24.744665    1494 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17527-929/.minikube/profiles/download-only-255000/config.json ...
	I1030 16:03:24.745082    1494 preload.go:132] Checking if preload exists for k8s version v1.28.3 and runtime docker
	I1030 16:03:24.745337    1494 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl
	I1030 16:03:25.233587    1494 out.go:169] 
	W1030 16:03:25.255356    1494 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.3/bin/darwin/amd64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/17527-929/.minikube/cache/darwin/amd64/v1.28.3/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540 0x51be540] Decompressors:map[bz2:0xc00091b220 gz:0xc00091b228 tar:0xc00091b1d0 tar.bz2:0xc00091b1e0 tar.gz:0xc00091b1f0 tar.xz:0xc00091b200 tar.zst:0xc00091b210 tbz2:0xc00091b1e0 tgz:0xc00091b1f0 txz:0xc00091b200 tzst:0xc00091b210 xz:0xc00091b230 zip:0xc00091b240 zst:0xc00091b238] Getters:map[file:0xc00094a3c0 http:0xc0004e20f0 https:0xc0004e2280] Dir:false ProgressListener:<nil> Insecure:false Disabl
eSymlinks:false Options:[]}: bad response code: 404
	W1030 16:03:25.255399    1494 out_reason.go:110] 
	W1030 16:03:25.278512    1494 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                           │
	│    If the above advice does not help, please let us know:                                 │
	│    https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                           │
	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                           │
	╰───────────────────────────────────────────────────────────────────────────────────────────╯
	I1030 16:03:25.300325    1494 out.go:169] 
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-255000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:173: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.3/LogsDuration (0.30s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.39s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:190: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.39s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.37s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:202: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-255000
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.37s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.19s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:927: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-690000
addons_test.go:927: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons enable dashboard -p addons-690000: exit status 85 (187.617305ms)

                                                
                                                
-- stdout --
	* Profile "addons-690000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-690000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.19s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.21s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:938: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-690000
addons_test.go:938: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons disable dashboard -p addons-690000: exit status 85 (208.167046ms)

                                                
                                                
-- stdout --
	* Profile "addons-690000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-690000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.21s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (10.22s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2396282798/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2396282798/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2396282798/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting control plane node minikube in cluster minikube
* Download complete!
--- PASS: TestHyperKitDriverInstallOrUpdate (10.22s)

                                                
                                    
x
+
TestErrorSpam/start (1.25s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 start --dry-run
--- PASS: TestErrorSpam/start (1.25s)

                                                
                                    
x
+
TestErrorSpam/status (0.23s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status: exit status 7 (66.039613ms)

                                                
                                                
-- stdout --
	nospam-465000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status: exit status 7 (65.708828ms)

                                                
                                                
-- stdout --
	nospam-465000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status: exit status 7 (101.192229ms)

                                                
                                                
-- stdout --
	nospam-465000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.23s)

                                                
                                    
x
+
TestErrorSpam/pause (0.4s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause: exit status 89 (131.604207ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause" failed: exit status 89
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause: exit status 89 (131.762236ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause" failed: exit status 89
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause: exit status 89 (130.910081ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 pause" failed: exit status 89
--- PASS: TestErrorSpam/pause (0.40s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.39s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause: exit status 89 (131.464412ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause" failed: exit status 89
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause: exit status 89 (131.183451ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause" failed: exit status 89
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause: exit status 89 (131.160419ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p nospam-465000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 unpause" failed: exit status 89
--- PASS: TestErrorSpam/unpause (0.39s)

                                                
                                    
x
+
TestErrorSpam/stop (0.62s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 stop
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-465000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-465000 stop
--- PASS: TestErrorSpam/stop (0.62s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/17527-929/.minikube/files/etc/test/nested/copy/1478/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (2.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.35s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialCacheCmdcacheadd_local384132063/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache add minikube-local-cache-test:functional-621000
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 cache delete minikube-local-cache-test:functional-621000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-621000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.35s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.16s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 config get cpus: exit status 14 (85.358608ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 config get cpus: exit status 14 (55.844531ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.92s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-621000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (482.46683ms)

                                                
                                                
-- stdout --
	* [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:05:16.354232    2152 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:05:16.354419    2152 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:16.354424    2152 out.go:309] Setting ErrFile to fd 2...
	I1030 16:05:16.354429    2152 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:16.354594    2152 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:05:16.355890    2152 out.go:303] Setting JSON to false
	I1030 16:05:16.377409    2152 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":291,"bootTime":1698706825,"procs":418,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:05:16.377502    2152 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:05:16.399852    2152 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 on Darwin 14.1
	I1030 16:05:16.448406    2152 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:05:16.448573    2152 notify.go:220] Checking for updates...
	I1030 16:05:16.470302    2152 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:05:16.492349    2152 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:05:16.514097    2152 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:05:16.535211    2152 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:05:16.556835    2152 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:05:16.580816    2152 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:05:16.581503    2152 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:16.581588    2152 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:16.590493    2152 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49711
	I1030 16:05:16.590846    2152 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:16.591258    2152 main.go:141] libmachine: Using API Version  1
	I1030 16:05:16.591270    2152 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:16.591530    2152 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:16.591647    2152 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:05:16.591829    2152 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:05:16.592064    2152 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:16.592085    2152 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:16.599805    2152 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49713
	I1030 16:05:16.600123    2152 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:16.600481    2152 main.go:141] libmachine: Using API Version  1
	I1030 16:05:16.600497    2152 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:16.600709    2152 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:16.600802    2152 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:05:16.629018    2152 out.go:177] * Using the hyperkit driver based on existing profile
	I1030 16:05:16.671088    2152 start.go:298] selected driver: hyperkit
	I1030 16:05:16.671115    2152 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:
/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:05:16.671300    2152 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:05:16.696979    2152 out.go:177] 
	W1030 16:05:16.717758    2152 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1030 16:05:16.739010    2152 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 
--- PASS: TestFunctional/parallel/DryRun (0.92s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-621000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-621000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (474.463466ms)

                                                
                                                
-- stdout --
	* [functional-621000] minikube v1.32.0-beta.0 sur Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote hyperkit basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1030 16:05:15.871601    2145 out.go:296] Setting OutFile to fd 1 ...
	I1030 16:05:15.871861    2145 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:15.871866    2145 out.go:309] Setting ErrFile to fd 2...
	I1030 16:05:15.871870    2145 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I1030 16:05:15.872045    2145 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17527-929/.minikube/bin
	I1030 16:05:15.873538    2145 out.go:303] Setting JSON to false
	I1030 16:05:15.895580    2145 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":290,"bootTime":1698706825,"procs":416,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W1030 16:05:15.895678    2145 start.go:136] gopshost.Virtualization returned error: not implemented yet
	I1030 16:05:15.917470    2145 out.go:177] * [functional-621000] minikube v1.32.0-beta.0 sur Darwin 14.1
	I1030 16:05:15.960304    2145 out.go:177]   - MINIKUBE_LOCATION=17527
	I1030 16:05:15.960454    2145 notify.go:220] Checking for updates...
	I1030 16:05:15.982279    2145 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	I1030 16:05:16.003935    2145 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I1030 16:05:16.025260    2145 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1030 16:05:16.047472    2145 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	I1030 16:05:16.069141    2145 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1030 16:05:16.092087    2145 config.go:182] Loaded profile config "functional-621000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.3
	I1030 16:05:16.092729    2145 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:16.092815    2145 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:16.101799    2145 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49706
	I1030 16:05:16.102157    2145 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:16.102596    2145 main.go:141] libmachine: Using API Version  1
	I1030 16:05:16.102622    2145 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:16.102886    2145 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:16.102988    2145 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:05:16.103160    2145 driver.go:378] Setting default libvirt URI to qemu:///system
	I1030 16:05:16.103409    2145 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I1030 16:05:16.103434    2145 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I1030 16:05:16.110978    2145 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49708
	I1030 16:05:16.111303    2145 main.go:141] libmachine: () Calling .GetVersion
	I1030 16:05:16.111714    2145 main.go:141] libmachine: Using API Version  1
	I1030 16:05:16.111725    2145 main.go:141] libmachine: () Calling .SetConfigRaw
	I1030 16:05:16.111919    2145 main.go:141] libmachine: () Calling .GetMachineName
	I1030 16:05:16.112023    2145 main.go:141] libmachine: (functional-621000) Calling .DriverName
	I1030 16:05:16.140225    2145 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant
	I1030 16:05:16.182425    2145 start.go:298] selected driver: hyperkit
	I1030 16:05:16.182485    2145 start.go:902] validating driver "hyperkit" against &{Name:functional-621000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17527/minikube-v1.32.0-1698684775-17527-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.41-1698660445-17527@sha256:34cb83e9cb3f0fe3ce8dcb727a873b33aee680fdd682fbcb5c46db345e9f67df Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.3 ClusterName:functional-621000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:
/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
	I1030 16:05:16.182645    2145 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1030 16:05:16.208411    2145 out.go:177] 
	W1030 16:05:16.230362    2145 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1030 16:05:16.252380    2145 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-amd64 license
--- PASS: TestFunctional/parallel/License (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.113517831s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-621000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.23s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image rm gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-621000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 image save --daemon gcr.io/google-containers/addon-resizer:functional-621000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-621000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-darwin-amd64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-darwin-amd64 profile list
functional_test.go:1314: Took "138.482104ms" to run "out/minikube-darwin-amd64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-darwin-amd64 profile list -l
functional_test.go:1328: Took "78.863049ms" to run "out/minikube-darwin-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json
functional_test.go:1365: Took "140.043776ms" to run "out/minikube-darwin-amd64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json --light
functional_test.go:1378: Took "78.688602ms" to run "out/minikube-darwin-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.012036309s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.03s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-amd64 -p functional-621000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.13s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-621000
--- PASS: TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-621000
--- PASS: TestFunctional/delete_my-image_image (0.05s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-621000
--- PASS: TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.2s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-237000 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.20s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 stop -p json-output-624000 --output=json --user=testUser
--- PASS: TestJSONOutput/stop/Command (0.14s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.77s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-error-744000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-error-744000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (387.338236ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"891c4823-201b-4158-8f6c-cdd940bf3219","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-744000] minikube v1.32.0-beta.0 on Darwin 14.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"00c3dbc3-517b-4546-ad1c-23f7f238f296","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17527"}}
	{"specversion":"1.0","id":"f1567eb7-8933-43b0-bc66-e5c7b2aac31b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig"}}
	{"specversion":"1.0","id":"7cb2b59f-7e05-460a-a719-25712855e8bb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"f2fa2d93-e79c-4622-8d69-f352d80f2156","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"da22f378-1e8f-4351-ae99-a3c0ba29cc92","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube"}}
	{"specversion":"1.0","id":"506ef834-88ca-4431-a1df-4d9220d786f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"b10bddc1-60dd-4a84-87db-fffdbcd1426e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-744000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p json-output-error-744000
--- PASS: TestErrorJSONOutput (0.77s)

                                                
                                    
x
+
TestMainNoArgs (0.08s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-amd64
--- PASS: TestMainNoArgs (0.08s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.52s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0-beta.0 on darwin
- MINIKUBE_LOCATION=17527
- KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current632925693/001
* Using the hyperkit driver based on user configuration
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current632925693/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current632925693/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current632925693/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting control plane node minikube in cluster minikube
* Download complete!
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.52s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (5.92s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0-beta.0 on darwin
- MINIKUBE_LOCATION=17527
- KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2396282798/001
* Using the hyperkit driver based on user configuration
* Downloading driver docker-machine-driver-hyperkit:
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (5.92s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.07s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.38s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-128000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit : exit status 14 (384.05758ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-128000] minikube v1.32.0-beta.0 on Darwin 14.1
	  - MINIKUBE_LOCATION=17527
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17527-929/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17527-929/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.38s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.13s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-128000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-128000 "sudo systemctl is-active --quiet service kubelet": exit status 89 (130.938415ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p NoKubernetes-128000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.13s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (0.2s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-128000
--- PASS: TestNoKubernetes/serial/Stop (0.20s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.13s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-128000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-128000 "sudo systemctl is-active --quiet service kubelet": exit status 89 (131.573506ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p NoKubernetes-128000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.13s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (0.57s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p old-k8s-version-295000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (0.57s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-295000 -n old-k8s-version-295000: exit status 7 (74.219183ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p old-k8s-version-295000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.38s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p no-preload-257000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/no-preload/serial/Stop (0.22s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-257000 -n no-preload-257000: exit status 7 (66.11273ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p no-preload-257000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p embed-certs-750000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/embed-certs/serial/Stop (0.26s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-750000 -n embed-certs-750000: exit status 7 (66.306744ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p embed-certs-750000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.31s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p default-k8s-diff-port-376000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (0.26s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-376000 -n default-k8s-diff-port-376000: exit status 7 (69.117438ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p default-k8s-diff-port-376000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.32s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p newest-cni-164000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p newest-cni-164000 --alsologtostderr -v=3
--- PASS: TestStartStop/group/newest-cni/serial/Stop (0.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-164000 -n newest-cni-164000: exit status 7 (66.054583ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p newest-cni-164000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.31s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (21/240)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.3/binaries
aaa_download_only_test.go:139: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:213: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (12.97s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port3944755958/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1698707076716016000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port3944755958/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1698707076716016000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port3944755958/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1698707076716016000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port3944755958/001/test-1698707076716016000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (195.31525ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (140.433902ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (155.402613ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (139.112692ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (137.276719ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (134.588263ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (136.913611ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (135.601018ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo umount -f /mount-9p": exit status 89 (131.913049ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo umount -f /mount-9p\"": exit status 89
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port3944755958/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (12.97s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (13.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdspecific-port3459534226/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (195.013187ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (155.45834ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (134.437916ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (137.318246ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (158.128601ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (154.701703ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (136.915952ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T /mount-9p | grep 9p": exit status 89 (135.175378ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "sudo umount -f /mount-9p": exit status 89 (131.316126ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-amd64 -p functional-621000 ssh \"sudo umount -f /mount-9p\"": exit status 89
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdspecific-port3459534226/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (13.68s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (12.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (279.429804ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (137.484841ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (136.256342ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (154.686085ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (137.847857ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (159.351879ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-621000 ssh "findmnt -T" /mount1: exit status 89 (133.371322ms)

                                                
                                                
-- stdout --
	* The control plane node must be running for this command
	  To start a cluster, run: "minikube start -p functional-621000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-621000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2640456206/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (12.20s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:297: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (5.8s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:523: 
----------------------- debugLogs start: cilium-996000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-996000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-996000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-996000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-996000"

                                                
                                                
----------------------- debugLogs end: cilium-996000 [took: 5.424462429s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-996000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cilium-996000
--- SKIP: TestNetworkPlugins/group/cilium (5.80s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-641000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p disable-driver-mounts-641000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.38s)

                                                
                                    
Copied to clipboard