=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-581000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-581000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (15.313198125s)

-- stdout --

	{"specversion":"1.0","id":"290f20d5-61f5-4564-b62a-5e874a1007d5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-581000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"0cb7ee68-757f-4ba2-9ad1-f7c6117fca32","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19598"}}

	{"specversion":"1.0","id":"d97d4124-d60f-4faa-a35b-3571e01f97c9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig"}}

	{"specversion":"1.0","id":"1f2ec5b0-3566-43a2-a2e2-123a84f9ac75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"e0a8e3f1-2f3e-4e44-9d4f-6815397de259","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"ecc4a4b0-227d-44a9-8c31-bb2818d7d554","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube"}}

	{"specversion":"1.0","id":"8ff9e4dd-4830-4218-b044-160d6cc67b69","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"e7a6b645-1bad-4ff4-af73-0080adb7064d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"59a298bd-9b6d-4dca-965c-9b41a9f002e6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"2bdeec61-712c-4918-adff-81a8c0eabe84","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"3551e7f4-a24d-401c-bad3-3fbf6ece152e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-581000\" primary control-plane node in \"download-only-581000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"d8d2eebf-ae9b-43cc-afbe-392be7f57dc6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"fc830339-6303-459d-ab75-e8a1bc6e547a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19598-1276/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020] Decompressors:map[bz2:0x140007fb700 gz:0x140007fb708 tar:0x140007fb6b0 tar.bz2:0x140007fb6c0 tar.gz:0x140007fb6d0 tar.xz:0x140007fb6e0 tar.zst:0x140007fb6f0 tbz2:0x140007fb6c0 tgz:0x14

0007fb6d0 txz:0x140007fb6e0 tzst:0x140007fb6f0 xz:0x140007fb710 zip:0x140007fb720 zst:0x140007fb718] Getters:map[file:0x14001404650 http:0x140004f8230 https:0x140004f8280] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"197f589e-5d87-40e1-8d98-b09a51cb0c2e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0910 10:28:20.652600    1797 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:28:20.652745    1797 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:28:20.652748    1797 out.go:358] Setting ErrFile to fd 2...

	I0910 10:28:20.652750    1797 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:28:20.652880    1797 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	W0910 10:28:20.652971    1797 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19598-1276/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19598-1276/.minikube/config/config.json: no such file or directory

	I0910 10:28:20.654255    1797 out.go:352] Setting JSON to true

	I0910 10:28:20.671245    1797 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1664,"bootTime":1725987636,"procs":472,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 10:28:20.671321    1797 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 10:28:20.677438    1797 out.go:97] [download-only-581000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 10:28:20.677569    1797 notify.go:220] Checking for updates...

	W0910 10:28:20.677578    1797 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball: no such file or directory

	I0910 10:28:20.681277    1797 out.go:169] MINIKUBE_LOCATION=19598

	I0910 10:28:20.684303    1797 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 10:28:20.689368    1797 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 10:28:20.692302    1797 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 10:28:20.695325    1797 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	W0910 10:28:20.701323    1797 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0910 10:28:20.701516    1797 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 10:28:20.706354    1797 out.go:97] Using the qemu2 driver based on user configuration

	I0910 10:28:20.706377    1797 start.go:297] selected driver: qemu2

	I0910 10:28:20.706381    1797 start.go:901] validating driver "qemu2" against <nil>

	I0910 10:28:20.706461    1797 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 10:28:20.709376    1797 out.go:169] Automatically selected the socket_vmnet network

	I0910 10:28:20.715028    1797 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0910 10:28:20.715118    1797 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0910 10:28:20.715210    1797 cni.go:84] Creating CNI manager for ""

	I0910 10:28:20.715226    1797 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0910 10:28:20.715273    1797 start.go:340] cluster config:

	{Name:download-only-581000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-581000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo

ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 10:28:20.720452    1797 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 10:28:20.725309    1797 out.go:97] Downloading VM boot image ...

	I0910 10:28:20.725322    1797 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso

	I0910 10:28:28.936338    1797 out.go:97] Starting "download-only-581000" primary control-plane node in "download-only-581000" cluster

	I0910 10:28:28.936358    1797 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0910 10:28:28.996348    1797 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0910 10:28:28.996356    1797 cache.go:56] Caching tarball of preloaded images

	I0910 10:28:28.996507    1797 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0910 10:28:29.001634    1797 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I0910 10:28:29.001641    1797 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0910 10:28:29.077377    1797 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0910 10:28:34.604768    1797 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0910 10:28:34.604933    1797 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0910 10:28:35.300660    1797 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I0910 10:28:35.300865    1797 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/download-only-581000/config.json ...

	I0910 10:28:35.300882    1797 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/download-only-581000/config.json: {Name:mk0d9555d9ba472361af6b5a19e01c658b692478 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:28:35.301105    1797 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0910 10:28:35.301311    1797 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I0910 10:28:35.885001    1797 out.go:193] 

	W0910 10:28:35.890735    1797 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19598-1276/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020 0x108d9c020] Decompressors:map[bz2:0x140007fb700 gz:0x140007fb708 tar:0x140007fb6b0 tar.bz2:0x140007fb6c0 tar.gz:0x140007fb6d0 tar.xz:0x140007fb6e0 tar.zst:0x140007fb6f0 tbz2:0x140007fb6c0 tgz:0x140007fb6d0 txz:0x140007fb6e0 tzst:0x140007fb6f0 xz:0x140007fb710 zip:0x140007fb720 zst:0x140007fb718] Getters:map[file:0x14001404650 http:0x140004f8230 https:0x140004f8280] Dir:false ProgressList

ener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0910 10:28:35.890768    1797 out_reason.go:110] 

	W0910 10:28:35.901860    1797 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 10:28:35.906807    1797 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-581000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (15.31s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19598-1276/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-249000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-249000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.932551958s)

-- stdout --

	* [offline-docker-249000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-249000" primary control-plane node in "offline-docker-249000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-249000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:06:18.048063    4907 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:06:18.048212    4907 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:18.048215    4907 out.go:358] Setting ErrFile to fd 2...

	I0910 11:06:18.048225    4907 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:18.048369    4907 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:06:18.049488    4907 out.go:352] Setting JSON to false

	I0910 11:06:18.067006    4907 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3942,"bootTime":1725987636,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:06:18.067089    4907 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:06:18.071368    4907 out.go:177] * [offline-docker-249000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:06:18.079314    4907 notify.go:220] Checking for updates...

	I0910 11:06:18.084304    4907 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:06:18.087326    4907 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:06:18.090241    4907 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:06:18.094277    4907 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:06:18.097198    4907 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:06:18.100262    4907 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:06:18.103597    4907 config.go:182] Loaded profile config "multinode-416000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:18.103658    4907 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:06:18.107207    4907 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 11:06:18.114233    4907 start.go:297] selected driver: qemu2

	I0910 11:06:18.114244    4907 start.go:901] validating driver "qemu2" against <nil>

	I0910 11:06:18.114252    4907 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:06:18.116374    4907 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 11:06:18.119230    4907 out.go:177] * Automatically selected the socket_vmnet network

	I0910 11:06:18.122312    4907 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 11:06:18.122329    4907 cni.go:84] Creating CNI manager for ""

	I0910 11:06:18.122335    4907 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 11:06:18.122339    4907 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0910 11:06:18.122368    4907 start.go:340] cluster config:

	{Name:offline-docker-249000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-249000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi

n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:06:18.126225    4907 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:06:18.133241    4907 out.go:177] * Starting "offline-docker-249000" primary control-plane node in "offline-docker-249000" cluster

	I0910 11:06:18.137227    4907 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:06:18.137264    4907 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:06:18.137275    4907 cache.go:56] Caching tarball of preloaded images

	I0910 11:06:18.137359    4907 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:06:18.137365    4907 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:06:18.137433    4907 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/offline-docker-249000/config.json ...

	I0910 11:06:18.137443    4907 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/offline-docker-249000/config.json: {Name:mk8ae5f475f0694d4ad10c60cc496729c85a3e10 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 11:06:18.137679    4907 start.go:360] acquireMachinesLock for offline-docker-249000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:18.137710    4907 start.go:364] duration metric: took 24.708µs to acquireMachinesLock for "offline-docker-249000"

	I0910 11:06:18.137721    4907 start.go:93] Provisioning new machine with config: &{Name:offline-docker-249000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-249000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:18.137769    4907 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:18.146285    4907 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:18.162448    4907 start.go:159] libmachine.API.Create for "offline-docker-249000" (driver="qemu2")

	I0910 11:06:18.162473    4907 client.go:168] LocalClient.Create starting

	I0910 11:06:18.162557    4907 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:18.162587    4907 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:18.162594    4907 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:18.162635    4907 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:18.162661    4907 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:18.162674    4907 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:18.163057    4907 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:18.322082    4907 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:18.502322    4907 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:18.502333    4907 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:18.505909    4907 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:18.522885    4907 main.go:141] libmachine: STDOUT: 

	I0910 11:06:18.522914    4907 main.go:141] libmachine: STDERR: 

	I0910 11:06:18.522985    4907 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2 +20000M

	I0910 11:06:18.533960    4907 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:18.533991    4907 main.go:141] libmachine: STDERR: 

	I0910 11:06:18.534028    4907 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:18.534036    4907 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:18.534049    4907 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:18.534091    4907 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/qemu.pid -device virtio-net-pci,netdev=net0,mac=86:4b:12:d0:9d:38 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:18.536228    4907 main.go:141] libmachine: STDOUT: 

	I0910 11:06:18.536249    4907 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:18.536268    4907 client.go:171] duration metric: took 373.800167ms to LocalClient.Create

	I0910 11:06:20.538426    4907 start.go:128] duration metric: took 2.400697166s to createHost

	I0910 11:06:20.538454    4907 start.go:83] releasing machines lock for "offline-docker-249000", held for 2.400803459s

	W0910 11:06:20.538481    4907 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:20.565832    4907 out.go:177] * Deleting "offline-docker-249000" in qemu2 ...

	W0910 11:06:20.586066    4907 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:20.586078    4907 start.go:729] Will try again in 5 seconds ...

	I0910 11:06:25.588022    4907 start.go:360] acquireMachinesLock for offline-docker-249000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:25.588140    4907 start.go:364] duration metric: took 93.666µs to acquireMachinesLock for "offline-docker-249000"

	I0910 11:06:25.588175    4907 start.go:93] Provisioning new machine with config: &{Name:offline-docker-249000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-249000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:25.588259    4907 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:25.601705    4907 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:25.617516    4907 start.go:159] libmachine.API.Create for "offline-docker-249000" (driver="qemu2")

	I0910 11:06:25.617542    4907 client.go:168] LocalClient.Create starting

	I0910 11:06:25.617603    4907 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:25.617637    4907 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:25.617646    4907 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:25.617679    4907 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:25.617702    4907 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:25.617709    4907 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:25.617978    4907 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:25.770887    4907 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:25.888479    4907 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:25.888486    4907 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:25.888699    4907 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:25.898059    4907 main.go:141] libmachine: STDOUT: 

	I0910 11:06:25.898091    4907 main.go:141] libmachine: STDERR: 

	I0910 11:06:25.898149    4907 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2 +20000M

	I0910 11:06:25.906216    4907 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:25.906233    4907 main.go:141] libmachine: STDERR: 

	I0910 11:06:25.906245    4907 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:25.906249    4907 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:25.906260    4907 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:25.906282    4907 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:7c:19:c3:7c:9d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/offline-docker-249000/disk.qcow2

	I0910 11:06:25.907844    4907 main.go:141] libmachine: STDOUT: 

	I0910 11:06:25.907860    4907 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:25.907872    4907 client.go:171] duration metric: took 290.335583ms to LocalClient.Create

	I0910 11:06:27.910047    4907 start.go:128] duration metric: took 2.32181025s to createHost

	I0910 11:06:27.910125    4907 start.go:83] releasing machines lock for "offline-docker-249000", held for 2.322035s

	W0910 11:06:27.910593    4907 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-249000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-249000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:27.919244    4907 out.go:201] 

	W0910 11:06:27.924320    4907 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:06:27.924353    4907 out.go:270] * 

	* 

	W0910 11:06:27.927234    4907 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:06:27.936132    4907 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-249000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:626: *** TestOffline FAILED at 2024-09-10 11:06:27.952345 -0700 PDT m=+2287.414444335

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-249000 -n offline-docker-249000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-249000 -n offline-docker-249000: exit status 7 (67.697334ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-249000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-249000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-249000

--- FAIL: TestOffline (10.09s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:332: registry stabilized in 1.253625ms

addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-66c9cd494c-qb2rh" [d1e5edb1-7803-4933-a00b-4e3f52088cd3] Running

addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.011888625s

addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-g9hh4" [ba9d217c-a23d-45ff-985a-a5b541ecc35a] Running

addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.011477333s

addons_test.go:342: (dbg) Run:  kubectl --context addons-592000 delete po -l run=registry-test --now

addons_test.go:347: (dbg) Run:  kubectl --context addons-592000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-592000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.053822791s)

-- stdout --

	pod "registry-test" deleted

-- /stdout --

** stderr ** 

	error: timed out waiting for the condition

** /stderr **

addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-592000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1

addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted

*

addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-592000 ip

2024/09/10 10:41:56 [DEBUG] GET http://192.168.105.2:5000

addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-592000 addons disable registry --alsologtostderr -v=1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-592000 -n addons-592000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-592000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only              | download-only-581000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT |                     |

	|         | -p download-only-581000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| delete  | -p download-only-581000              | download-only-581000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| start   | -o=json --download-only              | download-only-266000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT |                     |

	|         | -p download-only-266000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| delete  | -p download-only-266000              | download-only-266000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| delete  | -p download-only-581000              | download-only-581000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| delete  | -p download-only-266000              | download-only-266000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| start   | --download-only -p                   | binary-mirror-025000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT |                     |

	|         | binary-mirror-025000                 |                      |         |         |                     |                     |

	|         | --alsologtostderr                    |                      |         |         |                     |                     |

	|         | --binary-mirror                      |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49313               |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-025000              | binary-mirror-025000 | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:28 PDT |

	| addons  | disable dashboard -p                 | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT |                     |

	|         | addons-592000                        |                      |         |         |                     |                     |

	| addons  | enable dashboard -p                  | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT |                     |

	|         | addons-592000                        |                      |         |         |                     |                     |

	| start   | -p addons-592000 --wait=true         | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:28 PDT | 10 Sep 24 10:32 PDT |

	|         | --memory=4000 --alsologtostderr      |                      |         |         |                     |                     |

	|         | --addons=registry                    |                      |         |         |                     |                     |

	|         | --addons=metrics-server              |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots             |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver         |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                    |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner               |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget            |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher |                      |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin        |                      |         |         |                     |                     |

	|         | --addons=yakd --addons=volcano       |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress     |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                 |                      |         |         |                     |                     |

	| addons  | addons-592000 addons disable         | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:32 PDT | 10 Sep 24 10:32 PDT |

	|         | volcano --alsologtostderr -v=1       |                      |         |         |                     |                     |

	| addons  | addons-592000 addons                 | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:41 PDT | 10 Sep 24 10:41 PDT |

	|         | disable csi-hostpath-driver          |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-592000 addons                 | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:41 PDT | 10 Sep 24 10:41 PDT |

	|         | disable volumesnapshots              |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-592000 addons                 | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:41 PDT | 10 Sep 24 10:41 PDT |

	|         | disable metrics-server               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| ip      | addons-592000 ip                     | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:41 PDT | 10 Sep 24 10:41 PDT |

	| addons  | addons-592000 addons disable         | addons-592000        | jenkins | v1.34.0 | 10 Sep 24 10:41 PDT | 10 Sep 24 10:41 PDT |

	|         | registry --alsologtostderr           |                      |         |         |                     |                     |

	|         | -v=1                                 |                      |         |         |                     |                     |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/10 10:28:45

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0910 10:28:45.693155    1875 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:28:45.693283    1875 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:28:45.693287    1875 out.go:358] Setting ErrFile to fd 2...

	I0910 10:28:45.693289    1875 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:28:45.693421    1875 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 10:28:45.694452    1875 out.go:352] Setting JSON to false

	I0910 10:28:45.710674    1875 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1689,"bootTime":1725987636,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 10:28:45.710740    1875 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 10:28:45.716195    1875 out.go:177] * [addons-592000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 10:28:45.723155    1875 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 10:28:45.723217    1875 notify.go:220] Checking for updates...

	I0910 10:28:45.730169    1875 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 10:28:45.733187    1875 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 10:28:45.736130    1875 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 10:28:45.737611    1875 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 10:28:45.741132    1875 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 10:28:45.744378    1875 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 10:28:45.748011    1875 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 10:28:45.755137    1875 start.go:297] selected driver: qemu2

	I0910 10:28:45.755143    1875 start.go:901] validating driver "qemu2" against <nil>

	I0910 10:28:45.755151    1875 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 10:28:45.757477    1875 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 10:28:45.760196    1875 out.go:177] * Automatically selected the socket_vmnet network

	I0910 10:28:45.763176    1875 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 10:28:45.763213    1875 cni.go:84] Creating CNI manager for ""

	I0910 10:28:45.763221    1875 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 10:28:45.763228    1875 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0910 10:28:45.763256    1875 start.go:340] cluster config:

	{Name:addons-592000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-592000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c

lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 10:28:45.766946    1875 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 10:28:45.774154    1875 out.go:177] * Starting "addons-592000" primary control-plane node in "addons-592000" cluster

	I0910 10:28:45.778146    1875 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 10:28:45.778164    1875 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 10:28:45.778172    1875 cache.go:56] Caching tarball of preloaded images

	I0910 10:28:45.778247    1875 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 10:28:45.778258    1875 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 10:28:45.778488    1875 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/config.json ...

	I0910 10:28:45.778502    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/config.json: {Name:mk87e5e9c33c7acb2edbaba9065788eced1fe537 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:28:45.778927    1875 start.go:360] acquireMachinesLock for addons-592000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 10:28:45.778993    1875 start.go:364] duration metric: took 60.334µs to acquireMachinesLock for "addons-592000"

	I0910 10:28:45.779006    1875 start.go:93] Provisioning new machine with config: &{Name:addons-592000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.0 ClusterName:addons-592000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 10:28:45.779036    1875 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 10:28:45.782128    1875 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0910 10:28:46.581661    1875 start.go:159] libmachine.API.Create for "addons-592000" (driver="qemu2")

	I0910 10:28:46.581686    1875 client.go:168] LocalClient.Create starting

	I0910 10:28:46.581845    1875 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 10:28:46.707568    1875 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 10:28:46.788559    1875 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 10:28:47.080203    1875 main.go:141] libmachine: Creating SSH key...

	I0910 10:28:47.229169    1875 main.go:141] libmachine: Creating Disk image...

	I0910 10:28:47.229175    1875 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 10:28:47.229504    1875 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2

	I0910 10:28:47.249001    1875 main.go:141] libmachine: STDOUT: 

	I0910 10:28:47.249028    1875 main.go:141] libmachine: STDERR: 

	I0910 10:28:47.249083    1875 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2 +20000M

	I0910 10:28:47.257192    1875 main.go:141] libmachine: STDOUT: Image resized.

	I0910 10:28:47.257208    1875 main.go:141] libmachine: STDERR: 

	I0910 10:28:47.257224    1875 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2

	I0910 10:28:47.257228    1875 main.go:141] libmachine: Starting QEMU VM...

	I0910 10:28:47.257269    1875 qemu.go:418] Using hvf for hardware acceleration

	I0910 10:28:47.257293    1875 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0e:45:b2:e1:c9:a0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/disk.qcow2

	I0910 10:28:47.315476    1875 main.go:141] libmachine: STDOUT: 

	I0910 10:28:47.315506    1875 main.go:141] libmachine: STDERR: 

	I0910 10:28:47.315510    1875 main.go:141] libmachine: Attempt 0

	I0910 10:28:47.315532    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:47.315600    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:47.315617    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:49.317748    1875 main.go:141] libmachine: Attempt 1

	I0910 10:28:49.317916    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:49.318270    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:49.318321    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:51.320492    1875 main.go:141] libmachine: Attempt 2

	I0910 10:28:51.320584    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:51.321010    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:51.321062    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:53.323214    1875 main.go:141] libmachine: Attempt 3

	I0910 10:28:53.323245    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:53.323347    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:53.323396    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:55.325378    1875 main.go:141] libmachine: Attempt 4

	I0910 10:28:55.325391    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:55.325432    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:55.325448    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:57.327419    1875 main.go:141] libmachine: Attempt 5

	I0910 10:28:57.327431    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:57.327535    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:57.327561    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:28:59.329559    1875 main.go:141] libmachine: Attempt 6

	I0910 10:28:59.329581    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:28:59.329661    1875 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0910 10:28:59.329670    1875 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e1d328}

	I0910 10:29:01.330677    1875 main.go:141] libmachine: Attempt 7

	I0910 10:29:01.330697    1875 main.go:141] libmachine: Searching for e:45:b2:e1:c9:a0 in /var/db/dhcpd_leases ...

	I0910 10:29:01.330826    1875 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I0910 10:29:01.330838    1875 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:e:45:b2:e1:c9:a0 ID:1,e:45:b2:e1:c9:a0 Lease:0x66e1d35b}

	I0910 10:29:01.330840    1875 main.go:141] libmachine: Found match: e:45:b2:e1:c9:a0

	I0910 10:29:01.330849    1875 main.go:141] libmachine: IP: 192.168.105.2

	I0910 10:29:01.330854    1875 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0910 10:29:03.352045    1875 machine.go:93] provisionDockerMachine start ...

	I0910 10:29:03.353615    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.354144    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.354161    1875 main.go:141] libmachine: About to run SSH command:

	hostname

	I0910 10:29:03.418174    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0910 10:29:03.418202    1875 buildroot.go:166] provisioning hostname "addons-592000"

	I0910 10:29:03.418352    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.418592    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.418601    1875 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-592000 && echo "addons-592000" | sudo tee /etc/hostname

	I0910 10:29:03.475785    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-592000

	I0910 10:29:03.475841    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.475984    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.475994    1875 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-592000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-592000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-592000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0910 10:29:03.523940    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0910 10:29:03.523952    1875 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19598-1276/.minikube CaCertPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19598-1276/.minikube}

	I0910 10:29:03.523964    1875 buildroot.go:174] setting up certificates

	I0910 10:29:03.523972    1875 provision.go:84] configureAuth start

	I0910 10:29:03.523975    1875 provision.go:143] copyHostCerts

	I0910 10:29:03.524070    1875 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.pem (1078 bytes)

	I0910 10:29:03.524310    1875 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19598-1276/.minikube/cert.pem (1123 bytes)

	I0910 10:29:03.524442    1875 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19598-1276/.minikube/key.pem (1675 bytes)

	I0910 10:29:03.524536    1875 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca-key.pem org=jenkins.addons-592000 san=[127.0.0.1 192.168.105.2 addons-592000 localhost minikube]

	I0910 10:29:03.637245    1875 provision.go:177] copyRemoteCerts

	I0910 10:29:03.637300    1875 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0910 10:29:03.637318    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:03.660294    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0910 10:29:03.668596    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0910 10:29:03.676815    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0910 10:29:03.685077    1875 provision.go:87] duration metric: took 161.105792ms to configureAuth

	I0910 10:29:03.685086    1875 buildroot.go:189] setting minikube options for container-runtime

	I0910 10:29:03.685184    1875 config.go:182] Loaded profile config "addons-592000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:29:03.685223    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.685310    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.685315    1875 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0910 10:29:03.728467    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0910 10:29:03.728475    1875 buildroot.go:70] root file system type: tmpfs

	I0910 10:29:03.728532    1875 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0910 10:29:03.728579    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.728688    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.728722    1875 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0910 10:29:03.777660    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0910 10:29:03.777704    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:03.777808    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:03.777816    1875 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0910 10:29:05.144782    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0910 10:29:05.144796    1875 machine.go:96] duration metric: took 1.792778542s to provisionDockerMachine

	I0910 10:29:05.144802    1875 client.go:171] duration metric: took 18.563708542s to LocalClient.Create

	I0910 10:29:05.144814    1875 start.go:167] duration metric: took 18.56375375s to libmachine.API.Create "addons-592000"

	I0910 10:29:05.144818    1875 start.go:293] postStartSetup for "addons-592000" (driver="qemu2")

	I0910 10:29:05.144824    1875 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0910 10:29:05.144891    1875 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0910 10:29:05.144901    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:05.168464    1875 ssh_runner.go:195] Run: cat /etc/os-release

	I0910 10:29:05.170060    1875 info.go:137] Remote host: Buildroot 2023.02.9

	I0910 10:29:05.170069    1875 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19598-1276/.minikube/addons for local assets ...

	I0910 10:29:05.170158    1875 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19598-1276/.minikube/files for local assets ...

	I0910 10:29:05.170189    1875 start.go:296] duration metric: took 25.369208ms for postStartSetup

	I0910 10:29:05.170565    1875 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/config.json ...

	I0910 10:29:05.170749    1875 start.go:128] duration metric: took 19.3923325s to createHost

	I0910 10:29:05.170775    1875 main.go:141] libmachine: Using SSH client type: native

	I0910 10:29:05.170916    1875 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100547ba0] 0x10054a400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0910 10:29:05.170920    1875 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0910 10:29:05.215407    1875 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725989344.976501419

	I0910 10:29:05.215418    1875 fix.go:216] guest clock: 1725989344.976501419

	I0910 10:29:05.215422    1875 fix.go:229] Guest: 2024-09-10 10:29:04.976501419 -0700 PDT Remote: 2024-09-10 10:29:05.170752 -0700 PDT m=+19.497155668 (delta=-194.250581ms)

	I0910 10:29:05.215433    1875 fix.go:200] guest clock delta is within tolerance: -194.250581ms

	I0910 10:29:05.215436    1875 start.go:83] releasing machines lock for "addons-592000", held for 19.437062166s

	I0910 10:29:05.215764    1875 ssh_runner.go:195] Run: cat /version.json

	I0910 10:29:05.215774    1875 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0910 10:29:05.215773    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:05.215799    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:05.283675    1875 ssh_runner.go:195] Run: systemctl --version

	I0910 10:29:05.286062    1875 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0910 10:29:05.288100    1875 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0910 10:29:05.288124    1875 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0910 10:29:05.294295    1875 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0910 10:29:05.294303    1875 start.go:495] detecting cgroup driver to use...

	I0910 10:29:05.294420    1875 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0910 10:29:05.300899    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0910 10:29:05.304286    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0910 10:29:05.308025    1875 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0910 10:29:05.308049    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0910 10:29:05.311727    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0910 10:29:05.315637    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0910 10:29:05.319435    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0910 10:29:05.323299    1875 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0910 10:29:05.327310    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0910 10:29:05.331272    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0910 10:29:05.335328    1875 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0910 10:29:05.339376    1875 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0910 10:29:05.343093    1875 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0910 10:29:05.346942    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:05.430139    1875 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0910 10:29:05.437086    1875 start.go:495] detecting cgroup driver to use...

	I0910 10:29:05.437158    1875 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0910 10:29:05.445022    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0910 10:29:05.452202    1875 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0910 10:29:05.458971    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0910 10:29:05.464729    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0910 10:29:05.469729    1875 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0910 10:29:05.513701    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0910 10:29:05.519826    1875 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0910 10:29:05.526422    1875 ssh_runner.go:195] Run: which cri-dockerd

	I0910 10:29:05.527805    1875 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0910 10:29:05.531274    1875 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0910 10:29:05.537184    1875 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0910 10:29:05.617146    1875 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0910 10:29:05.697824    1875 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0910 10:29:05.697887    1875 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0910 10:29:05.703892    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:05.784342    1875 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0910 10:29:07.968861    1875 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.1845685s)

	I0910 10:29:07.968938    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0910 10:29:07.974357    1875 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0910 10:29:07.981366    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0910 10:29:07.986804    1875 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0910 10:29:08.070183    1875 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0910 10:29:08.167023    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:08.249736    1875 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0910 10:29:08.256552    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0910 10:29:08.261771    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:08.346509    1875 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0910 10:29:08.372514    1875 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0910 10:29:08.372631    1875 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0910 10:29:08.374874    1875 start.go:563] Will wait 60s for crictl version

	I0910 10:29:08.374917    1875 ssh_runner.go:195] Run: which crictl

	I0910 10:29:08.376398    1875 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0910 10:29:08.394745    1875 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.2.0

	RuntimeApiVersion:  v1

	I0910 10:29:08.394816    1875 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0910 10:29:08.406266    1875 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0910 10:29:08.423595    1875 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.2.0 ...

	I0910 10:29:08.423739    1875 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0910 10:29:08.425520    1875 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0910 10:29:08.429979    1875 kubeadm.go:883] updating cluster {Name:addons-592000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.0 ClusterName:addons-592000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort

:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0910 10:29:08.430030    1875 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 10:29:08.430073    1875 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0910 10:29:08.435068    1875 docker.go:685] Got preloaded images: 

	I0910 10:29:08.435078    1875 docker.go:691] registry.k8s.io/kube-apiserver:v1.31.0 wasn't preloaded

	I0910 10:29:08.435114    1875 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0910 10:29:08.438873    1875 ssh_runner.go:195] Run: which lz4

	I0910 10:29:08.440318    1875 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0910 10:29:08.441769    1875 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0910 10:29:08.441781    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (322549298 bytes)

	I0910 10:29:09.694769    1875 docker.go:649] duration metric: took 1.254526542s to copy over tarball

	I0910 10:29:09.694840    1875 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0910 10:29:10.678670    1875 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0910 10:29:10.693909    1875 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0910 10:29:10.697900    1875 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)

	I0910 10:29:10.703646    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:10.790245    1875 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0910 10:29:13.014626    1875 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.224432833s)

	I0910 10:29:13.014735    1875 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0910 10:29:13.021237    1875 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0910 10:29:13.021251    1875 cache_images.go:84] Images are preloaded, skipping loading

	I0910 10:29:13.021256    1875 kubeadm.go:934] updating node { 192.168.105.2 8443 v1.31.0 docker true true} ...

	I0910 10:29:13.021321    1875 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-592000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:addons-592000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0910 10:29:13.021383    1875 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0910 10:29:13.042870    1875 cni.go:84] Creating CNI manager for ""

	I0910 10:29:13.042884    1875 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 10:29:13.042888    1875 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0910 10:29:13.042898    1875 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-592000 NodeName:addons-592000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0910 10:29:13.042956    1875 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-592000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0910 10:29:13.043006    1875 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0910 10:29:13.047075    1875 binaries.go:44] Found k8s binaries, skipping transfer

	I0910 10:29:13.047102    1875 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0910 10:29:13.050802    1875 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0910 10:29:13.056441    1875 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0910 10:29:13.062303    1875 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0910 10:29:13.068551    1875 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0910 10:29:13.069957    1875 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0910 10:29:13.074192    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:13.154629    1875 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0910 10:29:13.161446    1875 certs.go:68] Setting up /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000 for IP: 192.168.105.2

	I0910 10:29:13.161465    1875 certs.go:194] generating shared ca certs ...

	I0910 10:29:13.161476    1875 certs.go:226] acquiring lock for ca certs: {Name:mk5b237e8da18ff05d2622f0be5a14dbe0d9b4f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.161649    1875 certs.go:240] generating "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.key

	I0910 10:29:13.263897    1875 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.crt ...

	I0910 10:29:13.263907    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.crt: {Name:mkd39bb2339b56e696cde1c2228697a7fee6c743 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.264213    1875 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.key ...

	I0910 10:29:13.264218    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.key: {Name:mk219de00d005948feef2cf1f0925d643ba417cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.264347    1875 certs.go:240] generating "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.key

	I0910 10:29:13.455808    1875 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.crt ...

	I0910 10:29:13.455817    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.crt: {Name:mkf2cce791861831a4bc24fcb04522b1b5874c5f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.455997    1875 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.key ...

	I0910 10:29:13.456001    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.key: {Name:mk1f9ba151bf80535c9ea2645d742d7b3e4744f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.456165    1875 certs.go:256] generating profile certs ...

	I0910 10:29:13.456214    1875 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.key

	I0910 10:29:13.456221    1875 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt with IP's: []

	I0910 10:29:13.536593    1875 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt ...

	I0910 10:29:13.536602    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt: {Name:mkfa8e28994e8092488ddd9780811f518fc5e161 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.536839    1875 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.key ...

	I0910 10:29:13.536846    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.key: {Name:mke1771ae08dcf943b5f9c9216b7f1ac96c469f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.536977    1875 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key.eb53f3ee

	I0910 10:29:13.536990    1875 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt.eb53f3ee with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.105.2]

	I0910 10:29:13.693495    1875 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt.eb53f3ee ...

	I0910 10:29:13.693500    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt.eb53f3ee: {Name:mkf3c725a80df3045b8a156a0852d1b94b4b48d7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.693658    1875 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key.eb53f3ee ...

	I0910 10:29:13.693662    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key.eb53f3ee: {Name:mke9373159797bf03c0e864c179b0fd670adc4b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.693788    1875 certs.go:381] copying /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt.eb53f3ee -> /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt

	I0910 10:29:13.693894    1875 certs.go:385] copying /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key.eb53f3ee -> /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key

	I0910 10:29:13.693988    1875 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.key

	I0910 10:29:13.693999    1875 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.crt with IP's: []

	I0910 10:29:13.759179    1875 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.crt ...

	I0910 10:29:13.759183    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.crt: {Name:mkaace6fa55aba2bf4801f67f833a141bb8bf43d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.759326    1875 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.key ...

	I0910 10:29:13.759329    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.key: {Name:mk283f60dd1edc7fbbd58d0e42c4323997cc84c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:13.759604    1875 certs.go:484] found cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca-key.pem (1675 bytes)

	I0910 10:29:13.759629    1875 certs.go:484] found cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem (1078 bytes)

	I0910 10:29:13.759650    1875 certs.go:484] found cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem (1123 bytes)

	I0910 10:29:13.759671    1875 certs.go:484] found cert: /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/key.pem (1675 bytes)

	I0910 10:29:13.760196    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0910 10:29:13.769313    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0910 10:29:13.777591    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0910 10:29:13.785744    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0910 10:29:13.794593    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0910 10:29:13.803445    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0910 10:29:13.812115    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0910 10:29:13.825226    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0910 10:29:13.833983    1875 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19598-1276/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0910 10:29:13.842298    1875 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0910 10:29:13.849866    1875 ssh_runner.go:195] Run: openssl version

	I0910 10:29:13.852141    1875 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0910 10:29:13.855894    1875 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0910 10:29:13.857523    1875 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 10 17:29 /usr/share/ca-certificates/minikubeCA.pem

	I0910 10:29:13.857545    1875 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0910 10:29:13.859597    1875 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0910 10:29:13.863492    1875 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0910 10:29:13.865038    1875 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0910 10:29:13.865084    1875 kubeadm.go:392] StartCluster: {Name:addons-592000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0

ClusterName:addons-592000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 10:29:13.865150    1875 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0910 10:29:13.871023    1875 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0910 10:29:13.875058    1875 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0910 10:29:13.878530    1875 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0910 10:29:13.882000    1875 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0910 10:29:13.882005    1875 kubeadm.go:157] found existing configuration files:

	I0910 10:29:13.882028    1875 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0910 10:29:13.885437    1875 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0910 10:29:13.885464    1875 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0910 10:29:13.888624    1875 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0910 10:29:13.891713    1875 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0910 10:29:13.891736    1875 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0910 10:29:13.895212    1875 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0910 10:29:13.898735    1875 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0910 10:29:13.898760    1875 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0910 10:29:13.902333    1875 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0910 10:29:13.905748    1875 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0910 10:29:13.905774    1875 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0910 10:29:13.908867    1875 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0910 10:29:13.930521    1875 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0

	I0910 10:29:13.930552    1875 kubeadm.go:310] [preflight] Running pre-flight checks

	I0910 10:29:13.967016    1875 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0910 10:29:13.967069    1875 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0910 10:29:13.967114    1875 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0910 10:29:13.971365    1875 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0910 10:29:13.991396    1875 out.go:235]   - Generating certificates and keys ...

	I0910 10:29:13.991433    1875 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0910 10:29:13.991480    1875 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0910 10:29:14.120764    1875 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0910 10:29:14.159414    1875 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0910 10:29:14.229495    1875 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0910 10:29:14.434717    1875 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0910 10:29:14.473023    1875 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0910 10:29:14.473087    1875 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-592000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0910 10:29:14.612695    1875 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0910 10:29:14.612768    1875 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-592000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0910 10:29:14.708108    1875 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0910 10:29:14.851201    1875 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0910 10:29:14.943176    1875 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0910 10:29:14.943209    1875 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0910 10:29:15.119708    1875 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0910 10:29:15.228258    1875 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0910 10:29:15.496556    1875 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0910 10:29:15.540057    1875 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0910 10:29:15.577134    1875 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0910 10:29:15.577374    1875 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0910 10:29:15.578543    1875 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0910 10:29:15.582761    1875 out.go:235]   - Booting up control plane ...

	I0910 10:29:15.582809    1875 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0910 10:29:15.582846    1875 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0910 10:29:15.582887    1875 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0910 10:29:15.586154    1875 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0910 10:29:15.588794    1875 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0910 10:29:15.588834    1875 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0910 10:29:15.672333    1875 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0910 10:29:15.672414    1875 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0910 10:29:16.177434    1875 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 504.576875ms

	I0910 10:29:16.177640    1875 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0910 10:29:19.177902    1875 kubeadm.go:310] [api-check] The API server is healthy after 3.001294835s

	I0910 10:29:19.185308    1875 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0910 10:29:19.192126    1875 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0910 10:29:19.199884    1875 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0910 10:29:19.199979    1875 kubeadm.go:310] [mark-control-plane] Marking the node addons-592000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0910 10:29:19.202726    1875 kubeadm.go:310] [bootstrap-token] Using token: xr4i0x.3t39gk90u27t7j6s

	I0910 10:29:19.209329    1875 out.go:235]   - Configuring RBAC rules ...

	I0910 10:29:19.209393    1875 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0910 10:29:19.210326    1875 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0910 10:29:19.217142    1875 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0910 10:29:19.218049    1875 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0910 10:29:19.219102    1875 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0910 10:29:19.220349    1875 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0910 10:29:19.590548    1875 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0910 10:29:20.006707    1875 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0910 10:29:20.585372    1875 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0910 10:29:20.586248    1875 kubeadm.go:310] 

	I0910 10:29:20.586375    1875 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0910 10:29:20.586391    1875 kubeadm.go:310] 

	I0910 10:29:20.586512    1875 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0910 10:29:20.586524    1875 kubeadm.go:310] 

	I0910 10:29:20.586554    1875 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0910 10:29:20.586653    1875 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0910 10:29:20.586723    1875 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0910 10:29:20.586736    1875 kubeadm.go:310] 

	I0910 10:29:20.586812    1875 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0910 10:29:20.586819    1875 kubeadm.go:310] 

	I0910 10:29:20.586882    1875 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0910 10:29:20.586891    1875 kubeadm.go:310] 

	I0910 10:29:20.586959    1875 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0910 10:29:20.587057    1875 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0910 10:29:20.587158    1875 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0910 10:29:20.587172    1875 kubeadm.go:310] 

	I0910 10:29:20.587292    1875 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0910 10:29:20.587403    1875 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0910 10:29:20.587411    1875 kubeadm.go:310] 

	I0910 10:29:20.587553    1875 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token xr4i0x.3t39gk90u27t7j6s \

	I0910 10:29:20.587669    1875 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:fe03b769f4337d7c0adc05ef52c00fad5eef028fab37b5c6cf35794f6ca4bdd0 \

	I0910 10:29:20.587706    1875 kubeadm.go:310] 	--control-plane 

	I0910 10:29:20.587713    1875 kubeadm.go:310] 

	I0910 10:29:20.587832    1875 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0910 10:29:20.587842    1875 kubeadm.go:310] 

	I0910 10:29:20.588010    1875 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token xr4i0x.3t39gk90u27t7j6s \

	I0910 10:29:20.588142    1875 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:fe03b769f4337d7c0adc05ef52c00fad5eef028fab37b5c6cf35794f6ca4bdd0 

	I0910 10:29:20.588564    1875 kubeadm.go:310] W0910 17:29:13.690733    1578 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0910 10:29:20.588980    1875 kubeadm.go:310] W0910 17:29:13.691061    1578 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0910 10:29:20.589118    1875 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0910 10:29:20.589134    1875 cni.go:84] Creating CNI manager for ""

	I0910 10:29:20.589149    1875 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 10:29:20.593465    1875 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0910 10:29:20.595224    1875 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0910 10:29:20.603394    1875 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0910 10:29:20.615194    1875 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0910 10:29:20.615317    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:20.615341    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-592000 minikube.k8s.io/updated_at=2024_09_10T10_29_20_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18 minikube.k8s.io/name=addons-592000 minikube.k8s.io/primary=true

	I0910 10:29:20.629136    1875 ops.go:34] apiserver oom_adj: -16

	I0910 10:29:20.692007    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:21.194188    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:21.694294    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:22.194152    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:22.694109    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:23.194082    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:23.693404    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:24.194060    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:24.694007    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:25.194010    1875 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0910 10:29:25.242015    1875 kubeadm.go:1113] duration metric: took 4.626950333s to wait for elevateKubeSystemPrivileges

	I0910 10:29:25.242031    1875 kubeadm.go:394] duration metric: took 11.377317791s to StartCluster

	I0910 10:29:25.242042    1875 settings.go:142] acquiring lock: {Name:mkc4479acb7c6185024679cd35acf0055f682c3d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:25.242217    1875 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 10:29:25.242409    1875 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/kubeconfig: {Name:mk1f6cc8b92900503b90f69186dd5a0cadd3a95f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 10:29:25.242619    1875 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0910 10:29:25.242652    1875 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 10:29:25.242693    1875 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0910 10:29:25.242768    1875 addons.go:69] Setting yakd=true in profile "addons-592000"

	I0910 10:29:25.242775    1875 addons.go:69] Setting inspektor-gadget=true in profile "addons-592000"

	I0910 10:29:25.242785    1875 addons.go:69] Setting metrics-server=true in profile "addons-592000"

	I0910 10:29:25.242797    1875 addons.go:234] Setting addon inspektor-gadget=true in "addons-592000"

	I0910 10:29:25.242803    1875 addons.go:234] Setting addon metrics-server=true in "addons-592000"

	I0910 10:29:25.242808    1875 config.go:182] Loaded profile config "addons-592000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:29:25.242813    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242814    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242834    1875 addons.go:69] Setting cloud-spanner=true in profile "addons-592000"

	I0910 10:29:25.242830    1875 addons.go:69] Setting default-storageclass=true in profile "addons-592000"

	I0910 10:29:25.242839    1875 addons.go:69] Setting ingress-dns=true in profile "addons-592000"

	I0910 10:29:25.242861    1875 addons.go:69] Setting registry=true in profile "addons-592000"

	I0910 10:29:25.242868    1875 addons.go:234] Setting addon registry=true in "addons-592000"

	I0910 10:29:25.242877    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242824    1875 addons.go:69] Setting ingress=true in profile "addons-592000"

	I0910 10:29:25.242846    1875 addons.go:234] Setting addon cloud-spanner=true in "addons-592000"

	I0910 10:29:25.242908    1875 addons.go:234] Setting addon ingress=true in "addons-592000"

	I0910 10:29:25.242917    1875 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-592000"

	I0910 10:29:25.242931    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242947    1875 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-592000"

	I0910 10:29:25.242883    1875 addons.go:234] Setting addon ingress-dns=true in "addons-592000"

	I0910 10:29:25.242987    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242782    1875 addons.go:234] Setting addon yakd=true in "addons-592000"

	I0910 10:29:25.243120    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.243122    1875 retry.go:31] will retry after 1.407518328s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.242895    1875 addons.go:69] Setting volcano=true in profile "addons-592000"

	I0910 10:29:25.243200    1875 addons.go:234] Setting addon volcano=true in "addons-592000"

	I0910 10:29:25.243211    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242848    1875 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-592000"

	I0910 10:29:25.243262    1875 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-592000"

	I0910 10:29:25.243271    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.243330    1875 retry.go:31] will retry after 1.179575214s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.242858    1875 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-592000"

	I0910 10:29:25.243361    1875 retry.go:31] will retry after 629.817274ms: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243357    1875 retry.go:31] will retry after 1.017527547s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243372    1875 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-592000"

	I0910 10:29:25.242855    1875 addons.go:69] Setting storage-provisioner=true in profile "addons-592000"

	I0910 10:29:25.243381    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.243394    1875 addons.go:234] Setting addon storage-provisioner=true in "addons-592000"

	I0910 10:29:25.243418    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.242851    1875 addons.go:69] Setting gcp-auth=true in profile "addons-592000"

	I0910 10:29:25.243475    1875 mustload.go:65] Loading cluster: addons-592000

	I0910 10:29:25.243501    1875 retry.go:31] will retry after 1.301114102s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.242950    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.243549    1875 config.go:182] Loaded profile config "addons-592000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:29:25.243613    1875 retry.go:31] will retry after 529.688491ms: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243614    1875 retry.go:31] will retry after 1.309123471s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243111    1875 addons.go:69] Setting volumesnapshots=true in profile "addons-592000"

	I0910 10:29:25.243624    1875 addons.go:234] Setting addon volumesnapshots=true in "addons-592000"

	I0910 10:29:25.243187    1875 retry.go:31] will retry after 652.966574ms: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.242887    1875 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-592000"

	I0910 10:29:25.243631    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.243682    1875 retry.go:31] will retry after 1.253957797s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243760    1875 retry.go:31] will retry after 744.583065ms: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243803    1875 retry.go:31] will retry after 1.484478212s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243826    1875 retry.go:31] will retry after 1.083326325s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.243865    1875 retry.go:31] will retry after 1.032102827s: connect: dial unix /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/monitor: connect: connection refused

	I0910 10:29:25.246709    1875 out.go:177] * Verifying Kubernetes components...

	I0910 10:29:25.254648    1875 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0

	I0910 10:29:25.257560    1875 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I0910 10:29:25.257611    1875 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0910 10:29:25.261629    1875 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0910 10:29:25.261634    1875 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0910 10:29:25.261641    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.264533    1875 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0910 10:29:25.264538    1875 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0910 10:29:25.264544    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.293827    1875 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0910 10:29:25.359483    1875 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0910 10:29:25.413349    1875 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0910 10:29:25.413359    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0910 10:29:25.420889    1875 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0910 10:29:25.420901    1875 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0910 10:29:25.423989    1875 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0910 10:29:25.423996    1875 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0910 10:29:25.430754    1875 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0910 10:29:25.430763    1875 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0910 10:29:25.436620    1875 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0910 10:29:25.436630    1875 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0910 10:29:25.440454    1875 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0910 10:29:25.440461    1875 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0910 10:29:25.454329    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0910 10:29:25.459326    1875 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0910 10:29:25.459335    1875 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0910 10:29:25.465329    1875 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0910 10:29:25.465339    1875 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0910 10:29:25.487377    1875 start.go:971] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0910 10:29:25.487746    1875 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0910 10:29:25.487755    1875 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0910 10:29:25.488830    1875 node_ready.go:35] waiting up to 6m0s for node "addons-592000" to be "Ready" ...

	I0910 10:29:25.494251    1875 node_ready.go:49] node "addons-592000" has status "Ready":"True"

	I0910 10:29:25.494267    1875 node_ready.go:38] duration metric: took 5.418041ms for node "addons-592000" to be "Ready" ...

	I0910 10:29:25.494271    1875 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0910 10:29:25.508676    1875 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0910 10:29:25.508685    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0910 10:29:25.509381    1875 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:25.531463    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0910 10:29:25.777858    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0910 10:29:25.786816    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0910 10:29:25.793830    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0910 10:29:25.802800    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0910 10:29:25.809783    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0910 10:29:25.815885    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0910 10:29:25.822816    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0910 10:29:25.825770    1875 addons.go:475] Verifying addon metrics-server=true in "addons-592000"

	I0910 10:29:25.828876    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0910 10:29:25.831866    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0910 10:29:25.831876    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0910 10:29:25.831896    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.864567    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0910 10:29:25.864578    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0910 10:29:25.871782    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0910 10:29:25.871798    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0910 10:29:25.874154    1875 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-592000"

	I0910 10:29:25.874172    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.877875    1875 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0910 10:29:25.886801    1875 out.go:177]   - Using image docker.io/busybox:stable

	I0910 10:29:25.891455    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0910 10:29:25.891468    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0910 10:29:25.894003    1875 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0910 10:29:25.894011    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0910 10:29:25.894022    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.901776    1875 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0910 10:29:25.909839    1875 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0910 10:29:25.912762    1875 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0910 10:29:25.916982    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0910 10:29:25.916991    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0910 10:29:25.918935    1875 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0910 10:29:25.918939    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0910 10:29:25.918946    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.925670    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0910 10:29:25.925680    1875 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0910 10:29:25.932716    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0910 10:29:25.932728    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0910 10:29:25.943548    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0910 10:29:25.943558    1875 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0910 10:29:25.947450    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0910 10:29:25.950135    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0910 10:29:25.950142    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0910 10:29:25.959577    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0910 10:29:25.959590    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0910 10:29:25.985993    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0910 10:29:25.986007    1875 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0910 10:29:25.989354    1875 addons.go:234] Setting addon default-storageclass=true in "addons-592000"

	I0910 10:29:25.989373    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:25.989972    1875 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0910 10:29:25.989979    1875 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0910 10:29:25.989985    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:25.990531    1875 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-592000" context rescaled to 1 replicas

	I0910 10:29:25.999760    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0910 10:29:26.018467    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0910 10:29:26.154011    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0910 10:29:26.266887    1875 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0910 10:29:26.270664    1875 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0910 10:29:26.270674    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0910 10:29:26.270684    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.281784    1875 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0910 10:29:26.285812    1875 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0910 10:29:26.285822    1875 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0910 10:29:26.285835    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.331802    1875 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0910 10:29:26.335882    1875 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0910 10:29:26.335891    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0910 10:29:26.335902    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.426770    1875 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0910 10:29:26.429749    1875 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0910 10:29:26.429758    1875 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0910 10:29:26.429770    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.483200    1875 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0910 10:29:26.483211    1875 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0910 10:29:26.496686    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0910 10:29:26.498116    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0910 10:29:26.498356    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:26.518977    1875 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0910 10:29:26.518988    1875 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0910 10:29:26.526875    1875 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0910 10:29:26.526887    1875 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0910 10:29:26.534512    1875 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0910 10:29:26.534527    1875 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0910 10:29:26.542294    1875 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0910 10:29:26.542304    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0910 10:29:26.542935    1875 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0910 10:29:26.542942    1875 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0910 10:29:26.549747    1875 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0

	I0910 10:29:26.560761    1875 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0

	I0910 10:29:26.564834    1875 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0

	I0910 10:29:26.571183    1875 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml

	I0910 10:29:26.571193    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)

	I0910 10:29:26.571203    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.573795    1875 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0910 10:29:26.576851    1875 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0910 10:29:26.576862    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0910 10:29:26.576873    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.581960    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0910 10:29:26.599952    1875 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0910 10:29:26.599964    1875 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0910 10:29:26.655758    1875 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0910 10:29:26.659798    1875 out.go:177]   - Using image docker.io/registry:2.8.3

	I0910 10:29:26.663821    1875 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0910 10:29:26.663829    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0910 10:29:26.663839    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.664106    1875 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0910 10:29:26.664113    1875 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0910 10:29:26.664342    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml

	I0910 10:29:26.675344    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0910 10:29:26.720214    1875 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0910 10:29:26.720224    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0910 10:29:26.733699    1875 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23

	I0910 10:29:26.737652    1875 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0910 10:29:26.737663    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0910 10:29:26.737674    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:26.795471    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0910 10:29:26.962990    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0910 10:29:27.048487    1875 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0910 10:29:27.048501    1875 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0910 10:29:27.137710    1875 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0910 10:29:27.137721    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0910 10:29:27.339548    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0910 10:29:27.513657    1875 pod_ready.go:103] pod "etcd-addons-592000" in "kube-system" namespace has status "Ready":"False"

	I0910 10:29:28.700590    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (2.700902583s)

	I0910 10:29:28.700608    1875 addons.go:475] Verifying addon ingress=true in "addons-592000"

	I0910 10:29:28.706112    1875 out.go:177] * Verifying ingress addon...

	I0910 10:29:28.712472    1875 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0910 10:29:28.715998    1875 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0910 10:29:28.716006    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:29.071090    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (3.0527005s)

	I0910 10:29:29.071109    1875 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-592000"

	I0910 10:29:29.071114    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.917182667s)

	I0910 10:29:29.071234    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (2.573194125s)

	I0910 10:29:29.071252    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.574596s)

	I0910 10:29:29.071276    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.489388292s)

	W0910 10:29:29.071288    1875 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0910 10:29:29.071306    1875 retry.go:31] will retry after 262.491846ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0910 10:29:29.075086    1875 out.go:177] * Verifying csi-hostpath-driver addon...

	I0910 10:29:29.084487    1875 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0910 10:29:29.099461    1875 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0910 10:29:29.099474    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:29.243376    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:29.335941    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0910 10:29:29.539816    1875 pod_ready.go:103] pod "etcd-addons-592000" in "kube-system" namespace has status "Ready":"False"

	I0910 10:29:29.625953    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:29.718347    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:30.013626    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (3.3493785s)

	I0910 10:29:30.013645    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.338396s)

	I0910 10:29:30.013668    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (3.218289375s)

	I0910 10:29:30.013731    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (2.674261083s)

	I0910 10:29:30.013739    1875 addons.go:475] Verifying addon registry=true in "addons-592000"

	I0910 10:29:30.013722    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.050820917s)

	I0910 10:29:30.020049    1875 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-592000 service yakd-dashboard -n yakd-dashboard

	I0910 10:29:30.026027    1875 out.go:177] * Verifying registry addon...

	I0910 10:29:30.033495    1875 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0910 10:29:30.061372    1875 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0910 10:29:30.061380    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:30.184413    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:30.265272    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:30.513603    1875 pod_ready.go:93] pod "etcd-addons-592000" in "kube-system" namespace has status "Ready":"True"

	I0910 10:29:30.513613    1875 pod_ready.go:82] duration metric: took 5.004384459s for pod "etcd-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.513617    1875 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.515962    1875 pod_ready.go:93] pod "kube-apiserver-addons-592000" in "kube-system" namespace has status "Ready":"True"

	I0910 10:29:30.515970    1875 pod_ready.go:82] duration metric: took 2.349875ms for pod "kube-apiserver-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.515976    1875 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.518432    1875 pod_ready.go:93] pod "kube-controller-manager-addons-592000" in "kube-system" namespace has status "Ready":"True"

	I0910 10:29:30.518443    1875 pod_ready.go:82] duration metric: took 2.463958ms for pod "kube-controller-manager-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.518447    1875 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:30.537374    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:30.588684    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:30.716160    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:31.037028    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:31.088502    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:31.217083    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:31.536816    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:31.635489    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:31.718642    1875 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.382757958s)

	I0910 10:29:31.732742    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:32.037046    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:32.088687    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:32.216734    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:32.522772    1875 pod_ready.go:103] pod "kube-scheduler-addons-592000" in "kube-system" namespace has status "Ready":"False"

	I0910 10:29:32.536834    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:32.588494    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:32.715412    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:33.035805    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:33.088266    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:33.216438    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:33.522541    1875 pod_ready.go:93] pod "kube-scheduler-addons-592000" in "kube-system" namespace has status "Ready":"True"

	I0910 10:29:33.522549    1875 pod_ready.go:82] duration metric: took 3.004195125s for pod "kube-scheduler-addons-592000" in "kube-system" namespace to be "Ready" ...

	I0910 10:29:33.522554    1875 pod_ready.go:39] duration metric: took 8.028536166s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0910 10:29:33.522564    1875 api_server.go:52] waiting for apiserver process to appear ...

	I0910 10:29:33.522627    1875 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0910 10:29:33.529662    1875 api_server.go:72] duration metric: took 8.287261125s to wait for apiserver process to appear ...

	I0910 10:29:33.529671    1875 api_server.go:88] waiting for apiserver healthz status ...

	I0910 10:29:33.529678    1875 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0910 10:29:33.532880    1875 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0910 10:29:33.533474    1875 api_server.go:141] control plane version: v1.31.0

	I0910 10:29:33.533480    1875 api_server.go:131] duration metric: took 3.806834ms to wait for apiserver health ...

	I0910 10:29:33.533483    1875 system_pods.go:43] waiting for kube-system pods to appear ...

	I0910 10:29:33.534826    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:33.538593    1875 system_pods.go:59] 17 kube-system pods found

	I0910 10:29:33.538605    1875 system_pods.go:61] "coredns-6f6b679f8f-7gqz8" [2ed6156d-968e-407d-8209-753a386c8d92] Running

	I0910 10:29:33.538623    1875 system_pods.go:61] "csi-hostpath-attacher-0" [3e87549f-5b38-4b5f-a840-f22a17e0b278] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0910 10:29:33.538626    1875 system_pods.go:61] "csi-hostpath-resizer-0" [7a272698-29ab-4821-bd8c-d61c043c577b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0910 10:29:33.538630    1875 system_pods.go:61] "csi-hostpathplugin-mhv2g" [b9701d73-7500-448f-96d4-20dbfeadf277] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0910 10:29:33.538632    1875 system_pods.go:61] "etcd-addons-592000" [75b4543a-5eb5-4136-80d7-20e9823f29e4] Running

	I0910 10:29:33.538634    1875 system_pods.go:61] "kube-apiserver-addons-592000" [29d697a4-3888-4401-a128-db39d9a52651] Running

	I0910 10:29:33.538636    1875 system_pods.go:61] "kube-controller-manager-addons-592000" [30a7f73a-3755-4cad-b1f8-eac90a68993b] Running

	I0910 10:29:33.538638    1875 system_pods.go:61] "kube-ingress-dns-minikube" [b53a1c20-7048-458c-8b0a-840a5da3e482] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0910 10:29:33.538640    1875 system_pods.go:61] "kube-proxy-nsw7h" [ed2201cf-7ceb-459a-9741-640454ee88ed] Running

	I0910 10:29:33.538642    1875 system_pods.go:61] "kube-scheduler-addons-592000" [6d4ed535-36f8-499f-86ca-032a298a62c0] Running

	I0910 10:29:33.538644    1875 system_pods.go:61] "metrics-server-84c5f94fbc-sb6ns" [6ef6de4d-79f9-4779-971b-4671e55ffe5a] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0910 10:29:33.538648    1875 system_pods.go:61] "nvidia-device-plugin-daemonset-pzndx" [0b9dc429-c9ee-40ac-82cb-a97095b45450] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0910 10:29:33.538650    1875 system_pods.go:61] "registry-66c9cd494c-qb2rh" [d1e5edb1-7803-4933-a00b-4e3f52088cd3] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0910 10:29:33.538653    1875 system_pods.go:61] "registry-proxy-g9hh4" [ba9d217c-a23d-45ff-985a-a5b541ecc35a] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0910 10:29:33.538655    1875 system_pods.go:61] "snapshot-controller-56fcc65765-8nqdw" [e1320020-03d3-4aaf-b5f5-c8a008c81d85] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0910 10:29:33.538658    1875 system_pods.go:61] "snapshot-controller-56fcc65765-d6h7n" [153f523e-fdb8-4cd5-8cbf-d5d39bc75e3b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0910 10:29:33.538660    1875 system_pods.go:61] "storage-provisioner" [bfb0c638-eea7-4ec1-b500-9f128a03a3fe] Running

	I0910 10:29:33.538662    1875 system_pods.go:74] duration metric: took 5.176208ms to wait for pod list to return data ...

	I0910 10:29:33.538666    1875 default_sa.go:34] waiting for default service account to be created ...

	I0910 10:29:33.539689    1875 default_sa.go:45] found service account: "default"

	I0910 10:29:33.539696    1875 default_sa.go:55] duration metric: took 1.026917ms for default service account to be created ...

	I0910 10:29:33.539699    1875 system_pods.go:116] waiting for k8s-apps to be running ...

	I0910 10:29:33.544289    1875 system_pods.go:86] 17 kube-system pods found

	I0910 10:29:33.544297    1875 system_pods.go:89] "coredns-6f6b679f8f-7gqz8" [2ed6156d-968e-407d-8209-753a386c8d92] Running

	I0910 10:29:33.544301    1875 system_pods.go:89] "csi-hostpath-attacher-0" [3e87549f-5b38-4b5f-a840-f22a17e0b278] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0910 10:29:33.544304    1875 system_pods.go:89] "csi-hostpath-resizer-0" [7a272698-29ab-4821-bd8c-d61c043c577b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0910 10:29:33.544307    1875 system_pods.go:89] "csi-hostpathplugin-mhv2g" [b9701d73-7500-448f-96d4-20dbfeadf277] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0910 10:29:33.544310    1875 system_pods.go:89] "etcd-addons-592000" [75b4543a-5eb5-4136-80d7-20e9823f29e4] Running

	I0910 10:29:33.544313    1875 system_pods.go:89] "kube-apiserver-addons-592000" [29d697a4-3888-4401-a128-db39d9a52651] Running

	I0910 10:29:33.544315    1875 system_pods.go:89] "kube-controller-manager-addons-592000" [30a7f73a-3755-4cad-b1f8-eac90a68993b] Running

	I0910 10:29:33.544319    1875 system_pods.go:89] "kube-ingress-dns-minikube" [b53a1c20-7048-458c-8b0a-840a5da3e482] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0910 10:29:33.544321    1875 system_pods.go:89] "kube-proxy-nsw7h" [ed2201cf-7ceb-459a-9741-640454ee88ed] Running

	I0910 10:29:33.544324    1875 system_pods.go:89] "kube-scheduler-addons-592000" [6d4ed535-36f8-499f-86ca-032a298a62c0] Running

	I0910 10:29:33.544326    1875 system_pods.go:89] "metrics-server-84c5f94fbc-sb6ns" [6ef6de4d-79f9-4779-971b-4671e55ffe5a] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0910 10:29:33.544330    1875 system_pods.go:89] "nvidia-device-plugin-daemonset-pzndx" [0b9dc429-c9ee-40ac-82cb-a97095b45450] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0910 10:29:33.544334    1875 system_pods.go:89] "registry-66c9cd494c-qb2rh" [d1e5edb1-7803-4933-a00b-4e3f52088cd3] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0910 10:29:33.544336    1875 system_pods.go:89] "registry-proxy-g9hh4" [ba9d217c-a23d-45ff-985a-a5b541ecc35a] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0910 10:29:33.544339    1875 system_pods.go:89] "snapshot-controller-56fcc65765-8nqdw" [e1320020-03d3-4aaf-b5f5-c8a008c81d85] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0910 10:29:33.544342    1875 system_pods.go:89] "snapshot-controller-56fcc65765-d6h7n" [153f523e-fdb8-4cd5-8cbf-d5d39bc75e3b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0910 10:29:33.544344    1875 system_pods.go:89] "storage-provisioner" [bfb0c638-eea7-4ec1-b500-9f128a03a3fe] Running

	I0910 10:29:33.544348    1875 system_pods.go:126] duration metric: took 4.645584ms to wait for k8s-apps to be running ...

	I0910 10:29:33.544351    1875 system_svc.go:44] waiting for kubelet service to be running ....

	I0910 10:29:33.544395    1875 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0910 10:29:33.550335    1875 system_svc.go:56] duration metric: took 5.981834ms WaitForService to wait for kubelet

	I0910 10:29:33.550345    1875 kubeadm.go:582] duration metric: took 8.307946167s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 10:29:33.550357    1875 node_conditions.go:102] verifying NodePressure condition ...

	I0910 10:29:33.552029    1875 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0910 10:29:33.552040    1875 node_conditions.go:123] node cpu capacity is 2

	I0910 10:29:33.552046    1875 node_conditions.go:105] duration metric: took 1.686958ms to run NodePressure ...

	I0910 10:29:33.552052    1875 start.go:241] waiting for startup goroutines ...

	I0910 10:29:33.588718    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:33.716125    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:34.037430    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:34.087318    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:34.216634    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:34.535827    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:34.588643    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:34.716076    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:34.906321    1875 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0910 10:29:34.906339    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:34.933315    1875 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0910 10:29:34.940018    1875 addons.go:234] Setting addon gcp-auth=true in "addons-592000"

	I0910 10:29:34.940041    1875 host.go:66] Checking if "addons-592000" exists ...

	I0910 10:29:34.940761    1875 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0910 10:29:34.940769    1875 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/addons-592000/id_rsa Username:docker}

	I0910 10:29:34.966543    1875 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0910 10:29:34.970322    1875 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0910 10:29:34.974476    1875 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0910 10:29:34.974482    1875 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0910 10:29:34.980478    1875 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0910 10:29:34.980486    1875 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0910 10:29:34.986522    1875 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0910 10:29:34.986529    1875 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0910 10:29:34.993772    1875 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0910 10:29:35.037304    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:35.137040    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:35.215987    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:35.311642    1875 addons.go:475] Verifying addon gcp-auth=true in "addons-592000"

	I0910 10:29:35.315607    1875 out.go:177] * Verifying gcp-auth addon...

	I0910 10:29:35.323004    1875 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0910 10:29:35.324259    1875 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0910 10:29:35.537178    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:35.588860    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:35.714583    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:36.041552    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:36.141897    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:36.239795    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:36.537505    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:36.589359    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:36.716585    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:37.038675    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:37.090078    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:37.218105    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:37.537272    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:37.588694    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:37.716351    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:38.036974    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:38.088068    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:38.215899    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:38.537092    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:38.588120    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:38.716232    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:39.036994    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:39.088044    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:39.216043    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:39.536925    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:39.588789    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:39.716712    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:40.037381    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:40.088764    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:40.216139    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:40.537130    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:40.588756    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:40.716630    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:41.037028    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:41.088801    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:41.216584    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:41.536594    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:41.589199    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:41.716090    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:42.037075    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:42.088553    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:42.217951    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:42.537051    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:42.588495    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:42.716148    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:43.036984    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:43.088286    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:43.216303    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:43.536960    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:43.587404    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:43.716152    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:44.036220    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:44.088294    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:44.216792    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:44.536771    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:44.588284    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:44.716594    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:45.036876    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:45.087344    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:45.215730    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:45.536656    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:45.588193    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:45.714623    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:46.037330    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:46.088123    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:46.217472    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:46.537018    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:46.588662    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:46.716358    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:47.036882    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:47.088229    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:47.216021    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:47.537115    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:47.588098    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:47.715863    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:48.036172    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:48.088356    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:48.215971    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:48.536897    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:48.588011    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:48.715846    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:49.037040    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:49.138354    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:49.216488    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:49.535453    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:49.588333    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:49.716318    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:50.036748    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:50.137636    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:50.237985    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:50.536607    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:50.587891    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:50.715694    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:51.036753    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:51.088015    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:51.215902    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:51.537710    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:51.588408    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:51.720150    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:52.038394    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:52.090047    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:52.218446    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:52.536749    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:52.587930    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:52.715746    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:53.037153    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:53.088810    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:53.216370    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:53.536978    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:53.587533    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:53.716947    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:54.037228    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:54.088122    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:54.215364    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:54.536878    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:54.588368    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:54.715854    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:55.036306    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:55.088004    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:55.216407    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:55.536368    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:55.587602    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:55.715699    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:56.036477    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:56.087500    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:56.215339    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:56.535663    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:56.587609    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:56.715449    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:57.036276    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:57.087497    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:57.215395    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:57.536386    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:57.587621    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:57.715346    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:58.036567    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:58.088156    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:58.215236    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:58.536317    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:58.587740    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:58.715158    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:59.036266    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:59.087572    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:59.215368    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:29:59.536740    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:29:59.587924    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:29:59.715123    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:00.036661    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:00.087387    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:00.214180    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:00.537050    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:00.585716    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:00.713770    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:01.036146    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:01.086091    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:01.215443    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:01.536277    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:01.587556    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:01.715921    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:02.034589    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:02.087442    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:02.215265    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:02.535312    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:02.587659    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:02.715532    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:03.036219    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:03.087096    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:03.215188    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:03.536134    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:03.587578    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:03.717360    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:04.038958    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:04.090383    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:04.219874    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:04.536337    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:04.587480    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:04.715641    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:05.037197    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:05.088836    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:05.216177    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:05.536810    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:05.587660    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:05.716738    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:06.036295    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:06.088186    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:06.215432    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:06.536225    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:06.587530    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:06.715289    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:07.035503    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:07.087616    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:07.215492    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:07.536267    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:07.587598    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:07.714100    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:08.036242    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:08.087569    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:08.216874    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:08.536223    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:08.587684    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:08.725063    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:09.036913    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0910 10:30:09.088994    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:09.218287    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:09.536325    1875 kapi.go:107] duration metric: took 39.504100375s to wait for kubernetes.io/minikube-addons=registry ...

	I0910 10:30:09.587786    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:09.716138    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:10.087735    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:10.215140    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:10.587739    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:10.715413    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:11.088072    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:11.216733    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:11.587417    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:11.714898    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:12.087107    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:12.215127    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:12.586346    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:12.714277    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:13.088942    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:13.217334    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:13.588499    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:13.715517    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:14.085926    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:14.215099    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:14.587709    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:14.714966    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:15.087534    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:15.216651    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:15.587884    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:15.715646    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:16.090741    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:16.215998    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:16.587518    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:16.714982    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:17.088622    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:17.215246    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:17.587290    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:17.713088    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:18.087423    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:18.214627    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:18.587461    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:18.714788    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:19.088741    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:19.214906    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:19.587341    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:19.715609    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:20.090961    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:20.215606    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:20.587301    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:20.715169    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:21.087171    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:21.214581    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:21.586978    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:21.714980    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:22.087162    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:22.214790    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:22.589148    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:22.716999    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:23.090853    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:23.216912    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:23.587494    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:23.714562    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:24.087181    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:24.214875    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:24.587123    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:24.715292    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:25.087750    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:25.215302    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:25.587346    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:25.715664    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:26.087565    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:26.215056    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:26.586891    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:26.714704    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:27.087192    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:27.218449    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:27.586957    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:27.715137    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:28.086015    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:28.218152    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:28.588450    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:28.714611    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:29.087212    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:29.215346    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:29.586999    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:29.714417    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:30.087313    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:30.213973    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:30.587454    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:30.715076    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:31.085640    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:31.216159    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:31.586744    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:31.713669    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:32.086944    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:32.215309    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:32.586831    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:32.714533    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:33.089117    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:33.216066    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:33.586955    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:33.714646    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:34.085479    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:34.215808    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:34.591093    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:34.718925    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:35.086956    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:35.214959    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:35.588436    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:35.715497    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:36.086888    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:36.214756    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:36.586540    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:36.715670    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:37.088645    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:37.219030    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:37.586709    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:37.714960    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:38.086092    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:38.214511    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:38.586576    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:38.714553    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:39.086625    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:39.214334    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:39.586620    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:39.714756    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:40.086781    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:40.214226    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:40.586551    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:40.714081    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:41.087203    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:41.214830    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:41.586682    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:41.714386    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:42.086754    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:42.213038    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:42.586491    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:42.712180    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:43.086564    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:43.214032    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:43.586562    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:43.714242    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:44.086726    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:44.213967    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:44.587002    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:44.714280    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:45.086537    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:45.213927    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:45.586408    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:45.713662    1875 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0910 10:30:46.086654    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:46.214264    1875 kapi.go:107] duration metric: took 1m17.504283583s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0910 10:30:46.588271    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:47.087120    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:47.586497    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:48.087269    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:48.585165    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:49.085567    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:49.585526    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:50.086888    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:50.586486    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:51.086604    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:51.587154    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:52.086963    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:52.586904    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:53.086227    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:53.586464    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:54.086684    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:54.585775    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:55.087159    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:55.586117    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:56.086013    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:56.585945    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:57.086286    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:57.324336    1875 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0910 10:30:57.324345    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:30:57.586177    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0910 10:30:57.825119    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:30:58.086036    1875 kapi.go:107] duration metric: took 1m29.004411875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0910 10:30:58.323898    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:30:58.825503    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:30:59.324410    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:30:59.824478    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:00.324818    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:00.829291    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:01.329376    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:01.830340    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:02.324777    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:02.831224    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:03.325978    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:03.829886    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:04.327184    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:04.827536    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:05.322910    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:05.827912    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:06.325320    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:06.829818    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:07.322343    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:07.825346    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:08.325631    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:08.828715    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:09.323674    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:09.823891    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:10.323928    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:10.830884    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:11.325898    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:11.830777    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:12.325590    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:12.829008    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:13.324835    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:13.829626    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:14.324891    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:14.824585    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:15.324034    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:15.825665    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:16.324133    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:16.824622    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:17.325567    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:17.823476    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:18.327790    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:18.824206    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:19.323511    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:19.823351    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:20.324764    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:20.824153    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:21.325734    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:21.825459    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:22.327779    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:22.829441    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:23.323676    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:23.828179    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:24.325309    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:24.829789    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:25.327528    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:25.829317    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:26.326308    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:26.827586    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:27.326782    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:27.825613    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:28.327361    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:28.827464    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:29.324560    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:29.830104    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:30.321654    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:30.825631    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:31.323302    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:31.828136    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:32.327964    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:32.822764    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:33.324099    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:33.824258    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:34.324978    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:34.825726    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:35.328536    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:35.829095    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:36.327760    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:36.827281    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:37.328001    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:37.824356    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:38.322938    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:38.821979    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:39.322780    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:39.823302    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:40.324991    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:40.822877    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:41.323384    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:41.822633    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:42.324317    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:42.824046    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:43.326612    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:43.824431    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:44.324091    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:44.824842    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:45.327629    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:45.823840    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:46.324438    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:46.824129    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:47.323017    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:47.823831    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:48.324382    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:48.825824    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:49.323633    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:49.822137    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:50.323996    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:50.828365    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:51.329282    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:51.827258    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:52.322906    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:52.828354    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:53.326159    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:53.825431    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:54.323463    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:54.824326    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:55.323389    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:55.823439    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:56.323461    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:56.827974    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:57.325961    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:57.828622    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:58.325268    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:58.823992    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:59.326116    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:31:59.825741    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:00.324590    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:00.829686    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:01.324736    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:01.824765    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:02.324987    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:02.829128    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:03.326512    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:03.826832    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:04.327486    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:04.828426    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:05.328693    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:05.829131    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:06.329586    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:06.831584    1875 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0910 10:32:07.330571    1875 kapi.go:107] duration metric: took 2m32.003648208s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0910 10:32:07.334839    1875 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-592000 cluster.

	I0910 10:32:07.339704    1875 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0910 10:32:07.343750    1875 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0910 10:32:07.346769    1875 out.go:177] * Enabled addons: metrics-server, inspektor-gadget, storage-provisioner-rancher, ingress-dns, storage-provisioner, default-storageclass, volcano, nvidia-device-plugin, cloud-spanner, yakd, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth

	I0910 10:32:07.350752    1875 addons.go:510] duration metric: took 2m42.104464958s for enable addons: enabled=[metrics-server inspektor-gadget storage-provisioner-rancher ingress-dns storage-provisioner default-storageclass volcano nvidia-device-plugin cloud-spanner yakd volumesnapshots registry ingress csi-hostpath-driver gcp-auth]

	I0910 10:32:07.350768    1875 start.go:246] waiting for cluster config update ...

	I0910 10:32:07.350789    1875 start.go:255] writing updated cluster config ...

	I0910 10:32:07.351250    1875 ssh_runner.go:195] Run: rm -f paused

	I0910 10:32:07.500189    1875 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0910 10:32:07.503729    1875 out.go:201] 

	W0910 10:32:07.506954    1875 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0910 10:32:07.510898    1875 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0910 10:32:07.518874    1875 out.go:177] * Done! kubectl is now configured to use "addons-592000" cluster and "default" namespace by default

	==> Docker <==

	Sep 10 17:41:50 addons-592000 dockerd[1272]: time="2024-09-10T17:41:50.488290313Z" level=info msg="shim disconnected" id=4effb0a8f037aac210692c55db17317e42d82f67cca0e4baf3cb442fb232eb34 namespace=moby

	Sep 10 17:41:50 addons-592000 dockerd[1265]: time="2024-09-10T17:41:50.488518053Z" level=info msg="ignoring event" container=4effb0a8f037aac210692c55db17317e42d82f67cca0e4baf3cb442fb232eb34 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:50 addons-592000 dockerd[1272]: time="2024-09-10T17:41:50.488687058Z" level=warning msg="cleaning up after shim disconnected" id=4effb0a8f037aac210692c55db17317e42d82f67cca0e4baf3cb442fb232eb34 namespace=moby

	Sep 10 17:41:50 addons-592000 dockerd[1272]: time="2024-09-10T17:41:50.488734187Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1265]: time="2024-09-10T17:41:56.351528028Z" level=info msg="ignoring event" container=3f4ec5c06c36a5bd85137393573b09d9fea639ef5ca4f81db2336381640bbbf2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.351974926Z" level=info msg="shim disconnected" id=3f4ec5c06c36a5bd85137393573b09d9fea639ef5ca4f81db2336381640bbbf2 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.352007712Z" level=warning msg="cleaning up after shim disconnected" id=3f4ec5c06c36a5bd85137393573b09d9fea639ef5ca4f81db2336381640bbbf2 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.352012164Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1265]: time="2024-09-10T17:41:56.492025920Z" level=info msg="ignoring event" container=e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.492252551Z" level=info msg="shim disconnected" id=e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.492281967Z" level=warning msg="cleaning up after shim disconnected" id=e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.492286086Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.509243247Z" level=warning msg="cleanup warnings time=\"2024-09-10T17:41:56Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.531074262Z" level=info msg="shim disconnected" id=3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.531219012Z" level=warning msg="cleaning up after shim disconnected" id=3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.531238192Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1265]: time="2024-09-10T17:41:56.532040620Z" level=info msg="ignoring event" container=3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.611074829Z" level=info msg="shim disconnected" id=4c72403f95e88aa0b1b15b26ae786b6573f14197928e0e41b24861236b417067 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.611104079Z" level=warning msg="cleaning up after shim disconnected" id=4c72403f95e88aa0b1b15b26ae786b6573f14197928e0e41b24861236b417067 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.611107823Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1265]: time="2024-09-10T17:41:56.611268925Z" level=info msg="ignoring event" container=4c72403f95e88aa0b1b15b26ae786b6573f14197928e0e41b24861236b417067 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.657876920Z" level=info msg="shim disconnected" id=e41c5cc4827b75decaa1062f46381f59994310a7fd0b8527e6be4ef7f3f26d19 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.657966957Z" level=warning msg="cleaning up after shim disconnected" id=e41c5cc4827b75decaa1062f46381f59994310a7fd0b8527e6be4ef7f3f26d19 namespace=moby

	Sep 10 17:41:56 addons-592000 dockerd[1265]: time="2024-09-10T17:41:56.658034027Z" level=info msg="ignoring event" container=e41c5cc4827b75decaa1062f46381f59994310a7fd0b8527e6be4ef7f3f26d19 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:41:56 addons-592000 dockerd[1272]: time="2024-09-10T17:41:56.657989217Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                       ATTEMPT             POD ID              POD

	1025a837f40e5       ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec            32 seconds ago      Exited              gadget                     7                   cd74953440164       gadget-vbxln

	5e70ab3ace129       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb                 9 minutes ago       Running             gcp-auth                   0                   c4f02c8bf30c2       gcp-auth-89d5ffd79-mgkkt

	145b79b803fe6       registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce             11 minutes ago      Running             controller                 0                   79c5b1cd36ab8       ingress-nginx-controller-bc57996ff-krrrr

	67eacd31859e1       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   11 minutes ago      Exited              patch                      0                   dd5f21785c479       ingress-nginx-admission-patch-kq245

	d79e1f3b06002       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   11 minutes ago      Exited              create                     0                   cb9ddfbfc25fc       ingress-nginx-admission-create-qcnqj

	bae295e5fcd62       marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624                                        11 minutes ago      Running             yakd                       0                   8c07cfa90e1ff       yakd-dashboard-67d98fc6b-ln7xx

	3ae2cc2fd9e7b       gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367              11 minutes ago      Exited              registry-proxy             0                   e41c5cc4827b7       registry-proxy-g9hh4

	dbe01519331e1       gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc               11 minutes ago      Running             cloud-spanner-emulator     0                   5648b7f49289e       cloud-spanner-emulator-769b77f747-85njj

	e7cff5d22c181       registry@sha256:ac0192b549007e22998eb74e8d8488dcfe70f1489520c3b144a6047ac5efbe90                                             12 minutes ago      Exited              registry                   0                   4c72403f95e88       registry-66c9cd494c-qb2rh

	614ca294c4f39       nvcr.io/nvidia/k8s-device-plugin@sha256:ed39e22c8b71343fb996737741a99da88ce6c75dd83b5c520e0b3d8e8a884c47                     12 minutes ago      Running             nvidia-device-plugin-ctr   0                   2d9028815317c       nvidia-device-plugin-daemonset-pzndx

	91cebd51ab75d       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             12 minutes ago      Running             minikube-ingress-dns       0                   c11fb68e364b0       kube-ingress-dns-minikube

	e454db0c77a16       rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246                       12 minutes ago      Running             local-path-provisioner     0                   7af242efba3e0       local-path-provisioner-86d989889c-h5ctd

	0b4fb9e93b88a       registry.k8s.io/metrics-server/metrics-server@sha256:ffcb2bf004d6aa0a17d90e0247cf94f2865c8901dcab4427034c341951c239f9        12 minutes ago      Running             metrics-server             0                   f1485cfeb2d51       metrics-server-84c5f94fbc-sb6ns

	cf29947c74eba       ba04bb24b9575                                                                                                                12 minutes ago      Running             storage-provisioner        0                   637e2c6010b95       storage-provisioner

	3c3197d5b12a8       2437cf7621777                                                                                                                12 minutes ago      Running             coredns                    0                   877c4665be2be       coredns-6f6b679f8f-7gqz8

	ea1510481c9df       71d55d66fd4ee                                                                                                                12 minutes ago      Running             kube-proxy                 0                   e63cccc2599f6       kube-proxy-nsw7h

	c9fc76460a920       cd0f0ae0ec9e0                                                                                                                12 minutes ago      Running             kube-apiserver             0                   ae7032a0ba5ab       kube-apiserver-addons-592000

	cdda8889658ad       fbbbd428abb4d                                                                                                                12 minutes ago      Running             kube-scheduler             0                   9c1a6c4810ee9       kube-scheduler-addons-592000

	a5b5af720e175       fcb0683e6bdbd                                                                                                                12 minutes ago      Running             kube-controller-manager    0                   1d3dbfdac85c5       kube-controller-manager-addons-592000

	0b74e0fd856e2       27e3830e14027                                                                                                                12 minutes ago      Running             etcd                       0                   d8489de09676c       etcd-addons-592000

	==> controller_ingress [145b79b803fe] <==

	W0910 17:30:45.758058       7 client_config.go:659] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

	I0910 17:30:45.758139       7 main.go:205] "Creating API client" host="https://10.96.0.1:443"

	I0910 17:30:45.761184       7 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.0" state="clean" commit="9edcffcde5595e8a5b1a35f88c421764e575afce" platform="linux/arm64"

	I0910 17:30:45.826431       7 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"

	I0910 17:30:45.832508       7 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"

	I0910 17:30:45.835869       7 nginx.go:271] "Starting NGINX Ingress controller"

	I0910 17:30:45.840405       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"2921581d-ce09-4cd8-b6e1-b837f46c7b4a", APIVersion:"v1", ResourceVersion:"580", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller

	I0910 17:30:45.841597       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"2e125521-7ef7-4949-98f6-7a8023722202", APIVersion:"v1", ResourceVersion:"593", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services

	I0910 17:30:45.841617       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"b04b738c-a1ae-41e3-b182-089216a0367c", APIVersion:"v1", ResourceVersion:"607", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services

	I0910 17:30:47.038130       7 nginx.go:317] "Starting NGINX process"

	I0910 17:30:47.038314       7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...

	I0910 17:30:47.038810       7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"

	I0910 17:30:47.038947       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0910 17:30:47.056404       7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader

	I0910 17:30:47.056711       7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-krrrr"

	I0910 17:30:47.060301       7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-krrrr" node="addons-592000"

	I0910 17:30:47.070446       7 controller.go:213] "Backend successfully reloaded"

	I0910 17:30:47.070491       7 controller.go:224] "Initial sync, sleeping for 1 second"

	I0910 17:30:47.070716       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-krrrr", UID:"ed57db95-441b-4e42-96ed-3d80191de858", APIVersion:"v1", ResourceVersion:"634", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	  Build:         46e76e5916813cfca2a9b0bfdc34b69a0000f6b9

	  Repository:    https://github.com/kubernetes/ingress-nginx

	  nginx version: nginx/1.25.5

	-------------------------------------------------------------------------------

	==> coredns [3c3197d5b12a] <==

	[INFO] 127.0.0.1:37424 - 43531 "HINFO IN 2577111125036051479.1742811790643504515. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009847409s

	[INFO] 10.244.0.8:43610 - 16406 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000110996s

	[INFO] 10.244.0.8:43610 - 19216 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000163868s

	[INFO] 10.244.0.8:60568 - 62559 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000050995s

	[INFO] 10.244.0.8:60568 - 4702 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000024225s

	[INFO] 10.244.0.8:46727 - 17874 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000029521s

	[INFO] 10.244.0.8:46727 - 20701 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000027395s

	[INFO] 10.244.0.8:53653 - 54471 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000028437s

	[INFO] 10.244.0.8:53653 - 9670 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.00006071s

	[INFO] 10.244.0.8:60168 - 63227 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000027019s

	[INFO] 10.244.0.8:60168 - 31993 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000015553s

	[INFO] 10.244.0.8:57605 - 25052 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000018388s

	[INFO] 10.244.0.8:57605 - 13023 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00001622s

	[INFO] 10.244.0.8:60338 - 18560 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000011716s

	[INFO] 10.244.0.8:60338 - 7809 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000009798s

	[INFO] 10.244.0.8:40343 - 51330 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000011926s

	[INFO] 10.244.0.8:40343 - 4227 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000054748s

	[INFO] 10.244.0.24:57896 - 10667 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004303233s

	[INFO] 10.244.0.24:49038 - 53726 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.004414916s

	[INFO] 10.244.0.24:60288 - 14242 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00023995s

	[INFO] 10.244.0.24:48843 - 47020 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000209697s

	[INFO] 10.244.0.24:49156 - 43868 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000125601s

	[INFO] 10.244.0.24:45638 - 34258 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000104765s

	[INFO] 10.244.0.24:39854 - 355 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001413575s

	[INFO] 10.244.0.24:56931 - 49209 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001474416s

	==> describe nodes <==

	Name:               addons-592000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-592000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18

	                    minikube.k8s.io/name=addons-592000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_10T10_29_20_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-592000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 10 Sep 2024 17:29:17 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-592000

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 10 Sep 2024 17:41:54 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 10 Sep 2024 17:38:00 +0000   Tue, 10 Sep 2024 17:29:16 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 10 Sep 2024 17:38:00 +0000   Tue, 10 Sep 2024 17:29:16 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 10 Sep 2024 17:38:00 +0000   Tue, 10 Sep 2024 17:29:16 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 10 Sep 2024 17:38:00 +0000   Tue, 10 Sep 2024 17:29:23 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-592000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 795f27a08ae946a8a5e5544ce603e24f

	  System UUID:                795f27a08ae946a8a5e5544ce603e24f

	  Boot ID:                    b84756e6-5c35-41b8-825a-7ef612569e39

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (18 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m11s

	  default                     cloud-spanner-emulator-769b77f747-85njj     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  default                     registry-test                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         60s

	  gadget                      gadget-vbxln                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  gcp-auth                    gcp-auth-89d5ffd79-mgkkt                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m

	  ingress-nginx               ingress-nginx-controller-bc57996ff-krrrr    100m (5%)     0 (0%)      90Mi (2%)        0 (0%)         12m

	  kube-system                 coredns-6f6b679f8f-7gqz8                    100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     12m

	  kube-system                 etcd-addons-592000                          100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         12m

	  kube-system                 kube-apiserver-addons-592000                250m (12%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-controller-manager-addons-592000       200m (10%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-proxy-nsw7h                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-scheduler-addons-592000                100m (5%)     0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 metrics-server-84c5f94fbc-sb6ns             100m (5%)     0 (0%)      200Mi (5%)       0 (0%)         12m

	  kube-system                 nvidia-device-plugin-daemonset-pzndx        0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  local-path-storage          local-path-provisioner-86d989889c-h5ctd     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  yakd-dashboard              yakd-dashboard-67d98fc6b-ln7xx              0 (0%)        0 (0%)      128Mi (3%)       256Mi (6%)     12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   0 (0%)

	  memory             588Mi (15%)  426Mi (11%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-1Gi      0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	  hugepages-32Mi     0 (0%)       0 (0%)

	  hugepages-64Ki     0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 12m                kube-proxy       

	  Normal  Starting                 12m                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  12m (x2 over 12m)  kubelet          Node addons-592000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m (x2 over 12m)  kubelet          Node addons-592000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m (x2 over 12m)  kubelet          Node addons-592000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeReady                12m                kubelet          Node addons-592000 status is now: NodeReady

	  Normal  RegisteredNode           12m                node-controller  Node addons-592000 event: Registered Node addons-592000 in Controller

	==> dmesg <==

	[  +0.044203] kauditd_printk_skb: 64 callbacks suppressed

	[  +4.965012] kauditd_printk_skb: 293 callbacks suppressed

	[  +4.966445] kauditd_printk_skb: 20 callbacks suppressed

	[  +8.884647] kauditd_printk_skb: 11 callbacks suppressed

	[Sep10 17:30] kauditd_printk_skb: 2 callbacks suppressed

	[  +5.271072] kauditd_printk_skb: 12 callbacks suppressed

	[  +6.886059] kauditd_printk_skb: 16 callbacks suppressed

	[  +5.185943] kauditd_printk_skb: 13 callbacks suppressed

	[ +13.020087] kauditd_printk_skb: 46 callbacks suppressed

	[  +5.244091] kauditd_printk_skb: 13 callbacks suppressed

	[  +6.608745] kauditd_printk_skb: 12 callbacks suppressed

	[Sep10 17:31] kauditd_printk_skb: 2 callbacks suppressed

	[Sep10 17:32] kauditd_printk_skb: 40 callbacks suppressed

	[  +5.779221] kauditd_printk_skb: 19 callbacks suppressed

	[ +27.853851] kauditd_printk_skb: 7 callbacks suppressed

	[ +10.193374] kauditd_printk_skb: 20 callbacks suppressed

	[Sep10 17:33] kauditd_printk_skb: 2 callbacks suppressed

	[Sep10 17:36] kauditd_printk_skb: 2 callbacks suppressed

	[Sep10 17:40] kauditd_printk_skb: 2 callbacks suppressed

	[Sep10 17:41] kauditd_printk_skb: 2 callbacks suppressed

	[  +7.890549] kauditd_printk_skb: 7 callbacks suppressed

	[ +20.254907] kauditd_printk_skb: 2 callbacks suppressed

	[  +8.788308] kauditd_printk_skb: 7 callbacks suppressed

	[  +7.738598] kauditd_printk_skb: 33 callbacks suppressed

	[  +5.439379] kauditd_printk_skb: 6 callbacks suppressed

	==> etcd [0b74e0fd856e] <==

	{"level":"info","ts":"2024-09-10T17:29:16.494795Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.2:2380"}

	{"level":"info","ts":"2024-09-10T17:29:16.496412Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.2:2380"}

	{"level":"info","ts":"2024-09-10T17:29:16.562039Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2024-09-10T17:29:16.562111Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2024-09-10T17:29:16.562178Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2024-09-10T17:29:16.562200Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2024-09-10T17:29:16.562219Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-09-10T17:29:16.562254Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2024-09-10T17:29:16.562275Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-09-10T17:29:16.570054Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:29:16.570256Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-592000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-10T17:29:16.570283Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:29:16.570332Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:29:16.574363Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:29:16.574869Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2024-09-10T17:29:16.575168Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:29:16.575614Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-10T17:29:16.578273Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:29:16.578317Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:29:16.578350Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:29:16.582028Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-10T17:29:16.582040Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-10T17:39:17.045852Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1815}

	{"level":"info","ts":"2024-09-10T17:39:17.139999Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1815,"took":"90.458513ms","hash":2158818084,"current-db-size-bytes":8851456,"current-db-size":"8.9 MB","current-db-size-in-use-bytes":4648960,"current-db-size-in-use":"4.6 MB"}

	{"level":"info","ts":"2024-09-10T17:39:17.140029Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2158818084,"revision":1815,"compact-revision":-1}

	==> gcp-auth [5e70ab3ace12] <==

	2024/09/10 17:32:06 GCP Auth Webhook started!

	2024/09/10 17:32:22 Ready to marshal response ...

	2024/09/10 17:32:22 Ready to write response ...

	2024/09/10 17:32:22 Ready to marshal response ...

	2024/09/10 17:32:22 Ready to write response ...

	2024/09/10 17:32:44 Ready to marshal response ...

	2024/09/10 17:32:44 Ready to write response ...

	2024/09/10 17:32:45 Ready to marshal response ...

	2024/09/10 17:32:45 Ready to write response ...

	2024/09/10 17:32:45 Ready to marshal response ...

	2024/09/10 17:32:45 Ready to write response ...

	2024/09/10 17:40:56 Ready to marshal response ...

	2024/09/10 17:40:56 Ready to write response ...

	2024/09/10 17:41:05 Ready to marshal response ...

	2024/09/10 17:41:05 Ready to write response ...

	2024/09/10 17:41:33 Ready to marshal response ...

	2024/09/10 17:41:33 Ready to write response ...

	==> kernel <==

	 17:41:57 up 12 min,  0 users,  load average: 0.54, 0.58, 0.45

	Linux addons-592000 5.10.207 #1 SMP PREEMPT Mon Sep 9 22:12:33 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [c9fc76460a92] <==

	I0910 17:32:35.471781       1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager

	I0910 17:32:35.488282       1 handler.go:286] Adding GroupVersion nodeinfo.volcano.sh v1alpha1 to ResourceManager

	I0910 17:32:35.599885       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0910 17:32:35.730275       1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager

	I0910 17:32:35.732507       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0910 17:32:35.763851       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	W0910 17:32:36.492916       1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh

	W0910 17:32:36.509348       1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh

	W0910 17:32:36.733684       1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh

	W0910 17:32:36.734252       1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh

	W0910 17:32:36.763139       1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh

	W0910 17:32:36.764690       1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh

	W0910 17:32:36.905829       1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh

	I0910 17:41:12.536330       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I0910 17:41:50.288423       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0910 17:41:50.288454       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0910 17:41:50.298632       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0910 17:41:50.298648       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0910 17:41:50.314928       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0910 17:41:50.314951       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0910 17:41:50.402017       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0910 17:41:50.402030       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W0910 17:41:51.315597       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W0910 17:41:51.402720       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W0910 17:41:51.435363       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	==> kube-controller-manager [a5b5af720e17] <==

	I0910 17:41:44.351828       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-592000"

	I0910 17:41:50.334464       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/snapshot-controller-56fcc65765" duration="3.203µs"

	E0910 17:41:51.317460       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	E0910 17:41:51.403507       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	E0910 17:41:51.435992       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:52.343877       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:52.343989       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:52.555962       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:52.556079       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:52.726834       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:52.726942       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:53.944601       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:53.944846       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:54.281777       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:54.281810       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0910 17:41:54.937575       1 shared_informer.go:313] Waiting for caches to sync for resource quota

	I0910 17:41:54.937653       1 shared_informer.go:320] Caches are synced for resource quota

	W0910 17:41:55.008312       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:55.008627       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0910 17:41:55.201168       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0910 17:41:55.201239       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0910 17:41:55.279008       1 shared_informer.go:313] Waiting for caches to sync for garbage collector

	I0910 17:41:55.279218       1 shared_informer.go:320] Caches are synced for garbage collector

	I0910 17:41:55.775933       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="2.705µs"

	I0910 17:41:56.473557       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="1.332µs"

	==> kube-proxy [ea1510481c9d] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0910 17:29:26.222111       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0910 17:29:26.246572       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.2"]

	E0910 17:29:26.246733       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0910 17:29:26.324058       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0910 17:29:26.324085       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0910 17:29:26.324101       1 server_linux.go:169] "Using iptables Proxier"

	I0910 17:29:26.324774       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0910 17:29:26.324897       1 server.go:483] "Version info" version="v1.31.0"

	I0910 17:29:26.324908       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0910 17:29:26.325762       1 config.go:197] "Starting service config controller"

	I0910 17:29:26.325896       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0910 17:29:26.325906       1 config.go:104] "Starting endpoint slice config controller"

	I0910 17:29:26.325908       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0910 17:29:26.326139       1 config.go:326] "Starting node config controller"

	I0910 17:29:26.326141       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0910 17:29:26.426096       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0910 17:29:26.426126       1 shared_informer.go:320] Caches are synced for service config

	I0910 17:29:26.426365       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [cdda8889658a] <==

	W0910 17:29:17.705879       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0910 17:29:17.705891       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:17.705911       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0910 17:29:17.705920       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:17.706069       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0910 17:29:17.706118       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	W0910 17:29:17.706212       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0910 17:29:17.706234       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:17.706617       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0910 17:29:17.706648       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.531017       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0910 17:29:18.531106       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.559407       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0910 17:29:18.559523       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.575911       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0910 17:29:18.575958       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.673370       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0910 17:29:18.673646       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.723070       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0910 17:29:18.723256       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0910 17:29:18.762834       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0910 17:29:18.762914       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	W0910 17:29:18.788689       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0910 17:29:18.788723       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"

	I0910 17:29:21.401599       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.552372    2026 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec56769-bfd7-46da-b810-095f42ed9453-kube-api-access-xn6pf" (OuterVolumeSpecName: "kube-api-access-xn6pf") pod "6ec56769-bfd7-46da-b810-095f42ed9453" (UID: "6ec56769-bfd7-46da-b810-095f42ed9453"). InnerVolumeSpecName "kube-api-access-xn6pf". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.651921    2026 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-xn6pf\" (UniqueName: \"kubernetes.io/projected/6ec56769-bfd7-46da-b810-095f42ed9453-kube-api-access-xn6pf\") on node \"addons-592000\" DevicePath \"\""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.651940    2026 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/6ec56769-bfd7-46da-b810-095f42ed9453-gcp-creds\") on node \"addons-592000\" DevicePath \"\""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.752216    2026 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx92c\" (UniqueName: \"kubernetes.io/projected/d1e5edb1-7803-4933-a00b-4e3f52088cd3-kube-api-access-xx92c\") pod \"d1e5edb1-7803-4933-a00b-4e3f52088cd3\" (UID: \"d1e5edb1-7803-4933-a00b-4e3f52088cd3\") "

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.753683    2026 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e5edb1-7803-4933-a00b-4e3f52088cd3-kube-api-access-xx92c" (OuterVolumeSpecName: "kube-api-access-xx92c") pod "d1e5edb1-7803-4933-a00b-4e3f52088cd3" (UID: "d1e5edb1-7803-4933-a00b-4e3f52088cd3"). InnerVolumeSpecName "kube-api-access-xx92c". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.853763    2026 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l627s\" (UniqueName: \"kubernetes.io/projected/ba9d217c-a23d-45ff-985a-a5b541ecc35a-kube-api-access-l627s\") pod \"ba9d217c-a23d-45ff-985a-a5b541ecc35a\" (UID: \"ba9d217c-a23d-45ff-985a-a5b541ecc35a\") "

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.853946    2026 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-xx92c\" (UniqueName: \"kubernetes.io/projected/d1e5edb1-7803-4933-a00b-4e3f52088cd3-kube-api-access-xx92c\") on node \"addons-592000\" DevicePath \"\""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.855144    2026 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9d217c-a23d-45ff-985a-a5b541ecc35a-kube-api-access-l627s" (OuterVolumeSpecName: "kube-api-access-l627s") pod "ba9d217c-a23d-45ff-985a-a5b541ecc35a" (UID: "ba9d217c-a23d-45ff-985a-a5b541ecc35a"). InnerVolumeSpecName "kube-api-access-l627s". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 10 17:41:56 addons-592000 kubelet[2026]: I0910 17:41:56.954261    2026 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-l627s\" (UniqueName: \"kubernetes.io/projected/ba9d217c-a23d-45ff-985a-a5b541ecc35a-kube-api-access-l627s\") on node \"addons-592000\" DevicePath \"\""

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.076400    2026 scope.go:117] "RemoveContainer" containerID="0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.087524    2026 scope.go:117] "RemoveContainer" containerID="0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: E0910 17:41:57.088606    2026 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55" containerID="0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.088621    2026 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55"} err="failed to get container status \"0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55\": rpc error: code = Unknown desc = Error response from daemon: No such container: 0b4fb9e93b88a8d04069f672c189dcf0fe177f92d345f57cb09a1f534076df55"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.088634    2026 scope.go:117] "RemoveContainer" containerID="3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.109462    2026 scope.go:117] "RemoveContainer" containerID="3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: E0910 17:41:57.110330    2026 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf" containerID="3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.110371    2026 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf"} err="failed to get container status \"3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf\": rpc error: code = Unknown desc = Error response from daemon: No such container: 3ae2cc2fd9e7be05b8e65014593462af188e7e102273963d53354d5da59ebddf"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.110388    2026 scope.go:117] "RemoveContainer" containerID="e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.129231    2026 scope.go:117] "RemoveContainer" containerID="e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: E0910 17:41:57.129579    2026 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f" containerID="e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.129598    2026 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f"} err="failed to get container status \"e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f\": rpc error: code = Unknown desc = Error response from daemon: No such container: e7cff5d22c181ce0af24e9261766eed30400076c102a2434c7bb8fc2bc880e5f"

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.155689    2026 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef6de4d-79f9-4779-971b-4671e55ffe5a-tmp-dir\") pod \"6ef6de4d-79f9-4779-971b-4671e55ffe5a\" (UID: \"6ef6de4d-79f9-4779-971b-4671e55ffe5a\") "

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.155709    2026 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54jqb\" (UniqueName: \"kubernetes.io/projected/6ef6de4d-79f9-4779-971b-4671e55ffe5a-kube-api-access-54jqb\") pod \"6ef6de4d-79f9-4779-971b-4671e55ffe5a\" (UID: \"6ef6de4d-79f9-4779-971b-4671e55ffe5a\") "

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.157107    2026 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef6de4d-79f9-4779-971b-4671e55ffe5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ef6de4d-79f9-4779-971b-4671e55ffe5a" (UID: "6ef6de4d-79f9-4779-971b-4671e55ffe5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""

	Sep 10 17:41:57 addons-592000 kubelet[2026]: I0910 17:41:57.157776    2026 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef6de4d-79f9-4779-971b-4671e55ffe5a-kube-api-access-54jqb" (OuterVolumeSpecName: "kube-api-access-54jqb") pod "6ef6de4d-79f9-4779-971b-4671e55ffe5a" (UID: "6ef6de4d-79f9-4779-971b-4671e55ffe5a"). InnerVolumeSpecName "kube-api-access-54jqb". PluginName "kubernetes.io/projected", VolumeGidValue ""

	==> storage-provisioner [cf29947c74eb] <==

	I0910 17:29:27.639423       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0910 17:29:27.741526       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0910 17:29:27.741570       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0910 17:29:27.797884       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0910 17:29:27.797983       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-592000_e7c1ccd2-eef9-4189-bf52-2a318b053220!

	I0910 17:29:27.799044       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b3474a80-8f9f-4102-af60-47b2a3c17674", APIVersion:"v1", ResourceVersion:"498", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-592000_e7c1ccd2-eef9-4189-bf52-2a318b053220 became leader

	I0910 17:29:27.898751       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-592000_e7c1ccd2-eef9-4189-bf52-2a318b053220!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-592000 -n addons-592000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-592000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-qcnqj ingress-nginx-admission-patch-kq245

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-592000 describe pod busybox ingress-nginx-admission-create-qcnqj ingress-nginx-admission-patch-kq245

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-592000 describe pod busybox ingress-nginx-admission-create-qcnqj ingress-nginx-admission-patch-kq245: exit status 1 (41.430334ms)

-- stdout --

	Name:             busybox

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-592000/192.168.105.2

	Start Time:       Tue, 10 Sep 2024 10:32:45 -0700

	Labels:           integration-test=busybox

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.26

	IPs:

	  IP:  10.244.0.26

	Containers:

	  busybox:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      sleep

	      3600

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nsn45 (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   True 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  kube-api-access-nsn45:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  9m12s                  default-scheduler  Successfully assigned default/busybox to addons-592000

	  Normal   Pulling    7m42s (x4 over 9m12s)  kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Warning  Failed     7m41s (x4 over 9m11s)  kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed

	  Warning  Failed     7m41s (x4 over 9m11s)  kubelet            Error: ErrImagePull

	  Warning  Failed     7m30s (x6 over 9m10s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m8s (x20 over 9m10s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-qcnqj" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-kq245" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-592000 describe pod busybox ingress-nginx-admission-create-qcnqj ingress-nginx-admission-patch-kq245: exit status 1

--- FAIL: TestAddons/parallel/Registry (71.35s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-070000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-070000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (11.990067875s)

-- stdout --

	* [cert-options-070000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-070000" primary control-plane node in "cert-options-070000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-070000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-070000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-070000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-070000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-070000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (80.005542ms)

-- stdout --

	* The control-plane node cert-options-070000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-070000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-070000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-070000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-070000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-070000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (41.815958ms)

-- stdout --

	* The control-plane node cert-options-070000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-070000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-070000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-070000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-070000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-09-10 11:07:03.539088 -0700 PDT m=+2323.002132501

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-070000 -n cert-options-070000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-070000 -n cert-options-070000: exit status 7 (31.4025ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-070000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-070000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-070000

--- FAIL: TestCertOptions (12.26s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (12.336437791s)

-- stdout --

	* [cert-expiration-717000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-717000" primary control-plane node in "cert-expiration-717000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-717000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-717000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.217871666s)

-- stdout --

	* [cert-expiration-717000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-717000" primary control-plane node in "cert-expiration-717000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-717000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-717000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-717000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-717000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-717000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-717000" primary control-plane node in "cert-expiration-717000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-717000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-717000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-717000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-09-10 11:10:06.209611 -0700 PDT m=+2505.677502835

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-717000 -n cert-expiration-717000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-717000 -n cert-expiration-717000: exit status 7 (63.000708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-717000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-717000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-717000

--- FAIL: TestCertExpiration (197.70s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-081000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-081000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (12.510515667s)

-- stdout --

	* [docker-flags-081000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-081000" primary control-plane node in "docker-flags-081000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-081000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:06:38.517578    5109 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:06:38.517715    5109 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:38.517719    5109 out.go:358] Setting ErrFile to fd 2...

	I0910 11:06:38.517721    5109 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:38.517862    5109 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:06:38.519043    5109 out.go:352] Setting JSON to false

	I0910 11:06:38.536787    5109 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3962,"bootTime":1725987636,"procs":474,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:06:38.536869    5109 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:06:38.550123    5109 out.go:177] * [docker-flags-081000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:06:38.559102    5109 notify.go:220] Checking for updates...

	I0910 11:06:38.565052    5109 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:06:38.576759    5109 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:06:38.586007    5109 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:06:38.592001    5109 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:06:38.598940    5109 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:06:38.612759    5109 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:06:38.621640    5109 config.go:182] Loaded profile config "force-systemd-flag-278000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:38.621728    5109 config.go:182] Loaded profile config "multinode-416000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:38.621794    5109 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:06:38.625008    5109 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 11:06:38.632007    5109 start.go:297] selected driver: qemu2

	I0910 11:06:38.632014    5109 start.go:901] validating driver "qemu2" against <nil>

	I0910 11:06:38.632020    5109 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:06:38.634847    5109 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 11:06:38.647953    5109 out.go:177] * Automatically selected the socket_vmnet network

	I0910 11:06:38.653144    5109 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0910 11:06:38.653181    5109 cni.go:84] Creating CNI manager for ""

	I0910 11:06:38.653190    5109 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 11:06:38.653196    5109 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0910 11:06:38.653249    5109 start.go:340] cluster config:

	{Name:docker-flags-081000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-081000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn

etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:06:38.658091    5109 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:06:38.673093    5109 out.go:177] * Starting "docker-flags-081000" primary control-plane node in "docker-flags-081000" cluster

	I0910 11:06:38.675204    5109 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:06:38.675231    5109 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:06:38.675239    5109 cache.go:56] Caching tarball of preloaded images

	I0910 11:06:38.675332    5109 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:06:38.675339    5109 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:06:38.675417    5109 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/docker-flags-081000/config.json ...

	I0910 11:06:38.675430    5109 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/docker-flags-081000/config.json: {Name:mk33ca806f63455a657e02070b2d8649103c2c6c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 11:06:38.676075    5109 start.go:360] acquireMachinesLock for docker-flags-081000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:40.843805    5109 start.go:364] duration metric: took 2.167744875s to acquireMachinesLock for "docker-flags-081000"

	I0910 11:06:40.843967    5109 start.go:93] Provisioning new machine with config: &{Name:docker-flags-081000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-081000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:40.844162    5109 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:40.855629    5109 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:40.905202    5109 start.go:159] libmachine.API.Create for "docker-flags-081000" (driver="qemu2")

	I0910 11:06:40.905253    5109 client.go:168] LocalClient.Create starting

	I0910 11:06:40.905410    5109 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:40.905465    5109 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:40.905484    5109 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:40.905544    5109 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:40.905588    5109 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:40.905600    5109 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:40.906210    5109 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:41.257279    5109 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:41.304789    5109 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:41.304794    5109 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:41.305023    5109 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:41.314082    5109 main.go:141] libmachine: STDOUT: 

	I0910 11:06:41.314102    5109 main.go:141] libmachine: STDERR: 

	I0910 11:06:41.314149    5109 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2 +20000M

	I0910 11:06:41.321953    5109 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:41.321968    5109 main.go:141] libmachine: STDERR: 

	I0910 11:06:41.321986    5109 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:41.321991    5109 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:41.322003    5109 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:41.322038    5109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ae:29:86:f4:48:de -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:41.323602    5109 main.go:141] libmachine: STDOUT: 

	I0910 11:06:41.323617    5109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:41.323637    5109 client.go:171] duration metric: took 418.389125ms to LocalClient.Create

	I0910 11:06:43.325771    5109 start.go:128] duration metric: took 2.481643833s to createHost

	I0910 11:06:43.325918    5109 start.go:83] releasing machines lock for "docker-flags-081000", held for 2.4820545s

	W0910 11:06:43.326012    5109 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:43.342270    5109 out.go:177] * Deleting "docker-flags-081000" in qemu2 ...

	W0910 11:06:43.386101    5109 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:43.386139    5109 start.go:729] Will try again in 5 seconds ...

	I0910 11:06:48.388185    5109 start.go:360] acquireMachinesLock for docker-flags-081000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:48.388364    5109 start.go:364] duration metric: took 142.833µs to acquireMachinesLock for "docker-flags-081000"

	I0910 11:06:48.388396    5109 start.go:93] Provisioning new machine with config: &{Name:docker-flags-081000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-081000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:48.388491    5109 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:48.395763    5109 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:48.422041    5109 start.go:159] libmachine.API.Create for "docker-flags-081000" (driver="qemu2")

	I0910 11:06:48.422076    5109 client.go:168] LocalClient.Create starting

	I0910 11:06:48.422144    5109 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:48.422176    5109 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:48.422191    5109 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:48.422229    5109 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:48.422249    5109 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:48.422261    5109 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:48.425468    5109 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:48.871397    5109 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:48.933756    5109 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:48.933762    5109 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:48.933938    5109 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:48.942922    5109 main.go:141] libmachine: STDOUT: 

	I0910 11:06:48.942940    5109 main.go:141] libmachine: STDERR: 

	I0910 11:06:48.942996    5109 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2 +20000M

	I0910 11:06:48.950847    5109 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:48.950861    5109 main.go:141] libmachine: STDERR: 

	I0910 11:06:48.950878    5109 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:48.950887    5109 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:48.950896    5109 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:48.950933    5109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:db:0b:dd:3f:21 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/docker-flags-081000/disk.qcow2

	I0910 11:06:48.952525    5109 main.go:141] libmachine: STDOUT: 

	I0910 11:06:48.952543    5109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:48.952556    5109 client.go:171] duration metric: took 530.489917ms to LocalClient.Create

	I0910 11:06:50.954730    5109 start.go:128] duration metric: took 2.56627075s to createHost

	I0910 11:06:50.954817    5109 start.go:83] releasing machines lock for "docker-flags-081000", held for 2.566505083s

	W0910 11:06:50.955271    5109 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-081000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-081000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:50.972805    5109 out.go:201] 

	W0910 11:06:50.977077    5109 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:06:50.977118    5109 out.go:270] * 

	* 

	W0910 11:06:50.979079    5109 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:06:50.987893    5109 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-081000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-081000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-081000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (94.3255ms)

-- stdout --

	* The control-plane node docker-flags-081000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-081000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-081000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-081000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-081000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-081000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-081000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-081000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-081000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (89.766833ms)

-- stdout --

	* The control-plane node docker-flags-081000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-081000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-081000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-081000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-081000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-081000\"\n"

panic.go:626: *** TestDockerFlags FAILED at 2024-09-10 11:06:51.185047 -0700 PDT m=+2310.647763376

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-081000 -n docker-flags-081000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-081000 -n docker-flags-081000: exit status 7 (33.3975ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-081000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-081000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-081000

--- FAIL: TestDockerFlags (12.91s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-278000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-278000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (12.626624042s)

-- stdout --

	* [force-systemd-flag-278000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-278000" primary control-plane node in "force-systemd-flag-278000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-278000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:06:35.758005    5088 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:06:35.758157    5088 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:35.758160    5088 out.go:358] Setting ErrFile to fd 2...

	I0910 11:06:35.758162    5088 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:35.758288    5088 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:06:35.759536    5088 out.go:352] Setting JSON to false

	I0910 11:06:35.778871    5088 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3959,"bootTime":1725987636,"procs":474,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:06:35.778965    5088 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:06:35.842870    5088 out.go:177] * [force-systemd-flag-278000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:06:35.851779    5088 notify.go:220] Checking for updates...

	I0910 11:06:35.857827    5088 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:06:35.864567    5088 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:06:35.877685    5088 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:06:35.884790    5088 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:06:35.892795    5088 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:06:35.899692    5088 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:06:35.904448    5088 config.go:182] Loaded profile config "force-systemd-env-177000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:35.904562    5088 config.go:182] Loaded profile config "multinode-416000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:35.904655    5088 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:06:35.919738    5088 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 11:06:35.929737    5088 start.go:297] selected driver: qemu2

	I0910 11:06:35.929748    5088 start.go:901] validating driver "qemu2" against <nil>

	I0910 11:06:35.929761    5088 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:06:35.933752    5088 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 11:06:35.944743    5088 out.go:177] * Automatically selected the socket_vmnet network

	I0910 11:06:35.947975    5088 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0910 11:06:35.948034    5088 cni.go:84] Creating CNI manager for ""

	I0910 11:06:35.948047    5088 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 11:06:35.948055    5088 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0910 11:06:35.948113    5088 start.go:340] cluster config:

	{Name:force-systemd-flag-278000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-278000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static

IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:06:35.954479    5088 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:06:35.969838    5088 out.go:177] * Starting "force-systemd-flag-278000" primary control-plane node in "force-systemd-flag-278000" cluster

	I0910 11:06:35.973787    5088 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:06:35.973819    5088 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:06:35.973835    5088 cache.go:56] Caching tarball of preloaded images

	I0910 11:06:35.973969    5088 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:06:35.973984    5088 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:06:35.974097    5088 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/force-systemd-flag-278000/config.json ...

	I0910 11:06:35.974118    5088 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/force-systemd-flag-278000/config.json: {Name:mk3b20719560a5e121cd4107ed0869ab1f295b09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 11:06:35.974671    5088 start.go:360] acquireMachinesLock for force-systemd-flag-278000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:38.126275    5088 start.go:364] duration metric: took 2.151614791s to acquireMachinesLock for "force-systemd-flag-278000"

	I0910 11:06:38.126485    5088 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-278000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-278000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:38.126669    5088 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:38.140036    5088 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:38.191795    5088 start.go:159] libmachine.API.Create for "force-systemd-flag-278000" (driver="qemu2")

	I0910 11:06:38.191850    5088 client.go:168] LocalClient.Create starting

	I0910 11:06:38.191962    5088 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:38.192021    5088 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:38.192036    5088 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:38.192121    5088 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:38.192165    5088 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:38.192180    5088 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:38.192818    5088 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:38.730133    5088 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:38.823618    5088 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:38.823623    5088 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:38.823811    5088 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:38.833071    5088 main.go:141] libmachine: STDOUT: 

	I0910 11:06:38.833090    5088 main.go:141] libmachine: STDERR: 

	I0910 11:06:38.833149    5088 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2 +20000M

	I0910 11:06:38.840922    5088 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:38.840935    5088 main.go:141] libmachine: STDERR: 

	I0910 11:06:38.840950    5088 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:38.840953    5088 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:38.840966    5088 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:38.840995    5088 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/qemu.pid -device virtio-net-pci,netdev=net0,mac=46:4f:2b:04:d7:2d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:38.842591    5088 main.go:141] libmachine: STDOUT: 

	I0910 11:06:38.842618    5088 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:38.842638    5088 client.go:171] duration metric: took 650.799416ms to LocalClient.Create

	I0910 11:06:40.843568    5088 start.go:128] duration metric: took 2.716944625s to createHost

	I0910 11:06:40.843649    5088 start.go:83] releasing machines lock for "force-systemd-flag-278000", held for 2.717402625s

	W0910 11:06:40.843711    5088 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:40.863601    5088 out.go:177] * Deleting "force-systemd-flag-278000" in qemu2 ...

	W0910 11:06:40.888149    5088 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:40.888166    5088 start.go:729] Will try again in 5 seconds ...

	I0910 11:06:45.890198    5088 start.go:360] acquireMachinesLock for force-systemd-flag-278000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:45.890748    5088 start.go:364] duration metric: took 424.875µs to acquireMachinesLock for "force-systemd-flag-278000"

	I0910 11:06:45.890926    5088 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-278000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-278000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:45.891253    5088 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:45.913761    5088 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:45.965157    5088 start.go:159] libmachine.API.Create for "force-systemd-flag-278000" (driver="qemu2")

	I0910 11:06:45.965209    5088 client.go:168] LocalClient.Create starting

	I0910 11:06:45.965316    5088 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:45.965384    5088 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:45.965403    5088 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:45.965479    5088 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:45.965523    5088 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:45.965535    5088 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:45.966056    5088 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:46.138449    5088 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:46.284796    5088 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:46.284802    5088 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:46.285038    5088 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:46.294404    5088 main.go:141] libmachine: STDOUT: 

	I0910 11:06:46.294431    5088 main.go:141] libmachine: STDERR: 

	I0910 11:06:46.294477    5088 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2 +20000M

	I0910 11:06:46.302184    5088 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:46.302200    5088 main.go:141] libmachine: STDERR: 

	I0910 11:06:46.302220    5088 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:46.302230    5088 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:46.302241    5088 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:46.302269    5088 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/qemu.pid -device virtio-net-pci,netdev=net0,mac=1a:0c:2c:b3:a8:b5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-flag-278000/disk.qcow2

	I0910 11:06:46.303773    5088 main.go:141] libmachine: STDOUT: 

	I0910 11:06:46.303788    5088 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:46.303800    5088 client.go:171] duration metric: took 338.596208ms to LocalClient.Create

	I0910 11:06:48.305926    5088 start.go:128] duration metric: took 2.414708459s to createHost

	I0910 11:06:48.305999    5088 start.go:83] releasing machines lock for "force-systemd-flag-278000", held for 2.415255042s

	W0910 11:06:48.306346    5088 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-278000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-278000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:48.322878    5088 out.go:201] 

	W0910 11:06:48.324539    5088 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:06:48.324565    5088 out.go:270] * 

	* 

	W0910 11:06:48.327238    5088 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:06:48.339854    5088 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-278000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-278000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-278000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (81.062666ms)

-- stdout --

	* The control-plane node force-systemd-flag-278000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-278000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-278000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-09-10 11:06:48.437022 -0700 PDT m=+2307.899665668

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-278000 -n force-systemd-flag-278000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-278000 -n force-systemd-flag-278000: exit status 7 (37.839583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-278000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-278000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-278000

--- FAIL: TestForceSystemdFlag (12.93s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-177000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-177000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.069717042s)

-- stdout --

	* [force-systemd-env-177000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-177000" primary control-plane node in "force-systemd-env-177000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-177000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:06:28.132045    5050 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:06:28.132166    5050 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:28.132169    5050 out.go:358] Setting ErrFile to fd 2...

	I0910 11:06:28.132171    5050 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:06:28.132288    5050 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:06:28.133413    5050 out.go:352] Setting JSON to false

	I0910 11:06:28.149453    5050 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3952,"bootTime":1725987636,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:06:28.149535    5050 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:06:28.156260    5050 out.go:177] * [force-systemd-env-177000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:06:28.165143    5050 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:06:28.165167    5050 notify.go:220] Checking for updates...

	I0910 11:06:28.172098    5050 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:06:28.175141    5050 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:06:28.178118    5050 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:06:28.181059    5050 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:06:28.184144    5050 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0910 11:06:28.187489    5050 config.go:182] Loaded profile config "multinode-416000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:06:28.187540    5050 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:06:28.192118    5050 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 11:06:28.199158    5050 start.go:297] selected driver: qemu2

	I0910 11:06:28.199163    5050 start.go:901] validating driver "qemu2" against <nil>

	I0910 11:06:28.199168    5050 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:06:28.201371    5050 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 11:06:28.204133    5050 out.go:177] * Automatically selected the socket_vmnet network

	I0910 11:06:28.207221    5050 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0910 11:06:28.207259    5050 cni.go:84] Creating CNI manager for ""

	I0910 11:06:28.207268    5050 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 11:06:28.207287    5050 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0910 11:06:28.207319    5050 start.go:340] cluster config:

	{Name:force-systemd-env-177000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-177000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l

ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:06:28.210982    5050 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:06:28.219057    5050 out.go:177] * Starting "force-systemd-env-177000" primary control-plane node in "force-systemd-env-177000" cluster

	I0910 11:06:28.223184    5050 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:06:28.223204    5050 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:06:28.223213    5050 cache.go:56] Caching tarball of preloaded images

	I0910 11:06:28.223277    5050 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:06:28.223283    5050 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:06:28.223355    5050 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/force-systemd-env-177000/config.json ...

	I0910 11:06:28.223367    5050 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/force-systemd-env-177000/config.json: {Name:mke385b317e40ba2a455d0301c9ed21b10968505 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 11:06:28.223596    5050 start.go:360] acquireMachinesLock for force-systemd-env-177000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:28.223631    5050 start.go:364] duration metric: took 27.625µs to acquireMachinesLock for "force-systemd-env-177000"

	I0910 11:06:28.223643    5050 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-177000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-177000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:28.223672    5050 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:28.232085    5050 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:28.249694    5050 start.go:159] libmachine.API.Create for "force-systemd-env-177000" (driver="qemu2")

	I0910 11:06:28.249728    5050 client.go:168] LocalClient.Create starting

	I0910 11:06:28.249792    5050 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:28.249825    5050 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:28.249835    5050 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:28.249877    5050 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:28.249899    5050 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:28.249908    5050 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:28.250251    5050 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:28.409803    5050 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:28.612333    5050 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:28.612341    5050 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:28.612557    5050 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:28.621885    5050 main.go:141] libmachine: STDOUT: 

	I0910 11:06:28.621903    5050 main.go:141] libmachine: STDERR: 

	I0910 11:06:28.621954    5050 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2 +20000M

	I0910 11:06:28.630044    5050 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:28.630060    5050 main.go:141] libmachine: STDERR: 

	I0910 11:06:28.630077    5050 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:28.630080    5050 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:28.630096    5050 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:28.630130    5050 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:93:06:5a:1b:e7 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:28.631747    5050 main.go:141] libmachine: STDOUT: 

	I0910 11:06:28.631762    5050 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:28.631781    5050 client.go:171] duration metric: took 382.058ms to LocalClient.Create

	I0910 11:06:30.633913    5050 start.go:128] duration metric: took 2.410290667s to createHost

	I0910 11:06:30.633999    5050 start.go:83] releasing machines lock for "force-systemd-env-177000", held for 2.410421917s

	W0910 11:06:30.634042    5050 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:30.644500    5050 out.go:177] * Deleting "force-systemd-env-177000" in qemu2 ...

	W0910 11:06:30.671436    5050 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:30.671460    5050 start.go:729] Will try again in 5 seconds ...

	I0910 11:06:35.671481    5050 start.go:360] acquireMachinesLock for force-systemd-env-177000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:06:35.671642    5050 start.go:364] duration metric: took 115.333µs to acquireMachinesLock for "force-systemd-env-177000"

	I0910 11:06:35.671679    5050 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-177000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-177000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:06:35.671753    5050 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:06:35.684757    5050 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0910 11:06:35.706068    5050 start.go:159] libmachine.API.Create for "force-systemd-env-177000" (driver="qemu2")

	I0910 11:06:35.706106    5050 client.go:168] LocalClient.Create starting

	I0910 11:06:35.706194    5050 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:06:35.706241    5050 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:35.706250    5050 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:35.706295    5050 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:06:35.706327    5050 main.go:141] libmachine: Decoding PEM data...

	I0910 11:06:35.706339    5050 main.go:141] libmachine: Parsing certificate...

	I0910 11:06:35.706664    5050 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:06:36.059151    5050 main.go:141] libmachine: Creating SSH key...

	I0910 11:06:36.105566    5050 main.go:141] libmachine: Creating Disk image...

	I0910 11:06:36.105572    5050 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:06:36.105774    5050 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:36.114891    5050 main.go:141] libmachine: STDOUT: 

	I0910 11:06:36.114912    5050 main.go:141] libmachine: STDERR: 

	I0910 11:06:36.114968    5050 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2 +20000M

	I0910 11:06:36.122821    5050 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:06:36.122837    5050 main.go:141] libmachine: STDERR: 

	I0910 11:06:36.122847    5050 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:36.122850    5050 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:06:36.122862    5050 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:06:36.122895    5050 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/qemu.pid -device virtio-net-pci,netdev=net0,mac=da:b2:99:b4:02:7e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/force-systemd-env-177000/disk.qcow2

	I0910 11:06:36.124470    5050 main.go:141] libmachine: STDOUT: 

	I0910 11:06:36.124496    5050 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:06:36.124508    5050 client.go:171] duration metric: took 418.39925ms to LocalClient.Create

	I0910 11:06:38.126034    5050 start.go:128] duration metric: took 2.45432125s to createHost

	I0910 11:06:38.126102    5050 start.go:83] releasing machines lock for "force-systemd-env-177000", held for 2.454509667s

	W0910 11:06:38.126399    5050 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-177000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-177000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:06:38.144117    5050 out.go:201] 

	W0910 11:06:38.151150    5050 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:06:38.151188    5050 out.go:270] * 

	* 

	W0910 11:06:38.153713    5050 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:06:38.162074    5050 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-177000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-177000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-177000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (91.564209ms)

-- stdout --

	* The control-plane node force-systemd-env-177000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-177000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-177000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-09-10 11:06:38.265431 -0700 PDT m=+2297.727803960

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-177000 -n force-systemd-env-177000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-177000 -n force-systemd-env-177000: exit status 7 (37.811916ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-177000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-177000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-177000

--- FAIL: TestForceSystemdEnv (10.39s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-475000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-475000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-65d86f57f4-qd6cf" [aca21656-a313-43c4-a6d8-17b3e35fba6a] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:344: "hello-node-connect-65d86f57f4-qd6cf" [aca21656-a313-43c4-a6d8-17b3e35fba6a] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.010672541s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-475000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:32163

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

E0910 10:47:48.525807    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:32163: Get "http://192.168.105.4:32163": dial tcp 192.168.105.4:32163: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-475000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-qd6cf

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-475000/192.168.105.4

Start Time:       Tue, 10 Sep 2024 10:47:31 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.9

IPs:

IP:           10.244.0.9

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://2d9432059a25a7c94f20e690e3b7239c127c7d477b85d68834f45c938d00ee25

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       CrashLoopBackOff

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Tue, 10 Sep 2024 10:47:52 -0700

Finished:     Tue, 10 Sep 2024 10:47:52 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8k8mx (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-8k8mx:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  39s                default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-qd6cf to functional-475000

Normal   Pulling    39s                kubelet            Pulling image "registry.k8s.io/echoserver-arm:1.8"

Normal   Pulled     34s                kubelet            Successfully pulled image "registry.k8s.io/echoserver-arm:1.8" in 4.802s (4.802s including waiting). Image size: 84957542 bytes.

Normal   Created    18s (x3 over 34s)  kubelet            Created container echoserver-arm

Normal   Started    18s (x3 over 34s)  kubelet            Started container echoserver-arm

Normal   Pulled     18s (x2 over 33s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Warning  BackOff    3s (x4 over 32s)   kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-qd6cf_default(aca21656-a313-43c4-a6d8-17b3e35fba6a)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-475000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-475000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.107.228.198

IPs:                      10.107.228.198

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  32163/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-475000 -n functional-475000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-475000 logs -n 25

2024/09/10 10:48:11 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|  Command  |                                                         Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| service   | functional-475000 service                                                                                            | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | hello-node --url                                                                                                     |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port1927916988/001:/mount-9p      |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh -- ls                                                                                          | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh cat                                                                                            | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | /mount-9p/test-1725990471988822000                                                                                   |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh stat                                                                                           | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | /mount-9p/created-by-test                                                                                            |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh stat                                                                                           | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | /mount-9p/created-by-pod                                                                                             |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh sudo                                                                                           | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port2407826175/001:/mount-9p |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1 --port 46464                                                                                  |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh -- ls                                                                                          | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:47 PDT |

	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh sudo                                                                                           | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2300655594/001:/mount3   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT | 10 Sep 24 10:48 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2300655594/001:/mount1   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:47 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2300655594/001:/mount2   |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT | 10 Sep 24 10:48 PDT |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-475000 ssh findmnt                                                                                        | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT | 10 Sep 24 10:48 PDT |

	|           | -T /mount3                                                                                                           |                   |         |         |                     |                     |

	| mount     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT |                     |

	|           | --kill=true                                                                                                          |                   |         |         |                     |                     |

	| start     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-475000                                                                                                 | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-475000 --dry-run                                                                                       | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| dashboard | --url --port 36195                                                                                                   | functional-475000 | jenkins | v1.34.0 | 10 Sep 24 10:48 PDT |                     |

	|           | -p functional-475000                                                                                                 |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/10 10:48:00

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0910 10:48:00.931412    2953 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:48:00.934357    2953 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:48:00.934361    2953 out.go:358] Setting ErrFile to fd 2...

	I0910 10:48:00.934364    2953 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:48:00.934515    2953 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 10:48:00.938642    2953 out.go:352] Setting JSON to false

	I0910 10:48:00.955489    2953 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2844,"bootTime":1725987636,"procs":474,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 10:48:00.955549    2953 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 10:48:00.960381    2953 out.go:177] * [functional-475000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 10:48:00.968295    2953 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 10:48:00.968370    2953 notify.go:220] Checking for updates...

	I0910 10:48:00.975339    2953 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 10:48:00.978292    2953 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 10:48:00.981324    2953 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 10:48:00.984244    2953 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 10:48:00.987326    2953 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 10:48:00.990666    2953 config.go:182] Loaded profile config "functional-475000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:48:00.990921    2953 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 10:48:00.995324    2953 out.go:177] * Using the qemu2 driver based on existing profile

	I0910 10:48:01.002326    2953 start.go:297] selected driver: qemu2

	I0910 10:48:01.002336    2953 start.go:901] validating driver "qemu2" against &{Name:functional-475000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub

ernetesVersion:v1.31.0 ClusterName:functional-475000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat

ion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 10:48:01.002393    2953 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 10:48:01.004653    2953 cni.go:84] Creating CNI manager for ""

	I0910 10:48:01.004670    2953 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0910 10:48:01.004725    2953 start.go:340] cluster config:

	{Name:functional-475000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-475000 Namespace:default APIServe

rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 10:48:01.017349    2953 out.go:177] * dry-run validation complete!

	==> Docker <==

	Sep 10 17:48:01 functional-475000 dockerd[6043]: time="2024-09-10T17:48:01.970717372Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:01 functional-475000 dockerd[6043]: time="2024-09-10T17:48:01.970782959Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:01 functional-475000 dockerd[6043]: time="2024-09-10T17:48:01.989763203Z" level=info msg="shim disconnected" id=dd3ada909d53810d3c8eb611c7404ea4ad09be3cc337f6f29ed56f3e17cff875 namespace=moby

	Sep 10 17:48:01 functional-475000 dockerd[6043]: time="2024-09-10T17:48:01.989831457Z" level=warning msg="cleaning up after shim disconnected" id=dd3ada909d53810d3c8eb611c7404ea4ad09be3cc337f6f29ed56f3e17cff875 namespace=moby

	Sep 10 17:48:01 functional-475000 dockerd[6043]: time="2024-09-10T17:48:01.989848458Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 10 17:48:01 functional-475000 dockerd[6036]: time="2024-09-10T17:48:01.990042720Z" level=info msg="ignoring event" container=dd3ada909d53810d3c8eb611c7404ea4ad09be3cc337f6f29ed56f3e17cff875 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 10 17:48:02 functional-475000 dockerd[6043]: time="2024-09-10T17:48:02.011545285Z" level=warning msg="cleanup warnings time=\"2024-09-10T17:48:02Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=moby

	Sep 10 17:48:02 functional-475000 dockerd[6043]: time="2024-09-10T17:48:02.014232408Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 10 17:48:02 functional-475000 dockerd[6043]: time="2024-09-10T17:48:02.014342914Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 10 17:48:02 functional-475000 dockerd[6043]: time="2024-09-10T17:48:02.014373124Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:02 functional-475000 dockerd[6043]: time="2024-09-10T17:48:02.014692561Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:02 functional-475000 cri-dockerd[6296]: time="2024-09-10T17:48:02Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/ae0b4ba61634273811b5f8a798d2b8f35a1c2b2d009ab6e1ee9668f93dd6aa43/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Sep 10 17:48:02 functional-475000 cri-dockerd[6296]: time="2024-09-10T17:48:02Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/400327eaf2fa015d0d55d8c191cbd600d1d15a6c518fc61bdc1cb66304711f19/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Sep 10 17:48:02 functional-475000 dockerd[6036]: time="2024-09-10T17:48:02.285376407Z" level=warning msg="reference for unknown type: " digest="sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c" remote="docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"

	Sep 10 17:48:04 functional-475000 cri-dockerd[6296]: time="2024-09-10T17:48:04Z" level=info msg="Stop pulling image docker.io/kubernetesui/metrics-scraper:v1.0.8@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c: Status: Downloaded newer image for kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"

	Sep 10 17:48:04 functional-475000 dockerd[6043]: time="2024-09-10T17:48:04.090541639Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 10 17:48:04 functional-475000 dockerd[6043]: time="2024-09-10T17:48:04.090596434Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 10 17:48:04 functional-475000 dockerd[6043]: time="2024-09-10T17:48:04.090610643Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:04 functional-475000 dockerd[6043]: time="2024-09-10T17:48:04.090645729Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:04 functional-475000 dockerd[6036]: time="2024-09-10T17:48:04.253413755Z" level=warning msg="reference for unknown type: " digest="sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93" remote="docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"

	Sep 10 17:48:09 functional-475000 cri-dockerd[6296]: time="2024-09-10T17:48:09Z" level=info msg="Stop pulling image docker.io/kubernetesui/dashboard:v2.7.0@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93: Status: Downloaded newer image for kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"

	Sep 10 17:48:09 functional-475000 dockerd[6043]: time="2024-09-10T17:48:09.702047602Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 10 17:48:09 functional-475000 dockerd[6043]: time="2024-09-10T17:48:09.702113022Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 10 17:48:09 functional-475000 dockerd[6043]: time="2024-09-10T17:48:09.702121148Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 10 17:48:09 functional-475000 dockerd[6043]: time="2024-09-10T17:48:09.702152816Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	==> container status <==

	CONTAINER           IMAGE                                                                                                  CREATED              STATE               NAME                        ATTEMPT             POD ID              POD

	7c92cb867c6aa       kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93         2 seconds ago        Running             kubernetes-dashboard        0                   400327eaf2fa0       kubernetes-dashboard-695b96c756-p79k8

	fd45f8373a09e       kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c   7 seconds ago        Running             dashboard-metrics-scraper   0                   ae0b4ba616342       dashboard-metrics-scraper-c5db448b4-pfc5t

	dd3ada909d538       72565bf5bbedf                                                                                          10 seconds ago       Exited              echoserver-arm              2                   e55b0b8878994       hello-node-64b4f8f9ff-9prtd

	6eeb9caea8261       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e    15 seconds ago       Exited              mount-munger                0                   a201eb5934ef1       busybox-mount

	2d9432059a25a       72565bf5bbedf                                                                                          19 seconds ago       Exited              echoserver-arm              2                   2453115ebe84d       hello-node-connect-65d86f57f4-qd6cf

	54e8711dac1c3       nginx@sha256:04ba374043ccd2fc5c593885c0eacddebabd5ca375f9323666f28dfd5a9710e3                          33 seconds ago       Running             myfrontend                  0                   7eeb8a1e924cd       sp-pod

	39f67e3ed2123       nginx@sha256:a5127daff3d6f4606be3100a252419bfa84fd6ee5cd74d0feaca1a5068f97dcf                          47 seconds ago       Running             nginx                       0                   61ac0bae3b223       nginx-svc

	1fa349b85817b       2437cf7621777                                                                                          About a minute ago   Running             coredns                     2                   cdaabd630c438       coredns-6f6b679f8f-gszvc

	cfeb92f2bdf5b       ba04bb24b9575                                                                                          About a minute ago   Running             storage-provisioner         3                   37d4e5ee8e98d       storage-provisioner

	48255ff2837a5       71d55d66fd4ee                                                                                          About a minute ago   Running             kube-proxy                  2                   c095200024919       kube-proxy-bpbbn

	cd35900f4309b       27e3830e14027                                                                                          About a minute ago   Running             etcd                        2                   11d997a919128       etcd-functional-475000

	165b6af675ce2       fcb0683e6bdbd                                                                                          About a minute ago   Running             kube-controller-manager     2                   f86908d181f31       kube-controller-manager-functional-475000

	9a27a37ccce11       fbbbd428abb4d                                                                                          About a minute ago   Running             kube-scheduler              2                   0816ae3bd442c       kube-scheduler-functional-475000

	d66c79967b192       cd0f0ae0ec9e0                                                                                          About a minute ago   Running             kube-apiserver              0                   b1e176c8eb4ae       kube-apiserver-functional-475000

	ab442f1caf1ba       ba04bb24b9575                                                                                          About a minute ago   Exited              storage-provisioner         2                   6341a967bd1dc       storage-provisioner

	b31a7590b50f4       2437cf7621777                                                                                          2 minutes ago        Exited              coredns                     1                   6dd8af27cfa26       coredns-6f6b679f8f-gszvc

	abe6c45f4ef5c       71d55d66fd4ee                                                                                          2 minutes ago        Exited              kube-proxy                  1                   88950c76aba24       kube-proxy-bpbbn

	270d0659a50c3       27e3830e14027                                                                                          2 minutes ago        Exited              etcd                        1                   887a144afe33b       etcd-functional-475000

	4b45322f5d0cb       fcb0683e6bdbd                                                                                          2 minutes ago        Exited              kube-controller-manager     1                   45e6ddfec7654       kube-controller-manager-functional-475000

	fbbdaea2cab56       fbbbd428abb4d                                                                                          2 minutes ago        Exited              kube-scheduler              1                   fa1ea3e7dd052       kube-scheduler-functional-475000

	==> coredns [1fa349b85817] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:55599 - 7829 "HINFO IN 3453894030970443615.2183872578334871128. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.00504058s

	[INFO] 10.244.0.1:2911 - 41520 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000087089s

	[INFO] 10.244.0.1:12627 - 31916 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000101757s

	[INFO] 10.244.0.1:33901 - 51855 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000031044s

	[INFO] 10.244.0.1:8019 - 7412 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001125991s

	[INFO] 10.244.0.1:21999 - 32767 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000060129s

	[INFO] 10.244.0.1:24638 - 9428 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000142218s

	==> coredns [b31a7590b50f] <==

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:56391 - 40389 "HINFO IN 9072361897402976075.7858225347418940381. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.010251691s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	Name:               functional-475000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-475000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=37b4bace07cd53444288cad630e4db4b688b8c18

	                    minikube.k8s.io/name=functional-475000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_10T10_45_10_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 10 Sep 2024 17:45:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-475000

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 10 Sep 2024 17:48:09 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 10 Sep 2024 17:47:58 +0000   Tue, 10 Sep 2024 17:45:07 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 10 Sep 2024 17:47:58 +0000   Tue, 10 Sep 2024 17:45:07 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 10 Sep 2024 17:47:58 +0000   Tue, 10 Sep 2024 17:45:07 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 10 Sep 2024 17:47:58 +0000   Tue, 10 Sep 2024 17:45:14 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-475000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 c28bde55a0d741a9b9b21957ca36d85b

	  System UUID:                c28bde55a0d741a9b9b21957ca36d85b

	  Boot ID:                    bf15a2fc-356e-4e52-b118-dbd9d5393303

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (13 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-64b4f8f9ff-9prtd                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         27s

	  default                     hello-node-connect-65d86f57f4-qd6cf          0 (0%)        0 (0%)      0 (0%)           0 (0%)         40s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         50s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         34s

	  kube-system                 coredns-6f6b679f8f-gszvc                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m55s

	  kube-system                 etcd-functional-475000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         3m1s

	  kube-system                 kube-apiserver-functional-475000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         73s

	  kube-system                 kube-controller-manager-functional-475000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         3m1s

	  kube-system                 kube-proxy-bpbbn                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m56s

	  kube-system                 kube-scheduler-functional-475000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         3m1s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m55s

	  kubernetes-dashboard        dashboard-metrics-scraper-c5db448b4-pfc5t    0 (0%)        0 (0%)      0 (0%)           0 (0%)         10s

	  kubernetes-dashboard        kubernetes-dashboard-695b96c756-p79k8        0 (0%)        0 (0%)      0 (0%)           0 (0%)         10s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m54s                kube-proxy       

	  Normal  Starting                 72s                  kube-proxy       

	  Normal  Starting                 2m2s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  3m5s (x8 over 3m5s)  kubelet          Node functional-475000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m5s (x8 over 3m5s)  kubelet          Node functional-475000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m5s (x7 over 3m5s)  kubelet          Node functional-475000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m5s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 3m1s                 kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  3m1s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  3m1s                 kubelet          Node functional-475000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m1s                 kubelet          Node functional-475000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m1s                 kubelet          Node functional-475000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                2m57s                kubelet          Node functional-475000 status is now: NodeReady

	  Normal  RegisteredNode           2m56s                node-controller  Node functional-475000 event: Registered Node functional-475000 in Controller

	  Normal  Starting                 2m6s                 kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m6s (x8 over 2m6s)  kubelet          Node functional-475000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m6s (x8 over 2m6s)  kubelet          Node functional-475000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m6s (x7 over 2m6s)  kubelet          Node functional-475000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m6s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m                   node-controller  Node functional-475000 event: Registered Node functional-475000 in Controller

	  Normal  Starting                 78s                  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  78s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    77s (x8 over 78s)    kubelet          Node functional-475000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     77s (x7 over 78s)    kubelet          Node functional-475000 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  77s (x8 over 78s)    kubelet          Node functional-475000 status is now: NodeHasSufficientMemory

	  Normal  RegisteredNode           71s                  node-controller  Node functional-475000 event: Registered Node functional-475000 in Controller

	==> dmesg <==

	[ +14.750520] kauditd_printk_skb: 36 callbacks suppressed

	[  +2.313357] systemd-fstab-generator[5127]: Ignoring "noauto" option for root device

	[ +13.725755] systemd-fstab-generator[5570]: Ignoring "noauto" option for root device

	[  +0.054795] kauditd_printk_skb: 17 callbacks suppressed

	[  +0.098334] systemd-fstab-generator[5603]: Ignoring "noauto" option for root device

	[  +0.091859] systemd-fstab-generator[5615]: Ignoring "noauto" option for root device

	[  +0.091684] systemd-fstab-generator[5629]: Ignoring "noauto" option for root device

	[  +5.126089] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.375065] systemd-fstab-generator[6245]: Ignoring "noauto" option for root device

	[  +0.082407] systemd-fstab-generator[6257]: Ignoring "noauto" option for root device

	[  +0.075911] systemd-fstab-generator[6269]: Ignoring "noauto" option for root device

	[  +0.114581] systemd-fstab-generator[6284]: Ignoring "noauto" option for root device

	[  +0.211832] systemd-fstab-generator[6452]: Ignoring "noauto" option for root device

	[  +0.914100] systemd-fstab-generator[6573]: Ignoring "noauto" option for root device

	[  +4.432099] kauditd_printk_skb: 199 callbacks suppressed

	[Sep10 17:47] kauditd_printk_skb: 33 callbacks suppressed

	[  +7.607543] systemd-fstab-generator[7591]: Ignoring "noauto" option for root device

	[  +5.344770] kauditd_printk_skb: 16 callbacks suppressed

	[  +5.422664] kauditd_printk_skb: 29 callbacks suppressed

	[  +9.165311] kauditd_printk_skb: 13 callbacks suppressed

	[  +5.571833] kauditd_printk_skb: 11 callbacks suppressed

	[  +8.001405] kauditd_printk_skb: 29 callbacks suppressed

	[  +8.134069] kauditd_printk_skb: 20 callbacks suppressed

	[  +5.018374] kauditd_printk_skb: 17 callbacks suppressed

	[Sep10 17:48] kauditd_printk_skb: 30 callbacks suppressed

	==> etcd [270d0659a50c] <==

	{"level":"info","ts":"2024-09-10T17:46:07.704929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-09-10T17:46:07.705002Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-09-10T17:46:07.705045Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:07.705062Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:07.705087Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:07.705110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:07.710278Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:46:07.710272Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-475000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-10T17:46:07.710872Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:46:07.711189Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-10T17:46:07.711213Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-10T17:46:07.712269Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:46:07.712345Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:46:07.714577Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-10T17:46:07.714578Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-09-10T17:46:39.977671Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-09-10T17:46:39.977699Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-475000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-09-10T17:46:39.977737Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-10T17:46:39.977748Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-10T17:46:39.977767Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-10T17:46:39.977799Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"info","ts":"2024-09-10T17:46:39.992823Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-09-10T17:46:39.994431Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-10T17:46:39.994468Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-10T17:46:39.994472Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-475000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> etcd [cd35900f4309] <==

	{"level":"info","ts":"2024-09-10T17:46:55.005325Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-09-10T17:46:55.005378Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:46:55.005407Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-10T17:46:55.006391Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:46:55.006989Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2024-09-10T17:46:55.007077Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-10T17:46:55.007099Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-10T17:46:55.007624Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2024-09-10T17:46:55.007655Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-09-10T17:46:56.704835Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:56.705102Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:56.705167Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-10T17:46:56.705203Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-09-10T17:46:56.705221Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-10T17:46:56.705249Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-09-10T17:46:56.705366Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-10T17:46:56.709890Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-475000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-10T17:46:56.710186Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:46:56.710228Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-10T17:46:56.710956Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-10T17:46:56.711507Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-10T17:46:56.713284Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:46:56.713779Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-10T17:46:56.715256Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-10T17:46:56.732787Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	==> kernel <==

	 17:48:11 up 3 min,  0 users,  load average: 0.88, 0.53, 0.22

	Linux functional-475000 5.10.207 #1 SMP PREEMPT Mon Sep 9 22:12:33 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [d66c79967b19] <==

	I0910 17:46:57.312920       1 cache.go:39] Caches are synced for LocalAvailability controller

	I0910 17:46:57.312934       1 cache.go:39] Caches are synced for RemoteAvailability controller

	I0910 17:46:57.316303       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	I0910 17:46:57.321894       1 shared_informer.go:320] Caches are synced for crd-autoregister

	I0910 17:46:57.321952       1 aggregator.go:171] initial CRD sync complete...

	I0910 17:46:57.321977       1 autoregister_controller.go:144] Starting autoregister controller

	I0910 17:46:57.321985       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0910 17:46:57.321987       1 cache.go:39] Caches are synced for autoregister controller

	I0910 17:46:57.345075       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0910 17:46:58.216012       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0910 17:46:58.535293       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0910 17:46:58.539215       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0910 17:46:58.554254       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0910 17:46:58.561333       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0910 17:46:58.563409       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0910 17:47:00.582108       1 controller.go:615] quota admission added evaluator for: endpoints

	I0910 17:47:00.836811       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0910 17:47:16.316416       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.108.160.169"}

	I0910 17:47:21.084259       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.107.77.60"}

	I0910 17:47:31.510147       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0910 17:47:31.554099       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.107.228.198"}

	I0910 17:47:44.833849       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.96.142.82"}

	I0910 17:48:01.573497       1 controller.go:615] quota admission added evaluator for: namespaces

	I0910 17:48:01.651554       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.99.149.181"}

	I0910 17:48:01.665768       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.100.174.186"}

	==> kube-controller-manager [165b6af675ce] <==

	I0910 17:48:01.606350       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="15.301644ms"

	E0910 17:48:01.606572       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0910 17:48:01.610321       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="2.244179ms"

	E0910 17:48:01.610338       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0910 17:48:01.612489       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="4.487983ms"

	E0910 17:48:01.612507       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0910 17:48:01.617396       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="3.395124ms"

	E0910 17:48:01.617437       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0910 17:48:01.617462       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="4.762208ms"

	E0910 17:48:01.617468       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0910 17:48:01.631503       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="6.834334ms"

	I0910 17:48:01.641382       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="9.828559ms"

	I0910 17:48:01.641428       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="27.085µs"

	I0910 17:48:01.645680       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="6.517191ms"

	I0910 17:48:01.653242       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="7.535127ms"

	I0910 17:48:01.653316       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="32.002µs"

	I0910 17:48:01.657313       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="21.959µs"

	I0910 17:48:01.918021       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="36.461µs"

	I0910 17:48:02.023273       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="26.835µs"

	I0910 17:48:03.109250       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="37.21µs"

	I0910 17:48:04.139950       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="3.501917ms"

	I0910 17:48:04.141009       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="14.668µs"

	I0910 17:48:07.914323       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="24.252µs"

	I0910 17:48:10.218711       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="9.854714ms"

	I0910 17:48:10.218774       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="37.96µs"

	==> kube-controller-manager [4b45322f5d0c] <==

	I0910 17:46:11.597582       1 shared_informer.go:320] Caches are synced for bootstrap_signer

	I0910 17:46:11.597630       1 shared_informer.go:320] Caches are synced for service account

	I0910 17:46:11.597680       1 shared_informer.go:320] Caches are synced for taint-eviction-controller

	I0910 17:46:11.597710       1 shared_informer.go:320] Caches are synced for ReplicaSet

	I0910 17:46:11.597740       1 shared_informer.go:320] Caches are synced for crt configmap

	I0910 17:46:11.597754       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="23.835µs"

	I0910 17:46:11.597710       1 shared_informer.go:320] Caches are synced for PVC protection

	I0910 17:46:11.597846       1 shared_informer.go:320] Caches are synced for endpoint

	I0910 17:46:11.597577       1 shared_informer.go:320] Caches are synced for validatingadmissionpolicy-status

	I0910 17:46:11.599073       1 shared_informer.go:320] Caches are synced for certificate-csrsigning-legacy-unknown

	I0910 17:46:11.599106       1 shared_informer.go:320] Caches are synced for certificate-csrsigning-kubelet-serving

	I0910 17:46:11.599095       1 shared_informer.go:320] Caches are synced for certificate-csrsigning-kubelet-client

	I0910 17:46:11.599150       1 shared_informer.go:320] Caches are synced for certificate-csrsigning-kube-apiserver-client

	I0910 17:46:11.747796       1 shared_informer.go:320] Caches are synced for attach detach

	I0910 17:46:11.773450       1 shared_informer.go:320] Caches are synced for resource quota

	I0910 17:46:11.782144       1 shared_informer.go:320] Caches are synced for taint

	I0910 17:46:11.782209       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""

	I0910 17:46:11.782249       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-475000"

	I0910 17:46:11.782291       1 shared_informer.go:320] Caches are synced for daemon sets

	I0910 17:46:11.782297       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"

	I0910 17:46:11.800106       1 shared_informer.go:320] Caches are synced for resource quota

	I0910 17:46:12.209111       1 shared_informer.go:320] Caches are synced for garbage collector

	I0910 17:46:12.297525       1 shared_informer.go:320] Caches are synced for garbage collector

	I0910 17:46:12.297609       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0910 17:46:39.047336       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-475000"

	==> kube-proxy [48255ff2837a] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0910 17:46:58.467701       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0910 17:46:58.471039       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0910 17:46:58.471073       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0910 17:46:58.489295       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0910 17:46:58.489318       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0910 17:46:58.489333       1 server_linux.go:169] "Using iptables Proxier"

	I0910 17:46:58.490779       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0910 17:46:58.490883       1 server.go:483] "Version info" version="v1.31.0"

	I0910 17:46:58.490889       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0910 17:46:58.491436       1 config.go:197] "Starting service config controller"

	I0910 17:46:58.491442       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0910 17:46:58.491501       1 config.go:326] "Starting node config controller"

	I0910 17:46:58.491505       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0910 17:46:58.495106       1 config.go:104] "Starting endpoint slice config controller"

	I0910 17:46:58.495698       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0910 17:46:58.495704       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0910 17:46:58.592295       1 shared_informer.go:320] Caches are synced for node config

	I0910 17:46:58.596392       1 shared_informer.go:320] Caches are synced for service config

	==> kube-proxy [abe6c45f4ef5] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0910 17:46:08.946227       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0910 17:46:08.964535       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0910 17:46:08.964570       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0910 17:46:08.987435       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0910 17:46:08.987456       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0910 17:46:08.987471       1 server_linux.go:169] "Using iptables Proxier"

	I0910 17:46:08.989064       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0910 17:46:08.989176       1 server.go:483] "Version info" version="v1.31.0"

	I0910 17:46:08.989181       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0910 17:46:08.989788       1 config.go:197] "Starting service config controller"

	I0910 17:46:08.989794       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0910 17:46:08.989801       1 config.go:104] "Starting endpoint slice config controller"

	I0910 17:46:08.989803       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0910 17:46:08.989919       1 config.go:326] "Starting node config controller"

	I0910 17:46:08.989921       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0910 17:46:09.090079       1 shared_informer.go:320] Caches are synced for node config

	I0910 17:46:09.090079       1 shared_informer.go:320] Caches are synced for service config

	I0910 17:46:09.090097       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [9a27a37ccce1] <==

	I0910 17:46:55.525726       1 serving.go:386] Generated self-signed cert in-memory

	W0910 17:46:57.225514       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0910 17:46:57.225529       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0910 17:46:57.225534       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0910 17:46:57.225537       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0910 17:46:57.253219       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0910 17:46:57.258098       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0910 17:46:57.259192       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0910 17:46:57.262136       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0910 17:46:57.262383       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0910 17:46:57.263033       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0910 17:46:57.365763       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kube-scheduler [fbbdaea2cab5] <==

	I0910 17:46:06.885471       1 serving.go:386] Generated self-signed cert in-memory

	W0910 17:46:08.246337       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0910 17:46:08.246354       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0910 17:46:08.246360       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0910 17:46:08.246363       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0910 17:46:08.269468       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0910 17:46:08.269565       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0910 17:46:08.271052       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0910 17:46:08.271070       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0910 17:46:08.271207       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0910 17:46:08.271255       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0910 17:46:08.372023       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0910 17:46:39.963875       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I0910 17:46:39.963904       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"

	I0910 17:46:39.963965       1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	E0910 17:46:39.964050       1 run.go:72] "command failed" err="finished without leader elect"

	==> kubelet <==

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.197621    6580 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jtgg\" (UniqueName: \"kubernetes.io/projected/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-kube-api-access-7jtgg\") pod \"32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde\" (UID: \"32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde\") "

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.197648    6580 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-test-volume\") pod \"32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde\" (UID: \"32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde\") "

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.197706    6580 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-test-volume" (OuterVolumeSpecName: "test-volume") pod "32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde" (UID: "32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.200581    6580 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-kube-api-access-7jtgg" (OuterVolumeSpecName: "kube-api-access-7jtgg") pod "32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde" (UID: "32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde"). InnerVolumeSpecName "kube-api-access-7jtgg". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.297775    6580 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-7jtgg\" (UniqueName: \"kubernetes.io/projected/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-kube-api-access-7jtgg\") on node \"functional-475000\" DevicePath \"\""

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.297793    6580 reconciler_common.go:288] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde-test-volume\") on node \"functional-475000\" DevicePath \"\""

	Sep 10 17:47:58 functional-475000 kubelet[6580]: I0910 17:47:58.958914    6580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a201eb5934ef1da544944ac79e31bc1fe12206678523162a5a9d8899a37586ea"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: E0910 17:48:01.631129    6580 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde" containerName="mount-munger"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.631162    6580 memory_manager.go:354] "RemoveStaleState removing state" podUID="32c7d11c-4deb-40e9-a7b8-e5b1abcd5cde" containerName="mount-munger"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.725460    6580 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvxc\" (UniqueName: \"kubernetes.io/projected/f68c6d2f-8c38-4f7a-b87c-7cc9f164a3b0-kube-api-access-9dvxc\") pod \"dashboard-metrics-scraper-c5db448b4-pfc5t\" (UID: \"f68c6d2f-8c38-4f7a-b87c-7cc9f164a3b0\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-pfc5t"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.725480    6580 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68c6d2f-8c38-4f7a-b87c-7cc9f164a3b0-tmp-volume\") pod \"dashboard-metrics-scraper-c5db448b4-pfc5t\" (UID: \"f68c6d2f-8c38-4f7a-b87c-7cc9f164a3b0\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-pfc5t"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.725490    6580 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz67h\" (UniqueName: \"kubernetes.io/projected/82538be3-e591-4ca1-814c-a62044ae7994-kube-api-access-cz67h\") pod \"kubernetes-dashboard-695b96c756-p79k8\" (UID: \"82538be3-e591-4ca1-814c-a62044ae7994\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-p79k8"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.725500    6580 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/82538be3-e591-4ca1-814c-a62044ae7994-tmp-volume\") pod \"kubernetes-dashboard-695b96c756-p79k8\" (UID: \"82538be3-e591-4ca1-814c-a62044ae7994\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-p79k8"

	Sep 10 17:48:01 functional-475000 kubelet[6580]: I0910 17:48:01.909202    6580 scope.go:117] "RemoveContainer" containerID="d561bf517d0b579decdf3e4e8c7992c420dd48eed3b8fea97937bc7d72c660bf"

	Sep 10 17:48:02 functional-475000 kubelet[6580]: I0910 17:48:02.019172    6580 scope.go:117] "RemoveContainer" containerID="dd3ada909d53810d3c8eb611c7404ea4ad09be3cc337f6f29ed56f3e17cff875"

	Sep 10 17:48:02 functional-475000 kubelet[6580]: E0910 17:48:02.019254    6580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-9prtd_default(aba5f1eb-b400-4ffb-ba7c-42e959e1e05b)\"" pod="default/hello-node-64b4f8f9ff-9prtd" podUID="aba5f1eb-b400-4ffb-ba7c-42e959e1e05b"

	Sep 10 17:48:02 functional-475000 kubelet[6580]: I0910 17:48:02.041587    6580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae0b4ba61634273811b5f8a798d2b8f35a1c2b2d009ab6e1ee9668f93dd6aa43"

	Sep 10 17:48:02 functional-475000 kubelet[6580]: I0910 17:48:02.076365    6580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="400327eaf2fa015d0d55d8c191cbd600d1d15a6c518fc61bdc1cb66304711f19"

	Sep 10 17:48:03 functional-475000 kubelet[6580]: I0910 17:48:03.100678    6580 scope.go:117] "RemoveContainer" containerID="d561bf517d0b579decdf3e4e8c7992c420dd48eed3b8fea97937bc7d72c660bf"

	Sep 10 17:48:03 functional-475000 kubelet[6580]: I0910 17:48:03.101133    6580 scope.go:117] "RemoveContainer" containerID="dd3ada909d53810d3c8eb611c7404ea4ad09be3cc337f6f29ed56f3e17cff875"

	Sep 10 17:48:03 functional-475000 kubelet[6580]: E0910 17:48:03.101261    6580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-9prtd_default(aba5f1eb-b400-4ffb-ba7c-42e959e1e05b)\"" pod="default/hello-node-64b4f8f9ff-9prtd" podUID="aba5f1eb-b400-4ffb-ba7c-42e959e1e05b"

	Sep 10 17:48:04 functional-475000 kubelet[6580]: I0910 17:48:04.138526    6580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-pfc5t" podStartSLOduration=1.171550159 podStartE2EDuration="3.138516163s" podCreationTimestamp="2024-09-10 17:48:01 +0000 UTC" firstStartedPulling="2024-09-10 17:48:02.070557853 +0000 UTC m=+68.228727661" lastFinishedPulling="2024-09-10 17:48:04.037523857 +0000 UTC m=+70.195693665" observedRunningTime="2024-09-10 17:48:04.13846766 +0000 UTC m=+70.296637510" watchObservedRunningTime="2024-09-10 17:48:04.138516163 +0000 UTC m=+70.296685971"

	Sep 10 17:48:07 functional-475000 kubelet[6580]: I0910 17:48:07.908087    6580 scope.go:117] "RemoveContainer" containerID="2d9432059a25a7c94f20e690e3b7239c127c7d477b85d68834f45c938d00ee25"

	Sep 10 17:48:07 functional-475000 kubelet[6580]: E0910 17:48:07.908164    6580 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-qd6cf_default(aca21656-a313-43c4-a6d8-17b3e35fba6a)\"" pod="default/hello-node-connect-65d86f57f4-qd6cf" podUID="aca21656-a313-43c4-a6d8-17b3e35fba6a"

	Sep 10 17:48:10 functional-475000 kubelet[6580]: I0910 17:48:10.210348    6580 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-p79k8" podStartSLOduration=1.882795317 podStartE2EDuration="9.210327655s" podCreationTimestamp="2024-09-10 17:48:01 +0000 UTC" firstStartedPulling="2024-09-10 17:48:02.096384266 +0000 UTC m=+68.254554074" lastFinishedPulling="2024-09-10 17:48:09.423916604 +0000 UTC m=+75.582086412" observedRunningTime="2024-09-10 17:48:10.209741036 +0000 UTC m=+76.367910927" watchObservedRunningTime="2024-09-10 17:48:10.210327655 +0000 UTC m=+76.368497546"

	==> kubernetes-dashboard [7c92cb867c6a] <==

	2024/09/10 17:48:09 Using namespace: kubernetes-dashboard

	2024/09/10 17:48:09 Using in-cluster config to connect to apiserver

	2024/09/10 17:48:09 Using secret token for csrf signing

	2024/09/10 17:48:09 Initializing csrf token from kubernetes-dashboard-csrf secret

	2024/09/10 17:48:09 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2024/09/10 17:48:09 Successful initial request to the apiserver, version: v1.31.0

	2024/09/10 17:48:09 Generating JWE encryption key

	2024/09/10 17:48:09 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2024/09/10 17:48:09 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2024/09/10 17:48:09 Initializing JWE encryption key from synchronized object

	2024/09/10 17:48:09 Creating in-cluster Sidecar client

	2024/09/10 17:48:09 Serving insecurely on HTTP port: 9090

	2024/09/10 17:48:09 Successful request to sidecar

	2024/09/10 17:48:09 Starting overwatch

	==> storage-provisioner [ab442f1caf1b] <==

	I0910 17:46:23.530425       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0910 17:46:23.534666       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0910 17:46:23.534740       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	==> storage-provisioner [cfeb92f2bdf5] <==

	I0910 17:46:58.443817       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0910 17:46:58.457394       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0910 17:46:58.457411       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0910 17:47:15.866372       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0910 17:47:15.866645       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"00a3a283-a7f0-46b9-a3a5-c59fdb8c92c0", APIVersion:"v1", ResourceVersion:"667", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-475000_02878e91-927a-427f-a089-ce3c6a4b9195 became leader

	I0910 17:47:15.866697       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-475000_02878e91-927a-427f-a089-ce3c6a4b9195!

	I0910 17:47:15.970422       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-475000_02878e91-927a-427f-a089-ce3c6a4b9195!

	I0910 17:47:25.962070       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0910 17:47:25.962133       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    24be34a4-1723-45ee-9bcd-c93c0a2edfb8 371 0 2024-09-10 17:45:16 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-09-10 17:45:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-359016e0-fab1-44a2-b83d-93175ed1301e &PersistentVolumeClaim{ObjectMeta:{myclaim  default  359016e0-fab1-44a2-b83d-93175ed1301e 724 0 2024-09-10 17:47:25 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-09-10 17:47:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-09-10 17:47:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0910 17:47:25.962851       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"359016e0-fab1-44a2-b83d-93175ed1301e", APIVersion:"v1", ResourceVersion:"724", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0910 17:47:25.966236       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-359016e0-fab1-44a2-b83d-93175ed1301e" provisioned

	I0910 17:47:25.966327       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0910 17:47:25.966361       1 volume_store.go:212] Trying to save persistentvolume "pvc-359016e0-fab1-44a2-b83d-93175ed1301e"

	I0910 17:47:25.971388       1 volume_store.go:219] persistentvolume "pvc-359016e0-fab1-44a2-b83d-93175ed1301e" saved

	I0910 17:47:25.972148       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"359016e0-fab1-44a2-b83d-93175ed1301e", APIVersion:"v1", ResourceVersion:"724", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-359016e0-fab1-44a2-b83d-93175ed1301e

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-475000 -n functional-475000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-475000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-475000 describe pod busybox-mount

helpers_test.go:282: (dbg) kubectl --context functional-475000 describe pod busybox-mount:

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-475000/192.168.105.4

	Start Time:       Tue, 10 Sep 2024 10:47:53 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.12

	IPs:

	  IP:  10.244.0.12

	Containers:

	  mount-munger:

	    Container ID:  docker://6eeb9caea8261b6b25d510802e0b9ed0667e5419c61ef747dd38fb757e4347f7

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Tue, 10 Sep 2024 10:47:56 -0700

	      Finished:     Tue, 10 Sep 2024 10:47:56 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7jtgg (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-7jtgg:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  18s   default-scheduler  Successfully assigned default/busybox-mount to functional-475000

	  Normal  Pulling    18s   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     15s   kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 2.855s (2.855s including waiting). Image size: 3547125 bytes.

	  Normal  Created    15s   kubelet            Created container mount-munger

	  Normal  Started    15s   kubelet            Started container mount-munger

-- /stdout --

helpers_test.go:285: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (40.57s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 node stop m02 -v=7 --alsologtostderr

E0910 10:53:01.668373    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/functional-475000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-080000 node stop m02 -v=7 --alsologtostderr: (12.192472208s)

ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr

E0910 10:53:42.630135    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/functional-475000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr: exit status 7 (1m17.812359583s)

-- stdout --

	ha-080000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-080000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-080000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0910 10:53:07.320105    3542 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:53:07.320262    3542 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:53:07.320265    3542 out.go:358] Setting ErrFile to fd 2...

	I0910 10:53:07.320267    3542 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:53:07.320409    3542 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 10:53:07.320538    3542 out.go:352] Setting JSON to false

	I0910 10:53:07.320553    3542 mustload.go:65] Loading cluster: ha-080000

	I0910 10:53:07.320628    3542 notify.go:220] Checking for updates...

	I0910 10:53:07.320781    3542 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:53:07.320788    3542 status.go:255] checking status of ha-080000 ...

	I0910 10:53:07.321572    3542 status.go:330] ha-080000 host status = "Running" (err=<nil>)

	I0910 10:53:07.321582    3542 host.go:66] Checking if "ha-080000" exists ...

	I0910 10:53:07.321678    3542 host.go:66] Checking if "ha-080000" exists ...

	I0910 10:53:07.321791    3542 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:53:07.321799    3542 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/id_rsa Username:docker}

	W0910 10:53:33.247222    3542 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0910 10:53:33.247380    3542 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0910 10:53:33.247413    3542 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0910 10:53:33.247441    3542 status.go:257] ha-080000 status: &{Name:ha-080000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:53:33.247505    3542 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0910 10:53:33.247520    3542 status.go:255] checking status of ha-080000-m02 ...

	I0910 10:53:33.247936    3542 status.go:330] ha-080000-m02 host status = "Stopped" (err=<nil>)

	I0910 10:53:33.247946    3542 status.go:343] host is not running, skipping remaining checks

	I0910 10:53:33.247950    3542 status.go:257] ha-080000-m02 status: &{Name:ha-080000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 10:53:33.247960    3542 status.go:255] checking status of ha-080000-m03 ...

	I0910 10:53:33.249744    3542 status.go:330] ha-080000-m03 host status = "Running" (err=<nil>)

	I0910 10:53:33.249754    3542 host.go:66] Checking if "ha-080000-m03" exists ...

	I0910 10:53:33.249918    3542 host.go:66] Checking if "ha-080000-m03" exists ...

	I0910 10:53:33.250049    3542 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:53:33.250059    3542 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m03/id_rsa Username:docker}

	W0910 10:53:59.171681    3542 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0910 10:53:59.171733    3542 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0910 10:53:59.171743    3542 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0910 10:53:59.171747    3542 status.go:257] ha-080000-m03 status: &{Name:ha-080000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:53:59.171755    3542 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0910 10:53:59.171759    3542 status.go:255] checking status of ha-080000-m04 ...

	I0910 10:53:59.172418    3542 status.go:330] ha-080000-m04 host status = "Running" (err=<nil>)

	I0910 10:53:59.172425    3542 host.go:66] Checking if "ha-080000-m04" exists ...

	I0910 10:53:59.172533    3542 host.go:66] Checking if "ha-080000-m04" exists ...

	I0910 10:53:59.172657    3542 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:53:59.172663    3542 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m04/id_rsa Username:docker}

	W0910 10:54:25.095845    3542 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0910 10:54:25.095886    3542 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0910 10:54:25.095905    3542 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0910 10:54:25.095909    3542 status.go:257] ha-080000-m04 status: &{Name:ha-080000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:54:25.095917    3542 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-080000-m04

type: Worker

host: Error

kubelet: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 3 (25.958659792s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0910 10:54:51.054220    3599 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0910 10:54:51.054229    3599 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (115.96s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

E0910 10:55:04.550653    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/functional-475000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (27.711765916s)

ha_test.go:413: expected profile "ha-080000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-080000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-080000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-080000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\

":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docke

r\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 3 (25.956173709s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0910 10:55:44.721081    3636 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0910 10:55:44.721096    3636 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (53.67s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 node start m02 -v=7 --alsologtostderr

ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.08118075s)

-- stdout --

	* Starting "ha-080000-m02" control-plane node in "ha-080000" cluster

	* Restarting existing qemu2 VM for "ha-080000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-080000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 10:55:44.754769    3658 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:55:44.755034    3658 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:55:44.755041    3658 out.go:358] Setting ErrFile to fd 2...

	I0910 10:55:44.755043    3658 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:55:44.755173    3658 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 10:55:44.755415    3658 mustload.go:65] Loading cluster: ha-080000

	I0910 10:55:44.755648    3658 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0910 10:55:44.755886    3658 host.go:58] "ha-080000-m02" host status: Stopped

	I0910 10:55:44.760449    3658 out.go:177] * Starting "ha-080000-m02" control-plane node in "ha-080000" cluster

	I0910 10:55:44.764282    3658 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 10:55:44.764295    3658 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 10:55:44.764301    3658 cache.go:56] Caching tarball of preloaded images

	I0910 10:55:44.764376    3658 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 10:55:44.764381    3658 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 10:55:44.764433    3658 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/ha-080000/config.json ...

	I0910 10:55:44.764864    3658 start.go:360] acquireMachinesLock for ha-080000-m02: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 10:55:44.764902    3658 start.go:364] duration metric: took 25.667µs to acquireMachinesLock for "ha-080000-m02"

	I0910 10:55:44.764909    3658 start.go:96] Skipping create...Using existing machine configuration

	I0910 10:55:44.764913    3658 fix.go:54] fixHost starting: m02

	I0910 10:55:44.765003    3658 fix.go:112] recreateIfNeeded on ha-080000-m02: state=Stopped err=<nil>

	W0910 10:55:44.765009    3658 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 10:55:44.768429    3658 out.go:177] * Restarting existing qemu2 VM for "ha-080000-m02" ...

	I0910 10:55:44.769670    3658 qemu.go:418] Using hvf for hardware acceleration

	I0910 10:55:44.769772    3658 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:e6:c3:f2:e2:4c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/disk.qcow2

	I0910 10:55:44.772602    3658 main.go:141] libmachine: STDOUT: 

	I0910 10:55:44.772680    3658 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 10:55:44.772703    3658 fix.go:56] duration metric: took 7.789791ms for fixHost

	I0910 10:55:44.772706    3658 start.go:83] releasing machines lock for "ha-080000-m02", held for 7.800334ms

	W0910 10:55:44.772712    3658 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 10:55:44.772738    3658 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 10:55:44.772741    3658 start.go:729] Will try again in 5 seconds ...

	I0910 10:55:49.774660    3658 start.go:360] acquireMachinesLock for ha-080000-m02: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 10:55:49.774804    3658 start.go:364] duration metric: took 111.375µs to acquireMachinesLock for "ha-080000-m02"

	I0910 10:55:49.774862    3658 start.go:96] Skipping create...Using existing machine configuration

	I0910 10:55:49.774869    3658 fix.go:54] fixHost starting: m02

	I0910 10:55:49.775048    3658 fix.go:112] recreateIfNeeded on ha-080000-m02: state=Stopped err=<nil>

	W0910 10:55:49.775055    3658 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 10:55:49.778844    3658 out.go:177] * Restarting existing qemu2 VM for "ha-080000-m02" ...

	I0910 10:55:49.782855    3658 qemu.go:418] Using hvf for hardware acceleration

	I0910 10:55:49.782912    3658 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:e6:c3:f2:e2:4c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/disk.qcow2

	I0910 10:55:49.784855    3658 main.go:141] libmachine: STDOUT: 

	I0910 10:55:49.784873    3658 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 10:55:49.784896    3658 fix.go:56] duration metric: took 10.027667ms for fixHost

	I0910 10:55:49.784900    3658 start.go:83] releasing machines lock for "ha-080000-m02", held for 10.07075ms

	W0910 10:55:49.784947    3658 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 10:55:49.788850    3658 out.go:201] 

	W0910 10:55:49.792931    3658 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 10:55:49.792936    3658 out.go:270] * 

	* 

	W0910 10:55:49.794645    3658 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 10:55:49.798844    3658 out.go:201] 

** /stderr **

ha_test.go:422: I0910 10:55:44.754769    3658 out.go:345] Setting OutFile to fd 1 ...

I0910 10:55:44.755034    3658 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0910 10:55:44.755041    3658 out.go:358] Setting ErrFile to fd 2...

I0910 10:55:44.755043    3658 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0910 10:55:44.755173    3658 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

I0910 10:55:44.755415    3658 mustload.go:65] Loading cluster: ha-080000

I0910 10:55:44.755648    3658 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

W0910 10:55:44.755886    3658 host.go:58] "ha-080000-m02" host status: Stopped

I0910 10:55:44.760449    3658 out.go:177] * Starting "ha-080000-m02" control-plane node in "ha-080000" cluster

I0910 10:55:44.764282    3658 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

I0910 10:55:44.764295    3658 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

I0910 10:55:44.764301    3658 cache.go:56] Caching tarball of preloaded images

I0910 10:55:44.764376    3658 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

I0910 10:55:44.764381    3658 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

I0910 10:55:44.764433    3658 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/ha-080000/config.json ...

I0910 10:55:44.764864    3658 start.go:360] acquireMachinesLock for ha-080000-m02: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0910 10:55:44.764902    3658 start.go:364] duration metric: took 25.667µs to acquireMachinesLock for "ha-080000-m02"

I0910 10:55:44.764909    3658 start.go:96] Skipping create...Using existing machine configuration

I0910 10:55:44.764913    3658 fix.go:54] fixHost starting: m02

I0910 10:55:44.765003    3658 fix.go:112] recreateIfNeeded on ha-080000-m02: state=Stopped err=<nil>

W0910 10:55:44.765009    3658 fix.go:138] unexpected machine state, will restart: <nil>

I0910 10:55:44.768429    3658 out.go:177] * Restarting existing qemu2 VM for "ha-080000-m02" ...

I0910 10:55:44.769670    3658 qemu.go:418] Using hvf for hardware acceleration

I0910 10:55:44.769772    3658 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:e6:c3:f2:e2:4c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/disk.qcow2

I0910 10:55:44.772602    3658 main.go:141] libmachine: STDOUT: 

I0910 10:55:44.772680    3658 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0910 10:55:44.772703    3658 fix.go:56] duration metric: took 7.789791ms for fixHost

I0910 10:55:44.772706    3658 start.go:83] releasing machines lock for "ha-080000-m02", held for 7.800334ms

W0910 10:55:44.772712    3658 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0910 10:55:44.772738    3658 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0910 10:55:44.772741    3658 start.go:729] Will try again in 5 seconds ...

I0910 10:55:49.774660    3658 start.go:360] acquireMachinesLock for ha-080000-m02: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0910 10:55:49.774804    3658 start.go:364] duration metric: took 111.375µs to acquireMachinesLock for "ha-080000-m02"

I0910 10:55:49.774862    3658 start.go:96] Skipping create...Using existing machine configuration

I0910 10:55:49.774869    3658 fix.go:54] fixHost starting: m02

I0910 10:55:49.775048    3658 fix.go:112] recreateIfNeeded on ha-080000-m02: state=Stopped err=<nil>

W0910 10:55:49.775055    3658 fix.go:138] unexpected machine state, will restart: <nil>

I0910 10:55:49.778844    3658 out.go:177] * Restarting existing qemu2 VM for "ha-080000-m02" ...

I0910 10:55:49.782855    3658 qemu.go:418] Using hvf for hardware acceleration

I0910 10:55:49.782912    3658 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:e6:c3:f2:e2:4c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m02/disk.qcow2

I0910 10:55:49.784855    3658 main.go:141] libmachine: STDOUT: 

I0910 10:55:49.784873    3658 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0910 10:55:49.784896    3658 fix.go:56] duration metric: took 10.027667ms for fixHost

I0910 10:55:49.784900    3658 start.go:83] releasing machines lock for "ha-080000-m02", held for 10.07075ms

W0910 10:55:49.784947    3658 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

* Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0910 10:55:49.788850    3658 out.go:201] 

W0910 10:55:49.792931    3658 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0910 10:55:49.792936    3658 out.go:270] * 

* 

W0910 10:55:49.794645    3658 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0910 10:55:49.798844    3658 out.go:201] 

ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-080000 node start m02 -v=7 --alsologtostderr": exit status 80

ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr

E0910 10:57:07.521036    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr: exit status 7 (1m19.470207s)

-- stdout --

	ha-080000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-080000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-080000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0910 10:55:49.837066    3664 out.go:345] Setting OutFile to fd 1 ...

	I0910 10:55:49.837235    3664 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:55:49.837238    3664 out.go:358] Setting ErrFile to fd 2...

	I0910 10:55:49.837241    3664 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 10:55:49.837372    3664 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 10:55:49.837493    3664 out.go:352] Setting JSON to false

	I0910 10:55:49.837510    3664 mustload.go:65] Loading cluster: ha-080000

	I0910 10:55:49.837565    3664 notify.go:220] Checking for updates...

	I0910 10:55:49.837723    3664 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 10:55:49.837730    3664 status.go:255] checking status of ha-080000 ...

	I0910 10:55:49.838429    3664 status.go:330] ha-080000 host status = "Running" (err=<nil>)

	I0910 10:55:49.838439    3664 host.go:66] Checking if "ha-080000" exists ...

	I0910 10:55:49.838545    3664 host.go:66] Checking if "ha-080000" exists ...

	I0910 10:55:49.838650    3664 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:55:49.838658    3664 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/id_rsa Username:docker}

	W0910 10:55:49.838840    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0910 10:55:49.838857    3664 retry.go:31] will retry after 276.753955ms: dial tcp 192.168.105.5:22: connect: host is down

	W0910 10:55:50.117800    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0910 10:55:50.117824    3664 retry.go:31] will retry after 339.047015ms: dial tcp 192.168.105.5:22: connect: host is down

	W0910 10:55:50.459019    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0910 10:55:50.459038    3664 retry.go:31] will retry after 327.312579ms: dial tcp 192.168.105.5:22: connect: host is down

	W0910 10:55:50.788501    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0910 10:55:50.788521    3664 retry.go:31] will retry after 724.260485ms: dial tcp 192.168.105.5:22: connect: host is down

	W0910 10:56:17.429558    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0910 10:56:17.429629    3664 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0910 10:56:17.429641    3664 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0910 10:56:17.429645    3664 status.go:257] ha-080000 status: &{Name:ha-080000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:56:17.429660    3664 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0910 10:56:17.429667    3664 status.go:255] checking status of ha-080000-m02 ...

	I0910 10:56:17.429856    3664 status.go:330] ha-080000-m02 host status = "Stopped" (err=<nil>)

	I0910 10:56:17.429861    3664 status.go:343] host is not running, skipping remaining checks

	I0910 10:56:17.429863    3664 status.go:257] ha-080000-m02 status: &{Name:ha-080000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 10:56:17.429867    3664 status.go:255] checking status of ha-080000-m03 ...

	I0910 10:56:17.430637    3664 status.go:330] ha-080000-m03 host status = "Running" (err=<nil>)

	I0910 10:56:17.430645    3664 host.go:66] Checking if "ha-080000-m03" exists ...

	I0910 10:56:17.430754    3664 host.go:66] Checking if "ha-080000-m03" exists ...

	I0910 10:56:17.430875    3664 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:56:17.430881    3664 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m03/id_rsa Username:docker}

	W0910 10:56:43.350342    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0910 10:56:43.350400    3664 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0910 10:56:43.350407    3664 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0910 10:56:43.350417    3664 status.go:257] ha-080000-m03 status: &{Name:ha-080000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:56:43.350425    3664 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0910 10:56:43.350429    3664 status.go:255] checking status of ha-080000-m04 ...

	I0910 10:56:43.351073    3664 status.go:330] ha-080000-m04 host status = "Running" (err=<nil>)

	I0910 10:56:43.351081    3664 host.go:66] Checking if "ha-080000-m04" exists ...

	I0910 10:56:43.351192    3664 host.go:66] Checking if "ha-080000-m04" exists ...

	I0910 10:56:43.351309    3664 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0910 10:56:43.351314    3664 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000-m04/id_rsa Username:docker}

	W0910 10:57:09.270855    3664 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0910 10:57:09.270896    3664 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0910 10:57:09.270902    3664 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0910 10:57:09.270908    3664 status.go:257] ha-080000-m04 status: &{Name:ha-080000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0910 10:57:09.270916    3664 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

E0910 10:57:20.672215    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/functional-475000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 3 (25.956364208s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0910 10:57:35.226974    3715 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0910 10:57:35.226981    3715 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (110.51s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-080000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-080000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-080000 -v=7 --alsologtostderr: (2m10.911518791s)

ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-080000 --wait=true -v=7 --alsologtostderr

ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-080000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.226943541s)

-- stdout --

	* [ha-080000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-080000" primary control-plane node in "ha-080000" cluster

	* Restarting existing qemu2 VM for "ha-080000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-080000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:00:13.991534    4164 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:00:13.991765    4164 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:13.991769    4164 out.go:358] Setting ErrFile to fd 2...

	I0910 11:00:13.991772    4164 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:13.991962    4164 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:00:13.993194    4164 out.go:352] Setting JSON to false

	I0910 11:00:14.012980    4164 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3578,"bootTime":1725987636,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:00:14.013065    4164 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:00:14.017554    4164 out.go:177] * [ha-080000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:00:14.024524    4164 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:00:14.024551    4164 notify.go:220] Checking for updates...

	I0910 11:00:14.031427    4164 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:00:14.034455    4164 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:00:14.037510    4164 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:00:14.040461    4164 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:00:14.043455    4164 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:00:14.046838    4164 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:00:14.046888    4164 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:00:14.051352    4164 out.go:177] * Using the qemu2 driver based on existing profile

	I0910 11:00:14.058614    4164 start.go:297] selected driver: qemu2

	I0910 11:00:14.058623    4164 start.go:901] validating driver "qemu2" against &{Name:ha-080000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-080000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:

false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mou

nt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:00:14.058706    4164 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:00:14.061528    4164 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 11:00:14.061567    4164 cni.go:84] Creating CNI manager for ""

	I0910 11:00:14.061575    4164 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0910 11:00:14.061617    4164 start.go:340] cluster config:

	{Name:ha-080000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-080000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:00:14.065834    4164 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:00:14.074411    4164 out.go:177] * Starting "ha-080000" primary control-plane node in "ha-080000" cluster

	I0910 11:00:14.078354    4164 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:00:14.078372    4164 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:00:14.078381    4164 cache.go:56] Caching tarball of preloaded images

	I0910 11:00:14.078447    4164 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:00:14.078454    4164 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:00:14.078526    4164 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/ha-080000/config.json ...

	I0910 11:00:14.079015    4164 start.go:360] acquireMachinesLock for ha-080000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:00:14.079054    4164 start.go:364] duration metric: took 32.166µs to acquireMachinesLock for "ha-080000"

	I0910 11:00:14.079063    4164 start.go:96] Skipping create...Using existing machine configuration

	I0910 11:00:14.079068    4164 fix.go:54] fixHost starting: 

	I0910 11:00:14.079192    4164 fix.go:112] recreateIfNeeded on ha-080000: state=Stopped err=<nil>

	W0910 11:00:14.079201    4164 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 11:00:14.083462    4164 out.go:177] * Restarting existing qemu2 VM for "ha-080000" ...

	I0910 11:00:14.090499    4164 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:00:14.090537    4164 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:60:aa:a3:1d:ad -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/disk.qcow2

	I0910 11:00:14.092620    4164 main.go:141] libmachine: STDOUT: 

	I0910 11:00:14.092640    4164 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:00:14.092669    4164 fix.go:56] duration metric: took 13.601833ms for fixHost

	I0910 11:00:14.092675    4164 start.go:83] releasing machines lock for "ha-080000", held for 13.616958ms

	W0910 11:00:14.092683    4164 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:00:14.092730    4164 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:00:14.092735    4164 start.go:729] Will try again in 5 seconds ...

	I0910 11:00:19.094806    4164 start.go:360] acquireMachinesLock for ha-080000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:00:19.095373    4164 start.go:364] duration metric: took 414.791µs to acquireMachinesLock for "ha-080000"

	I0910 11:00:19.095506    4164 start.go:96] Skipping create...Using existing machine configuration

	I0910 11:00:19.095523    4164 fix.go:54] fixHost starting: 

	I0910 11:00:19.096229    4164 fix.go:112] recreateIfNeeded on ha-080000: state=Stopped err=<nil>

	W0910 11:00:19.096251    4164 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 11:00:19.104793    4164 out.go:177] * Restarting existing qemu2 VM for "ha-080000" ...

	I0910 11:00:19.107761    4164 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:00:19.107965    4164 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:60:aa:a3:1d:ad -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/disk.qcow2

	I0910 11:00:19.116026    4164 main.go:141] libmachine: STDOUT: 

	I0910 11:00:19.116077    4164 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:00:19.116150    4164 fix.go:56] duration metric: took 20.628958ms for fixHost

	I0910 11:00:19.116165    4164 start.go:83] releasing machines lock for "ha-080000", held for 20.768542ms

	W0910 11:00:19.116358    4164 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:00:19.124583    4164 out.go:201] 

	W0910 11:00:19.128789    4164 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:00:19.128809    4164 out.go:270] * 

	* 

	W0910 11:00:19.130919    4164 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:00:19.142771    4164 out.go:201] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-080000 -v=7 --alsologtostderr" : exit status 80

ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-080000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (32.300875ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (136.29s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 node delete m03 -v=7 --alsologtostderr: exit status 83 (40.250625ms)

-- stdout --

	* The control-plane node ha-080000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-080000"

-- /stdout --

** stderr ** 

	I0910 11:00:19.278231    4178 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:00:19.278472    4178 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:19.278475    4178 out.go:358] Setting ErrFile to fd 2...

	I0910 11:00:19.278478    4178 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:19.278623    4178 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:00:19.278861    4178 mustload.go:65] Loading cluster: ha-080000

	I0910 11:00:19.279090    4178 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0910 11:00:19.279401    4178 out.go:270] ! The control-plane node ha-080000 host is not running (will try others): state=Stopped

	! The control-plane node ha-080000 host is not running (will try others): state=Stopped

	W0910 11:00:19.279503    4178 out.go:270] ! The control-plane node ha-080000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-080000-m02 host is not running (will try others): state=Stopped

	I0910 11:00:19.282708    4178 out.go:177] * The control-plane node ha-080000-m03 host is not running: state=Stopped

	I0910 11:00:19.285696    4178 out.go:177]   To start a cluster, run: "minikube start -p ha-080000"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-080000 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr: exit status 7 (30.238083ms)

-- stdout --

	ha-080000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0910 11:00:19.317880    4180 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:00:19.318021    4180 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:19.318024    4180 out.go:358] Setting ErrFile to fd 2...

	I0910 11:00:19.318027    4180 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:00:19.318160    4180 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:00:19.318275    4180 out.go:352] Setting JSON to false

	I0910 11:00:19.318285    4180 mustload.go:65] Loading cluster: ha-080000

	I0910 11:00:19.318351    4180 notify.go:220] Checking for updates...

	I0910 11:00:19.318518    4180 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:00:19.318524    4180 status.go:255] checking status of ha-080000 ...

	I0910 11:00:19.318733    4180 status.go:330] ha-080000 host status = "Stopped" (err=<nil>)

	I0910 11:00:19.318738    4180 status.go:343] host is not running, skipping remaining checks

	I0910 11:00:19.318740    4180 status.go:257] ha-080000 status: &{Name:ha-080000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:00:19.318749    4180 status.go:255] checking status of ha-080000-m02 ...

	I0910 11:00:19.318839    4180 status.go:330] ha-080000-m02 host status = "Stopped" (err=<nil>)

	I0910 11:00:19.318841    4180 status.go:343] host is not running, skipping remaining checks

	I0910 11:00:19.318843    4180 status.go:257] ha-080000-m02 status: &{Name:ha-080000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:00:19.318848    4180 status.go:255] checking status of ha-080000-m03 ...

	I0910 11:00:19.318933    4180 status.go:330] ha-080000-m03 host status = "Stopped" (err=<nil>)

	I0910 11:00:19.318936    4180 status.go:343] host is not running, skipping remaining checks

	I0910 11:00:19.318941    4180 status.go:257] ha-080000-m03 status: &{Name:ha-080000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:00:19.318945    4180 status.go:255] checking status of ha-080000-m04 ...

	I0910 11:00:19.319039    4180 status.go:330] ha-080000-m04 host status = "Stopped" (err=<nil>)

	I0910 11:00:19.319042    4180 status.go:343] host is not running, skipping remaining checks

	I0910 11:00:19.319044    4180 status.go:257] ha-080000-m04 status: &{Name:ha-080000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (30.3555ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-080000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-080000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-080000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-080000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (29.343792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.08s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 stop -v=7 --alsologtostderr

ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-080000 stop -v=7 --alsologtostderr: (1m43.808341458s)

ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr: exit status 7 (65.05325ms)

-- stdout --

	ha-080000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-080000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0910 11:02:03.295466    4267 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:02:03.295686    4267 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:03.295691    4267 out.go:358] Setting ErrFile to fd 2...

	I0910 11:02:03.295694    4267 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:03.295855    4267 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:02:03.296011    4267 out.go:352] Setting JSON to false

	I0910 11:02:03.296025    4267 mustload.go:65] Loading cluster: ha-080000

	I0910 11:02:03.296057    4267 notify.go:220] Checking for updates...

	I0910 11:02:03.296323    4267 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:02:03.296332    4267 status.go:255] checking status of ha-080000 ...

	I0910 11:02:03.296617    4267 status.go:330] ha-080000 host status = "Stopped" (err=<nil>)

	I0910 11:02:03.296623    4267 status.go:343] host is not running, skipping remaining checks

	I0910 11:02:03.296626    4267 status.go:257] ha-080000 status: &{Name:ha-080000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:02:03.296640    4267 status.go:255] checking status of ha-080000-m02 ...

	I0910 11:02:03.296759    4267 status.go:330] ha-080000-m02 host status = "Stopped" (err=<nil>)

	I0910 11:02:03.296763    4267 status.go:343] host is not running, skipping remaining checks

	I0910 11:02:03.296766    4267 status.go:257] ha-080000-m02 status: &{Name:ha-080000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:02:03.296771    4267 status.go:255] checking status of ha-080000-m03 ...

	I0910 11:02:03.296901    4267 status.go:330] ha-080000-m03 host status = "Stopped" (err=<nil>)

	I0910 11:02:03.296905    4267 status.go:343] host is not running, skipping remaining checks

	I0910 11:02:03.296908    4267 status.go:257] ha-080000-m03 status: &{Name:ha-080000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0910 11:02:03.296912    4267 status.go:255] checking status of ha-080000-m04 ...

	I0910 11:02:03.297054    4267 status.go:330] ha-080000-m04 host status = "Stopped" (err=<nil>)

	I0910 11:02:03.297060    4267 status.go:343] host is not running, skipping remaining checks

	I0910 11:02:03.297063    4267 status.go:257] ha-080000-m04 status: &{Name:ha-080000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-080000 status -v=7 --alsologtostderr": ha-080000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-080000-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (33.506208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (103.91s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-080000 --wait=true -v=7 --alsologtostderr --driver=qemu2 

E0910 11:02:07.515222    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-080000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.178871042s)

-- stdout --

	* [ha-080000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-080000" primary control-plane node in "ha-080000" cluster

	* Restarting existing qemu2 VM for "ha-080000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-080000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:02:03.359343    4271 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:02:03.359476    4271 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:03.359479    4271 out.go:358] Setting ErrFile to fd 2...

	I0910 11:02:03.359481    4271 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:03.359603    4271 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:02:03.360609    4271 out.go:352] Setting JSON to false

	I0910 11:02:03.376610    4271 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3687,"bootTime":1725987636,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:02:03.376677    4271 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:02:03.381173    4271 out.go:177] * [ha-080000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:02:03.388034    4271 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:02:03.388091    4271 notify.go:220] Checking for updates...

	I0910 11:02:03.394044    4271 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:02:03.397060    4271 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:02:03.398487    4271 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:02:03.402036    4271 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:02:03.405045    4271 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:02:03.408395    4271 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:02:03.408677    4271 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:02:03.413031    4271 out.go:177] * Using the qemu2 driver based on existing profile

	I0910 11:02:03.420015    4271 start.go:297] selected driver: qemu2

	I0910 11:02:03.420021    4271 start.go:901] validating driver "qemu2" against &{Name:ha-080000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-080000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storage

class:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho

st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:02:03.420134    4271 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:02:03.422240    4271 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 11:02:03.422263    4271 cni.go:84] Creating CNI manager for ""

	I0910 11:02:03.422268    4271 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0910 11:02:03.422309    4271 start.go:340] cluster config:

	{Name:ha-080000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-080000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:02:03.425655    4271 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:02:03.434104    4271 out.go:177] * Starting "ha-080000" primary control-plane node in "ha-080000" cluster

	I0910 11:02:03.438012    4271 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:02:03.438027    4271 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:02:03.438054    4271 cache.go:56] Caching tarball of preloaded images

	I0910 11:02:03.438112    4271 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:02:03.438117    4271 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:02:03.438202    4271 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/ha-080000/config.json ...

	I0910 11:02:03.438663    4271 start.go:360] acquireMachinesLock for ha-080000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:02:03.438697    4271 start.go:364] duration metric: took 28.041µs to acquireMachinesLock for "ha-080000"

	I0910 11:02:03.438706    4271 start.go:96] Skipping create...Using existing machine configuration

	I0910 11:02:03.438712    4271 fix.go:54] fixHost starting: 

	I0910 11:02:03.438835    4271 fix.go:112] recreateIfNeeded on ha-080000: state=Stopped err=<nil>

	W0910 11:02:03.438844    4271 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 11:02:03.443067    4271 out.go:177] * Restarting existing qemu2 VM for "ha-080000" ...

	I0910 11:02:03.451027    4271 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:02:03.451061    4271 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:60:aa:a3:1d:ad -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/disk.qcow2

	I0910 11:02:03.453130    4271 main.go:141] libmachine: STDOUT: 

	I0910 11:02:03.453149    4271 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:02:03.453177    4271 fix.go:56] duration metric: took 14.466791ms for fixHost

	I0910 11:02:03.453190    4271 start.go:83] releasing machines lock for "ha-080000", held for 14.479875ms

	W0910 11:02:03.453198    4271 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:02:03.453232    4271 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:02:03.453237    4271 start.go:729] Will try again in 5 seconds ...

	I0910 11:02:08.455328    4271 start.go:360] acquireMachinesLock for ha-080000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:02:08.455961    4271 start.go:364] duration metric: took 461.334µs to acquireMachinesLock for "ha-080000"

	I0910 11:02:08.456133    4271 start.go:96] Skipping create...Using existing machine configuration

	I0910 11:02:08.456156    4271 fix.go:54] fixHost starting: 

	I0910 11:02:08.456898    4271 fix.go:112] recreateIfNeeded on ha-080000: state=Stopped err=<nil>

	W0910 11:02:08.456929    4271 fix.go:138] unexpected machine state, will restart: <nil>

	I0910 11:02:08.461417    4271 out.go:177] * Restarting existing qemu2 VM for "ha-080000" ...

	I0910 11:02:08.467299    4271 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:02:08.467564    4271 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:60:aa:a3:1d:ad -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/ha-080000/disk.qcow2

	I0910 11:02:08.477177    4271 main.go:141] libmachine: STDOUT: 

	I0910 11:02:08.477286    4271 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:02:08.477421    4271 fix.go:56] duration metric: took 21.24375ms for fixHost

	I0910 11:02:08.477441    4271 start.go:83] releasing machines lock for "ha-080000", held for 21.419875ms

	W0910 11:02:08.477662    4271 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-080000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:02:08.485421    4271 out.go:201] 

	W0910 11:02:08.489409    4271 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:02:08.489456    4271 out.go:270] * 

	* 

	W0910 11:02:08.492188    4271 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:02:08.502438    4271 out.go:201] 

** /stderr **

ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-080000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (69.202875ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.25s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-080000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-080000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-080000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-080000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (29.39ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

=== RUN   TestMultiControlPlane/serial/AddSecondaryNode

ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-080000 --control-plane -v=7 --alsologtostderr

ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-080000 --control-plane -v=7 --alsologtostderr: exit status 83 (42.02425ms)

-- stdout --

	* The control-plane node ha-080000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-080000"

-- /stdout --

** stderr ** 

	I0910 11:02:08.691312    4288 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:02:08.691468    4288 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:08.691471    4288 out.go:358] Setting ErrFile to fd 2...

	I0910 11:02:08.691473    4288 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:08.691604    4288 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:02:08.691831    4288 mustload.go:65] Loading cluster: ha-080000

	I0910 11:02:08.692035    4288 config.go:182] Loaded profile config "ha-080000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0910 11:02:08.692339    4288 out.go:270] ! The control-plane node ha-080000 host is not running (will try others): state=Stopped

	! The control-plane node ha-080000 host is not running (will try others): state=Stopped

	W0910 11:02:08.692447    4288 out.go:270] ! The control-plane node ha-080000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-080000-m02 host is not running (will try others): state=Stopped

	I0910 11:02:08.696540    4288 out.go:177] * The control-plane node ha-080000-m03 host is not running: state=Stopped

	I0910 11:02:08.700487    4288 out.go:177]   To start a cluster, run: "minikube start -p ha-080000"

** /stderr **

ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-080000 --control-plane -v=7 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-080000 -n ha-080000: exit status 7 (29.208625ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-080000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.07s)

=== RUN   TestImageBuild/serial/Setup

image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-487000 --driver=qemu2 

image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-487000 --driver=qemu2 : exit status 80 (10.127801708s)

-- stdout --

	* [image-487000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "image-487000" primary control-plane node in "image-487000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "image-487000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p image-487000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-487000 --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-487000 -n image-487000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-487000 -n image-487000: exit status 7 (66.307625ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "image-487000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestImageBuild/serial/Setup (10.19s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-966000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

E0910 11:02:20.665328    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/functional-475000/client.crt: no such file or directory" logger="UnhandledError"

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-966000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.838666458s)

-- stdout --

	{"specversion":"1.0","id":"cb435634-e689-4638-a3f5-b990432cf98c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-966000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"1d24d7c3-de44-4ceb-b9ea-af9c278a6c92","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19598"}}

	{"specversion":"1.0","id":"45a4fbdf-7d85-413c-8c43-a5abe1f38af5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig"}}

	{"specversion":"1.0","id":"13e154e2-f2fc-4ec4-827c-67a1069ea661","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"d1032a09-5f46-4465-a936-a3b31eed950d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"9fc564cc-21e0-4c71-a2de-73a873ce803e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube"}}

	{"specversion":"1.0","id":"db700ab1-009e-4e39-905d-8fd7c8d3eb5f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"65fa4454-21e9-45ec-baa5-108442bb6929","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"501a4e0f-3576-4876-bf5c-4a7d45b3a791","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"9523072f-b9c0-420d-aadc-ab198b12e737","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-966000\" primary control-plane node in \"json-output-966000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"a7b35cfa-5dc0-44d4-b73d-11754e1b4058","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"7717c412-adb6-469b-b467-ba9f9f005bfa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-966000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"6d05bddc-1a22-4aba-8673-863632b1c550","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"3faf884e-92dd-4fd6-abad-56599380b7e0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"a1b28c1b-65fc-4acc-9adf-1ce10f1cb4cb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-966000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"fcf9eaf2-4870-4c4c-8354-b410bebd6c3d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}

	{"specversion":"1.0","id":"54d15f01-5261-43f5-b6ee-3d75aaed17fb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-966000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80

json_output_test.go:213: unable to marshal output: OUTPUT: 

json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value

--- FAIL: TestJSONOutput/start/Command (9.84s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-966000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-966000 --output=json --user=testUser: exit status 83 (76.26425ms)

-- stdout --

	{"specversion":"1.0","id":"037331a6-b2c8-4010-9335-fab76a89cd07","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-966000 host is not running: state=Stopped"}}

	{"specversion":"1.0","id":"cc2b5d16-34db-46b1-ae00-0743ce2a3439","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-966000\""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-966000 --output=json --user=testUser": exit status 83

--- FAIL: TestJSONOutput/pause/Command (0.08s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-966000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-966000 --output=json --user=testUser: exit status 83 (42.711541ms)

-- stdout --

	* The control-plane node json-output-966000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p json-output-966000"

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-966000 --output=json --user=testUser": exit status 83

json_output_test.go:213: unable to marshal output: * The control-plane node json-output-966000 host is not running: state=Stopped

json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value

--- FAIL: TestJSONOutput/unpause/Command (0.04s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-645000 --driver=qemu2 

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-645000 --driver=qemu2 : exit status 80 (9.856877625s)

-- stdout --

	* [first-645000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "first-645000" primary control-plane node in "first-645000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "first-645000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p first-645000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-645000 --driver=qemu2 ": exit status 80

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-10 11:02:43.290826 -0700 PDT m=+2062.739583960

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-647000 -n second-647000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-647000 -n second-647000: exit status 85 (83.657292ms)

-- stdout --

	* Profile "second-647000" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p second-647000"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "second-647000" host is not running, skipping log retrieval (state="* Profile \"second-647000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-647000\"")

helpers_test.go:175: Cleaning up "second-647000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-647000

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-10 11:02:43.484566 -0700 PDT m=+2062.933328418

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-645000 -n first-645000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-645000 -n first-645000: exit status 7 (30.091167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "first-645000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "first-645000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-645000

--- FAIL: TestMinikubeProfile (10.16s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-490000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-490000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.954154541s)

-- stdout --

	* [mount-start-1-490000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-490000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-490000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-490000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-490000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-490000 -n mount-start-1-490000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-490000 -n mount-start-1-490000: exit status 7 (71.376917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-490000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.03s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-416000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-416000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.784366333s)

-- stdout --

	* [multinode-416000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19598

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-416000" primary control-plane node in "multinode-416000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-416000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0910 11:02:53.831221    4458 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:02:53.831370    4458 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:53.831373    4458 out.go:358] Setting ErrFile to fd 2...

	I0910 11:02:53.831376    4458 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:02:53.831505    4458 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:02:53.832575    4458 out.go:352] Setting JSON to false

	I0910 11:02:53.849091    4458 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3737,"bootTime":1725987636,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0910 11:02:53.849161    4458 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0910 11:02:53.854506    4458 out.go:177] * [multinode-416000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0910 11:02:53.862456    4458 out.go:177]   - MINIKUBE_LOCATION=19598

	I0910 11:02:53.862501    4458 notify.go:220] Checking for updates...

	I0910 11:02:53.873400    4458 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19598-1276/kubeconfig

	I0910 11:02:53.876425    4458 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0910 11:02:53.877950    4458 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0910 11:02:53.881440    4458 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19598-1276/.minikube

	I0910 11:02:53.884404    4458 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0910 11:02:53.887579    4458 driver.go:394] Setting default libvirt URI to qemu:///system

	I0910 11:02:53.891387    4458 out.go:177] * Using the qemu2 driver based on user configuration

	I0910 11:02:53.898483    4458 start.go:297] selected driver: qemu2

	I0910 11:02:53.898491    4458 start.go:901] validating driver "qemu2" against <nil>

	I0910 11:02:53.898503    4458 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0910 11:02:53.900829    4458 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0910 11:02:53.903393    4458 out.go:177] * Automatically selected the socket_vmnet network

	I0910 11:02:53.906507    4458 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0910 11:02:53.906559    4458 cni.go:84] Creating CNI manager for ""

	I0910 11:02:53.906567    4458 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0910 11:02:53.906571    4458 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0910 11:02:53.906598    4458 start.go:340] cluster config:

	{Name:multinode-416000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-416000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm

net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0910 11:02:53.910257    4458 iso.go:125] acquiring lock: {Name:mkdf05e9eafdd4f958013b37202d71f89648c5cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0910 11:02:53.917407    4458 out.go:177] * Starting "multinode-416000" primary control-plane node in "multinode-416000" cluster

	I0910 11:02:53.921412    4458 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0910 11:02:53.921426    4458 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0910 11:02:53.921431    4458 cache.go:56] Caching tarball of preloaded images

	I0910 11:02:53.921488    4458 preload.go:172] Found /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0910 11:02:53.921493    4458 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0910 11:02:53.921679    4458 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/multinode-416000/config.json ...

	I0910 11:02:53.921692    4458 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/multinode-416000/config.json: {Name:mk03c9a8955c8d66a25c92d0ea6b8b0b7f4f5328 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0910 11:02:53.921922    4458 start.go:360] acquireMachinesLock for multinode-416000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:02:53.921958    4458 start.go:364] duration metric: took 28.958µs to acquireMachinesLock for "multinode-416000"

	I0910 11:02:53.921971    4458 start.go:93] Provisioning new machine with config: &{Name:multinode-416000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-416000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:02:53.922001    4458 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:02:53.931468    4458 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0910 11:02:53.948835    4458 start.go:159] libmachine.API.Create for "multinode-416000" (driver="qemu2")

	I0910 11:02:53.948863    4458 client.go:168] LocalClient.Create starting

	I0910 11:02:53.948922    4458 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:02:53.948957    4458 main.go:141] libmachine: Decoding PEM data...

	I0910 11:02:53.948969    4458 main.go:141] libmachine: Parsing certificate...

	I0910 11:02:53.949006    4458 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:02:53.949028    4458 main.go:141] libmachine: Decoding PEM data...

	I0910 11:02:53.949037    4458 main.go:141] libmachine: Parsing certificate...

	I0910 11:02:53.949389    4458 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:02:54.108316    4458 main.go:141] libmachine: Creating SSH key...

	I0910 11:02:54.145874    4458 main.go:141] libmachine: Creating Disk image...

	I0910 11:02:54.145879    4458 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:02:54.146075    4458 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:02:54.155199    4458 main.go:141] libmachine: STDOUT: 

	I0910 11:02:54.155216    4458 main.go:141] libmachine: STDERR: 

	I0910 11:02:54.155269    4458 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2 +20000M

	I0910 11:02:54.163004    4458 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:02:54.163018    4458 main.go:141] libmachine: STDERR: 

	I0910 11:02:54.163026    4458 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:02:54.163032    4458 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:02:54.163044    4458 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:02:54.163070    4458 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:57:28:54:f0:0d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:02:54.164674    4458 main.go:141] libmachine: STDOUT: 

	I0910 11:02:54.164689    4458 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:02:54.164708    4458 client.go:171] duration metric: took 215.845709ms to LocalClient.Create

	I0910 11:02:56.166851    4458 start.go:128] duration metric: took 2.244879208s to createHost

	I0910 11:02:56.166936    4458 start.go:83] releasing machines lock for "multinode-416000", held for 2.245023292s

	W0910 11:02:56.166986    4458 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:02:56.178173    4458 out.go:177] * Deleting "multinode-416000" in qemu2 ...

	W0910 11:02:56.217343    4458 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:02:56.217367    4458 start.go:729] Will try again in 5 seconds ...

	I0910 11:03:01.219523    4458 start.go:360] acquireMachinesLock for multinode-416000: {Name:mk7d82825f9df5a42d0956d3943a8155bac34abc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0910 11:03:01.220142    4458 start.go:364] duration metric: took 470.083µs to acquireMachinesLock for "multinode-416000"

	I0910 11:03:01.220299    4458 start.go:93] Provisioning new machine with config: &{Name:multinode-416000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-416000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0910 11:03:01.220547    4458 start.go:125] createHost starting for "" (driver="qemu2")

	I0910 11:03:01.234140    4458 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0910 11:03:01.285649    4458 start.go:159] libmachine.API.Create for "multinode-416000" (driver="qemu2")

	I0910 11:03:01.285703    4458 client.go:168] LocalClient.Create starting

	I0910 11:03:01.285806    4458 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/ca.pem

	I0910 11:03:01.285861    4458 main.go:141] libmachine: Decoding PEM data...

	I0910 11:03:01.285878    4458 main.go:141] libmachine: Parsing certificate...

	I0910 11:03:01.285948    4458 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19598-1276/.minikube/certs/cert.pem

	I0910 11:03:01.285995    4458 main.go:141] libmachine: Decoding PEM data...

	I0910 11:03:01.286006    4458 main.go:141] libmachine: Parsing certificate...

	I0910 11:03:01.286907    4458 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19598-1276/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19598-1276/.minikube/cache/iso/arm64/minikube-v1.34.0-1725912912-19598-arm64.iso...

	I0910 11:03:01.457380    4458 main.go:141] libmachine: Creating SSH key...

	I0910 11:03:01.513527    4458 main.go:141] libmachine: Creating Disk image...

	I0910 11:03:01.513531    4458 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0910 11:03:01.513738    4458 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2.raw /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:03:01.523220    4458 main.go:141] libmachine: STDOUT: 

	I0910 11:03:01.523239    4458 main.go:141] libmachine: STDERR: 

	I0910 11:03:01.523287    4458 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2 +20000M

	I0910 11:03:01.531099    4458 main.go:141] libmachine: STDOUT: Image resized.

	I0910 11:03:01.531120    4458 main.go:141] libmachine: STDERR: 

	I0910 11:03:01.531128    4458 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:03:01.531133    4458 main.go:141] libmachine: Starting QEMU VM...

	I0910 11:03:01.531139    4458 qemu.go:418] Using hvf for hardware acceleration

	I0910 11:03:01.531168    4458 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/qemu.pid -device virtio-net-pci,netdev=net0,mac=56:a5:c4:a5:46:ac -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19598-1276/.minikube/machines/multinode-416000/disk.qcow2

	I0910 11:03:01.532786    4458 main.go:141] libmachine: STDOUT: 

	I0910 11:03:01.532801    4458 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0910 11:03:01.532813    4458 client.go:171] duration metric: took 247.112334ms to LocalClient.Create

	I0910 11:03:03.534950    4458 start.go:128] duration metric: took 2.314430333s to createHost

	I0910 11:03:03.535034    4458 start.go:83] releasing machines lock for "multinode-416000", held for 2.314918917s

	W0910 11:03:03.535510    4458 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-416000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-416000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0910 11:03:03.551131    4458 out.go:201] 

	W0910 11:03:03.555282    4458 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0910 11:03:03.555334    4458 out.go:270] * 

	* 

	W0910 11:03:03.558000    4458 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:03:03.573139    4458 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-416000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (68.535083ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.86s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (131.260583ms)

** stderr ** 

	error: cluster "multinode-416000" does not exist

** /stderr **

multinode_test.go:495: failed to create busybox deployment to multinode cluster

multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- rollout status deployment/busybox

multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- rollout status deployment/busybox: exit status 1 (58.606959ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:500: failed to deploy busybox to multinode cluster

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (57.358917ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.497167ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.353959ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.284625ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.13125ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.111333ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.063791ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

E0910 11:03:30.608658    1795 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19598-1276/.minikube/profiles/addons-592000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.720959ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.021584ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.720208ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.498958ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:530: failed get Pod names

multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.io

multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.io: exit status 1 (57.097416ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.default

multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.default: exit status 1 (56.590041ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (56.138875ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (30.568167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (84.16s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-416000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.703292ms)

** stderr ** 

	error: no server found for cluster "multinode-416000"

** /stderr **

multinode_test.go:566: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (31.110292ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-416000 -v 3 --alsologtostderr

multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-416000 -v 3 --alsologtostderr: exit status 83 (42.565375ms)

-- stdout --

	* The control-plane node multinode-416000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-416000"

-- /stdout --

** stderr ** 

	I0910 11:04:27.925454    4591 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:27.925615    4591 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:27.925619    4591 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:27.925621    4591 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:27.925755    4591 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:27.925999    4591 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:27.926175    4591 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:27.929854    4591 out.go:177] * The control-plane node multinode-416000 host is not running: state=Stopped

	I0910 11:04:27.933698    4591 out.go:177]   To start a cluster, run: "minikube start -p multinode-416000"

** /stderr **

multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-416000 -v 3 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (29.336458ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.07s)

=== RUN   TestMultiNode/serial/MultiNodeLabels

multinode_test.go:221: (dbg) Run:  kubectl --context multinode-416000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-416000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (28.693042ms)

** stderr ** 

	Error in configuration: context was not found for specified context: multinode-416000

** /stderr **

multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-416000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-416000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (29.479208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.06s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

multinode_test.go:166: expected profile "multinode-416000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-416000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-416000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19598/minikube-v1.34.0-1725912912-19598-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1725963390-19606@sha256:05c3fb4a3ac73e1a547cb186e5aec949a4a3d18af7d1444e0d1365c17dbedef9\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNU

MACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"multinode-416000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVer

sion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":

\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (29.921708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ProfileList (0.08s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status --output json --alsologtostderr

multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status --output json --alsologtostderr: exit status 7 (29.892959ms)

-- stdout --

	{"Name":"multinode-416000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

-- /stdout --

** stderr ** 

	I0910 11:04:28.132992    4603 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:28.133155    4603 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.133158    4603 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:28.133160    4603 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.133286    4603 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:28.133411    4603 out.go:352] Setting JSON to true

	I0910 11:04:28.133422    4603 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:28.133482    4603 notify.go:220] Checking for updates...

	I0910 11:04:28.133641    4603 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:28.133647    4603 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:28.133851    4603 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:28.133855    4603 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:28.133857    4603 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-416000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (29.906291ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 node stop m03

multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 node stop m03: exit status 85 (47.391541ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-416000 node stop m03": exit status 85

multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status

multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status: exit status 7 (29.88725ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status --alsologtostderr

multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status --alsologtostderr: exit status 7 (29.615167ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:28.270616    4611 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:28.270781    4611 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.270784    4611 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:28.270786    4611 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.270908    4611 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:28.271036    4611 out.go:352] Setting JSON to false

	I0910 11:04:28.271046    4611 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:28.271123    4611 notify.go:220] Checking for updates...

	I0910 11:04:28.271247    4611 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:28.271252    4611 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:28.271446    4611 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:28.271450    4611 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:28.271453    4611 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-416000 status --alsologtostderr": multinode-416000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (29.695167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopNode (0.14s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 node start m03 -v=7 --alsologtostderr

multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 node start m03 -v=7 --alsologtostderr: exit status 85 (46.276709ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0910 11:04:28.330680    4615 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:28.330933    4615 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.330937    4615 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:28.330939    4615 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.331060    4615 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:28.331295    4615 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:28.331484    4615 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:28.335757    4615 out.go:201] 

	W0910 11:04:28.338712    4615 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W0910 11:04:28.338716    4615 out.go:270] * 

	* 

	W0910 11:04:28.340340    4615 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0910 11:04:28.343689    4615 out.go:201] 

** /stderr **

multinode_test.go:284: I0910 11:04:28.330680    4615 out.go:345] Setting OutFile to fd 1 ...

I0910 11:04:28.330933    4615 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0910 11:04:28.330937    4615 out.go:358] Setting ErrFile to fd 2...

I0910 11:04:28.330939    4615 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0910 11:04:28.331060    4615 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

I0910 11:04:28.331295    4615 mustload.go:65] Loading cluster: multinode-416000

I0910 11:04:28.331484    4615 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

I0910 11:04:28.335757    4615 out.go:201] 

W0910 11:04:28.338712    4615 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W0910 11:04:28.338716    4615 out.go:270] * 

* 

W0910 11:04:28.340340    4615 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0910 11:04:28.343689    4615 out.go:201] 

multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-416000 node start m03 -v=7 --alsologtostderr": exit status 85

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (30.728542ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:28.377759    4617 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:28.377918    4617 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.377922    4617 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:28.377924    4617 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:28.378070    4617 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:28.378183    4617 out.go:352] Setting JSON to false

	I0910 11:04:28.378194    4617 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:28.378248    4617 notify.go:220] Checking for updates...

	I0910 11:04:28.378403    4617 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:28.378413    4617 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:28.378632    4617 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:28.378637    4617 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:28.378639    4617 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (70.518291ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:29.759039    4620 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:29.759216    4620 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:29.759220    4620 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:29.759224    4620 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:29.759381    4620 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:29.759546    4620 out.go:352] Setting JSON to false

	I0910 11:04:29.759561    4620 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:29.759602    4620 notify.go:220] Checking for updates...

	I0910 11:04:29.759841    4620 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:29.759848    4620 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:29.760144    4620 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:29.760150    4620 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:29.760153    4620 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (73.723042ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:30.719683    4624 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:30.719893    4624 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:30.719898    4624 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:30.719901    4624 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:30.720091    4624 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:30.720263    4624 out.go:352] Setting JSON to false

	I0910 11:04:30.720277    4624 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:30.720325    4624 notify.go:220] Checking for updates...

	I0910 11:04:30.720547    4624 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:30.720553    4624 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:30.720837    4624 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:30.720843    4624 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:30.720845    4624 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (72.240625ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:33.629693    4628 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:33.629917    4628 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:33.629922    4628 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:33.629925    4628 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:33.630109    4628 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:33.630275    4628 out.go:352] Setting JSON to false

	I0910 11:04:33.630295    4628 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:33.630326    4628 notify.go:220] Checking for updates...

	I0910 11:04:33.630543    4628 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:33.630549    4628 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:33.630841    4628 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:33.630846    4628 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:33.630849    4628 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (75.071209ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:37.610590    4630 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:37.610973    4630 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:37.610979    4630 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:37.610983    4630 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:37.611229    4630 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:37.611417    4630 out.go:352] Setting JSON to false

	I0910 11:04:37.611431    4630 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:37.611611    4630 notify.go:220] Checking for updates...

	I0910 11:04:37.612012    4630 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:37.612021    4630 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:37.612315    4630 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:37.612322    4630 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:37.612325    4630 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (73.557792ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:40.390683    4634 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:40.390882    4634 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:40.390887    4634 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:40.390890    4634 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:40.391062    4634 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:40.391237    4634 out.go:352] Setting JSON to false

	I0910 11:04:40.391250    4634 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:40.391293    4634 notify.go:220] Checking for updates...

	I0910 11:04:40.391520    4634 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:40.391526    4634 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:40.391814    4634 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:40.391820    4634 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:40.391823    4634 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (73.456416ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:04:51.180460    4643 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:04:51.180696    4643 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:51.180701    4643 out.go:358] Setting ErrFile to fd 2...

	I0910 11:04:51.180704    4643 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:04:51.180903    4643 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:04:51.181062    4643 out.go:352] Setting JSON to false

	I0910 11:04:51.181078    4643 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:04:51.181125    4643 notify.go:220] Checking for updates...

	I0910 11:04:51.181372    4643 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:04:51.181379    4643 status.go:255] checking status of multinode-416000 ...

	I0910 11:04:51.181670    4643 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:04:51.181675    4643 status.go:343] host is not running, skipping remaining checks

	I0910 11:04:51.181678    4643 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr: exit status 7 (71.63375ms)

-- stdout --

	multinode-416000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0910 11:05:07.230103    4659 out.go:345] Setting OutFile to fd 1 ...

	I0910 11:05:07.230322    4659 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:05:07.230327    4659 out.go:358] Setting ErrFile to fd 2...

	I0910 11:05:07.230330    4659 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0910 11:05:07.230524    4659 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19598-1276/.minikube/bin

	I0910 11:05:07.230679    4659 out.go:352] Setting JSON to false

	I0910 11:05:07.230695    4659 mustload.go:65] Loading cluster: multinode-416000

	I0910 11:05:07.230738    4659 notify.go:220] Checking for updates...

	I0910 11:05:07.230962    4659 config.go:182] Loaded profile config "multinode-416000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0910 11:05:07.230969    4659 status.go:255] checking status of multinode-416000 ...

	I0910 11:05:07.231260    4659 status.go:330] multinode-416000 host status = "Stopped" (err=<nil>)

	I0910 11:05:07.231266    4659 status.go:343] host is not running, skipping remaining checks

	I0910 11:05:07.231269    4659 status.go:257] multinode-416000 status: &{Name:multinode-416000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-416000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-416000 -n multinode-416000: exit status 7 (34.280792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-416000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StartAfterStop (38.97s)