=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-031000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-031000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (28.32690575s)

-- stdout --

	{"specversion":"1.0","id":"2862a020-5b40-4e07-b5ef-af3e3df7c584","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-031000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"895d34fb-60b5-42ed-ad68-7992f8fd5058","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19531"}}

	{"specversion":"1.0","id":"4de42d57-bfca-4600-b750-0c5ccf128f4a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig"}}

	{"specversion":"1.0","id":"46b7a229-42c2-4af2-aca4-2c92ad4340c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"0e403467-219a-4571-9cc9-d3cfc93591b0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"4c915b8e-48b2-4dcd-ba04-7d0a2eefe11b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube"}}

	{"specversion":"1.0","id":"f3dca106-8278-4322-a487-9db1d37a39e1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"6982965e-78d3-4b74-a1c6-98c627a81781","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"347bc719-33cf-4ba1-82a9-59c46b6acd35","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"18d597ff-9949-4d3e-9cda-50e372c4de27","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"7dad265f-69cf-4230-af10-dc3caeaed168","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-031000\" primary control-plane node in \"download-only-031000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"fd4f7a58-82cc-44ee-9ea1-38fe3a7272ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"23d77ab8-c7db-4aba-bb26-ee91d04b414e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19531-965/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920] Decompressors:map[bz2:0x1400000f940 gz:0x1400000f948 tar:0x1400000f8f0 tar.bz2:0x1400000f900 tar.gz:0x1400000f910 tar.xz:0x1400000f920 tar.zst:0x1400000f930 tbz2:0x1400000f900 tgz:0x140

0000f910 txz:0x1400000f920 tzst:0x1400000f930 xz:0x1400000f950 zip:0x1400000f960 zst:0x1400000f958] Getters:map[file:0x14001818550 http:0x14000578280 https:0x14000578500] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"0f12238c-b98f-498d-b15d-cd9065cfc91c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0829 11:04:35.185082    1420 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:04:35.185238    1420 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:04:35.185241    1420 out.go:358] Setting ErrFile to fd 2...

	I0829 11:04:35.185244    1420 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:04:35.185368    1420 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	W0829 11:04:35.185476    1420 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19531-965/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19531-965/.minikube/config/config.json: no such file or directory

	I0829 11:04:35.186676    1420 out.go:352] Setting JSON to true

	I0829 11:04:35.203684    1420 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":239,"bootTime":1724954436,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:04:35.203756    1420 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:04:35.208758    1420 out.go:97] [download-only-031000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:04:35.208912    1420 notify.go:220] Checking for updates...

	W0829 11:04:35.208932    1420 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball: no such file or directory

	I0829 11:04:35.212630    1420 out.go:169] MINIKUBE_LOCATION=19531

	I0829 11:04:35.215609    1420 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:04:35.220676    1420 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:04:35.223701    1420 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:04:35.226585    1420 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	W0829 11:04:35.232621    1420 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0829 11:04:35.232825    1420 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:04:35.237600    1420 out.go:97] Using the qemu2 driver based on user configuration

	I0829 11:04:35.237620    1420 start.go:297] selected driver: qemu2

	I0829 11:04:35.237636    1420 start.go:901] validating driver "qemu2" against <nil>

	I0829 11:04:35.237717    1420 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 11:04:35.241600    1420 out.go:169] Automatically selected the socket_vmnet network

	I0829 11:04:35.247379    1420 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0829 11:04:35.247473    1420 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0829 11:04:35.247562    1420 cni.go:84] Creating CNI manager for ""

	I0829 11:04:35.247579    1420 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0829 11:04:35.247628    1420 start.go:340] cluster config:

	{Name:download-only-031000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-031000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo

ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:04:35.252996    1420 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:04:35.255669    1420 out.go:97] Downloading VM boot image ...

	I0829 11:04:35.255689    1420 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso

	I0829 11:04:46.944240    1420 out.go:97] Starting "download-only-031000" primary control-plane node in "download-only-031000" cluster

	I0829 11:04:46.944265    1420 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0829 11:04:46.998519    1420 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0829 11:04:46.998555    1420 cache.go:56] Caching tarball of preloaded images

	I0829 11:04:46.998707    1420 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0829 11:04:47.003793    1420 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I0829 11:04:47.003800    1420 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0829 11:04:47.115685    1420 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0829 11:05:02.241365    1420 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0829 11:05:02.241532    1420 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0829 11:05:02.938473    1420 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I0829 11:05:02.938656    1420 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/download-only-031000/config.json ...

	I0829 11:05:02.938673    1420 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/download-only-031000/config.json: {Name:mkc169edd70a2dc1a2bec2403108ab7bb4d18df0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:02.938889    1420 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0829 11:05:02.939071    1420 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19531-965/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I0829 11:05:03.436176    1420 out.go:193] 

	W0829 11:05:03.442196    1420 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19531-965/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920 0x10940f920] Decompressors:map[bz2:0x1400000f940 gz:0x1400000f948 tar:0x1400000f8f0 tar.bz2:0x1400000f900 tar.gz:0x1400000f910 tar.xz:0x1400000f920 tar.zst:0x1400000f930 tbz2:0x1400000f900 tgz:0x1400000f910 txz:0x1400000f920 tzst:0x1400000f930 xz:0x1400000f950 zip:0x1400000f960 zst:0x1400000f958] Getters:map[file:0x14001818550 http:0x14000578280 https:0x14000578500] Dir:false ProgressListe

ner:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0829 11:05:03.442228    1420 out_reason.go:110] 

	W0829 11:05:03.451189    1420 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:05:03.455130    1420 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-031000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (28.33s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19531-965/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19531-965/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-200000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-200000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.963560542s)

-- stdout --

	* [offline-docker-200000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-200000" primary control-plane node in "offline-docker-200000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-200000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 11:52:21.960781    3879 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:52:21.960915    3879 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:52:21.960918    3879 out.go:358] Setting ErrFile to fd 2...

	I0829 11:52:21.960920    3879 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:52:21.961059    3879 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:52:21.962247    3879 out.go:352] Setting JSON to false

	I0829 11:52:21.979948    3879 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3105,"bootTime":1724954436,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:52:21.980028    3879 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:52:21.985264    3879 out.go:177] * [offline-docker-200000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:52:21.993207    3879 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:52:21.993264    3879 notify.go:220] Checking for updates...

	I0829 11:52:21.998589    3879 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:52:22.001101    3879 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:52:22.004094    3879 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:52:22.007148    3879 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:52:22.010100    3879 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:52:22.013483    3879 config.go:182] Loaded profile config "multinode-531000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:52:22.013543    3879 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:52:22.017056    3879 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 11:52:22.024180    3879 start.go:297] selected driver: qemu2

	I0829 11:52:22.024191    3879 start.go:901] validating driver "qemu2" against <nil>

	I0829 11:52:22.024200    3879 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:52:22.026304    3879 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 11:52:22.029073    3879 out.go:177] * Automatically selected the socket_vmnet network

	I0829 11:52:22.032130    3879 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:52:22.032154    3879 cni.go:84] Creating CNI manager for ""

	I0829 11:52:22.032162    3879 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:52:22.032165    3879 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0829 11:52:22.032197    3879 start.go:340] cluster config:

	{Name:offline-docker-200000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-200000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi

n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:52:22.035767    3879 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:52:22.042940    3879 out.go:177] * Starting "offline-docker-200000" primary control-plane node in "offline-docker-200000" cluster

	I0829 11:52:22.047001    3879 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:52:22.047027    3879 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:52:22.047039    3879 cache.go:56] Caching tarball of preloaded images

	I0829 11:52:22.047105    3879 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:52:22.047111    3879 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:52:22.047172    3879 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/offline-docker-200000/config.json ...

	I0829 11:52:22.047186    3879 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/offline-docker-200000/config.json: {Name:mk6afef9a197e81664c0338ec1b85fbfd06aaddb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:52:22.047477    3879 start.go:360] acquireMachinesLock for offline-docker-200000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:52:22.047510    3879 start.go:364] duration metric: took 25.333µs to acquireMachinesLock for "offline-docker-200000"

	I0829 11:52:22.047520    3879 start.go:93] Provisioning new machine with config: &{Name:offline-docker-200000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-200000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:52:22.047557    3879 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 11:52:22.050981    3879 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 11:52:22.067466    3879 start.go:159] libmachine.API.Create for "offline-docker-200000" (driver="qemu2")

	I0829 11:52:22.067508    3879 client.go:168] LocalClient.Create starting

	I0829 11:52:22.067596    3879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 11:52:22.067634    3879 main.go:141] libmachine: Decoding PEM data...

	I0829 11:52:22.067645    3879 main.go:141] libmachine: Parsing certificate...

	I0829 11:52:22.067690    3879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 11:52:22.067714    3879 main.go:141] libmachine: Decoding PEM data...

	I0829 11:52:22.067721    3879 main.go:141] libmachine: Parsing certificate...

	I0829 11:52:22.068106    3879 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 11:52:22.226413    3879 main.go:141] libmachine: Creating SSH key...

	I0829 11:52:22.399912    3879 main.go:141] libmachine: Creating Disk image...

	I0829 11:52:22.399921    3879 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 11:52:22.400272    3879 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:22.410763    3879 main.go:141] libmachine: STDOUT: 

	I0829 11:52:22.410788    3879 main.go:141] libmachine: STDERR: 

	I0829 11:52:22.410837    3879 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2 +20000M

	I0829 11:52:22.423558    3879 main.go:141] libmachine: STDOUT: Image resized.

	I0829 11:52:22.423591    3879 main.go:141] libmachine: STDERR: 

	I0829 11:52:22.423609    3879 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:22.423615    3879 main.go:141] libmachine: Starting QEMU VM...

	I0829 11:52:22.423624    3879 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:52:22.423650    3879 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/qemu.pid -device virtio-net-pci,netdev=net0,mac=8e:57:0e:7b:5a:8d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:22.425307    3879 main.go:141] libmachine: STDOUT: 

	I0829 11:52:22.425325    3879 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:52:22.425344    3879 client.go:171] duration metric: took 357.835792ms to LocalClient.Create

	I0829 11:52:24.427417    3879 start.go:128] duration metric: took 2.3798845s to createHost

	I0829 11:52:24.427442    3879 start.go:83] releasing machines lock for "offline-docker-200000", held for 2.379960167s

	W0829 11:52:24.427479    3879 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:52:24.440867    3879 out.go:177] * Deleting "offline-docker-200000" in qemu2 ...

	W0829 11:52:24.458791    3879 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:52:24.458803    3879 start.go:729] Will try again in 5 seconds ...

	I0829 11:52:29.461013    3879 start.go:360] acquireMachinesLock for offline-docker-200000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:52:29.461559    3879 start.go:364] duration metric: took 407µs to acquireMachinesLock for "offline-docker-200000"

	I0829 11:52:29.461698    3879 start.go:93] Provisioning new machine with config: &{Name:offline-docker-200000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-200000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:52:29.461981    3879 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 11:52:29.468530    3879 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 11:52:29.521099    3879 start.go:159] libmachine.API.Create for "offline-docker-200000" (driver="qemu2")

	I0829 11:52:29.521152    3879 client.go:168] LocalClient.Create starting

	I0829 11:52:29.521261    3879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 11:52:29.521319    3879 main.go:141] libmachine: Decoding PEM data...

	I0829 11:52:29.521335    3879 main.go:141] libmachine: Parsing certificate...

	I0829 11:52:29.521396    3879 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 11:52:29.521441    3879 main.go:141] libmachine: Decoding PEM data...

	I0829 11:52:29.521455    3879 main.go:141] libmachine: Parsing certificate...

	I0829 11:52:29.521958    3879 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 11:52:29.691242    3879 main.go:141] libmachine: Creating SSH key...

	I0829 11:52:29.821194    3879 main.go:141] libmachine: Creating Disk image...

	I0829 11:52:29.821203    3879 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 11:52:29.821370    3879 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:29.830604    3879 main.go:141] libmachine: STDOUT: 

	I0829 11:52:29.830632    3879 main.go:141] libmachine: STDERR: 

	I0829 11:52:29.830698    3879 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2 +20000M

	I0829 11:52:29.838668    3879 main.go:141] libmachine: STDOUT: Image resized.

	I0829 11:52:29.838684    3879 main.go:141] libmachine: STDERR: 

	I0829 11:52:29.838699    3879 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:29.838705    3879 main.go:141] libmachine: Starting QEMU VM...

	I0829 11:52:29.838721    3879 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:52:29.838754    3879 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:7c:37:a5:28:7a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/offline-docker-200000/disk.qcow2

	I0829 11:52:29.840268    3879 main.go:141] libmachine: STDOUT: 

	I0829 11:52:29.840282    3879 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:52:29.840292    3879 client.go:171] duration metric: took 319.1375ms to LocalClient.Create

	I0829 11:52:31.842433    3879 start.go:128] duration metric: took 2.380448791s to createHost

	I0829 11:52:31.842487    3879 start.go:83] releasing machines lock for "offline-docker-200000", held for 2.38093625s

	W0829 11:52:31.842861    3879 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-200000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-200000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:52:31.863526    3879 out.go:201] 

	W0829 11:52:31.873651    3879 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:52:31.873683    3879 out.go:270] * 

	* 

	W0829 11:52:31.875988    3879 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:52:31.886468    3879 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-200000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:626: *** TestOffline FAILED at 2024-08-29 11:52:31.895766 -0700 PDT m=+2876.842878001

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-200000 -n offline-docker-200000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-200000 -n offline-docker-200000: exit status 7 (49.935708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-200000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-200000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-200000

--- FAIL: TestOffline (10.11s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:332: registry stabilized in 1.097125ms

addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-6fb4cdfc84-2xddm" [c5b53102-3848-4204-9379-99d61d77a524] Running

addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.009417833s

addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-vr87j" [3059ef24-0a76-4ac9-bc80-747fc239f276] Running

addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.009584042s

addons_test.go:342: (dbg) Run:  kubectl --context addons-048000 delete po -l run=registry-test --now

addons_test.go:347: (dbg) Run:  kubectl --context addons-048000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-048000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.058436541s)

-- stdout --

	pod "registry-test" deleted

-- /stdout --

** stderr ** 

	error: timed out waiting for the condition

** /stderr **

addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-048000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1

addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted

*

addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-048000 ip

2024/08/29 11:18:23 [DEBUG] GET http://192.168.105.2:5000

addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-048000 addons disable registry --alsologtostderr -v=1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-048000 -n addons-048000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-048000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only              | download-only-031000 | jenkins | v1.33.1 | 29 Aug 24 11:04 PDT |                     |

	|         | -p download-only-031000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| delete  | -p download-only-031000              | download-only-031000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| start   | -o=json --download-only              | download-only-318000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT |                     |

	|         | -p download-only-318000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| delete  | -p download-only-318000              | download-only-318000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| delete  | -p download-only-031000              | download-only-031000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| delete  | -p download-only-318000              | download-only-318000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| start   | --download-only -p                   | binary-mirror-471000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT |                     |

	|         | binary-mirror-471000                 |                      |         |         |                     |                     |

	|         | --alsologtostderr                    |                      |         |         |                     |                     |

	|         | --binary-mirror                      |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49311               |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-471000              | binary-mirror-471000 | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:05 PDT |

	| addons  | enable dashboard -p                  | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT |                     |

	|         | addons-048000                        |                      |         |         |                     |                     |

	| addons  | disable dashboard -p                 | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT |                     |

	|         | addons-048000                        |                      |         |         |                     |                     |

	| start   | -p addons-048000 --wait=true         | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:05 PDT | 29 Aug 24 11:08 PDT |

	|         | --memory=4000 --alsologtostderr      |                      |         |         |                     |                     |

	|         | --addons=registry                    |                      |         |         |                     |                     |

	|         | --addons=metrics-server              |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots             |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver         |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                    |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner               |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget            |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher |                      |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin        |                      |         |         |                     |                     |

	|         | --addons=yakd --addons=volcano       |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress     |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                 |                      |         |         |                     |                     |

	| addons  | addons-048000 addons disable         | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:09 PDT | 29 Aug 24 11:09 PDT |

	|         | volcano --alsologtostderr -v=1       |                      |         |         |                     |                     |

	| addons  | addons-048000 addons                 | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:17 PDT | 29 Aug 24 11:18 PDT |

	|         | disable csi-hostpath-driver          |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-048000 addons                 | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:18 PDT | 29 Aug 24 11:18 PDT |

	|         | disable volumesnapshots              |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-048000 addons                 | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:18 PDT | 29 Aug 24 11:18 PDT |

	|         | disable metrics-server               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | disable inspektor-gadget -p          | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:18 PDT | 29 Aug 24 11:18 PDT |

	|         | addons-048000                        |                      |         |         |                     |                     |

	| ip      | addons-048000 ip                     | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:18 PDT | 29 Aug 24 11:18 PDT |

	| addons  | addons-048000 addons disable         | addons-048000        | jenkins | v1.33.1 | 29 Aug 24 11:18 PDT | 29 Aug 24 11:18 PDT |

	|         | registry --alsologtostderr           |                      |         |         |                     |                     |

	|         | -v=1                                 |                      |         |         |                     |                     |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/29 11:05:12

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0829 11:05:12.749097    1498 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:05:12.749218    1498 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:05:12.749222    1498 out.go:358] Setting ErrFile to fd 2...

	I0829 11:05:12.749224    1498 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:05:12.749350    1498 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:05:12.750373    1498 out.go:352] Setting JSON to false

	I0829 11:05:12.766233    1498 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":276,"bootTime":1724954436,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:05:12.766294    1498 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:05:12.771392    1498 out.go:177] * [addons-048000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:05:12.778555    1498 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:05:12.778608    1498 notify.go:220] Checking for updates...

	I0829 11:05:12.785472    1498 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:05:12.788531    1498 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:05:12.791525    1498 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:05:12.794492    1498 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:05:12.797525    1498 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:05:12.800730    1498 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:05:12.804473    1498 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 11:05:12.811536    1498 start.go:297] selected driver: qemu2

	I0829 11:05:12.811543    1498 start.go:901] validating driver "qemu2" against <nil>

	I0829 11:05:12.811550    1498 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:05:12.813858    1498 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 11:05:12.816514    1498 out.go:177] * Automatically selected the socket_vmnet network

	I0829 11:05:12.819536    1498 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:05:12.819573    1498 cni.go:84] Creating CNI manager for ""

	I0829 11:05:12.819580    1498 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:05:12.819588    1498 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0829 11:05:12.819619    1498 start.go:340] cluster config:

	{Name:addons-048000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-048000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c

lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:05:12.823384    1498 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:05:12.831512    1498 out.go:177] * Starting "addons-048000" primary control-plane node in "addons-048000" cluster

	I0829 11:05:12.835534    1498 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:05:12.835548    1498 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:05:12.835553    1498 cache.go:56] Caching tarball of preloaded images

	I0829 11:05:12.835615    1498 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:05:12.835621    1498 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:05:12.835803    1498 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/config.json ...

	I0829 11:05:12.835813    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/config.json: {Name:mk2412d0fcebec2bd4c944fde76aa7913fd9d3a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:12.836183    1498 start.go:360] acquireMachinesLock for addons-048000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:05:12.836247    1498 start.go:364] duration metric: took 58.416µs to acquireMachinesLock for "addons-048000"

	I0829 11:05:12.836256    1498 start.go:93] Provisioning new machine with config: &{Name:addons-048000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.0 ClusterName:addons-048000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:05:12.836284    1498 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 11:05:12.844515    1498 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0829 11:05:13.903401    1498 start.go:159] libmachine.API.Create for "addons-048000" (driver="qemu2")

	I0829 11:05:13.903466    1498 client.go:168] LocalClient.Create starting

	I0829 11:05:13.903793    1498 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 11:05:13.981474    1498 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 11:05:14.032600    1498 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 11:05:14.316792    1498 main.go:141] libmachine: Creating SSH key...

	I0829 11:05:14.439098    1498 main.go:141] libmachine: Creating Disk image...

	I0829 11:05:14.439103    1498 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 11:05:14.439321    1498 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2

	I0829 11:05:14.531373    1498 main.go:141] libmachine: STDOUT: 

	I0829 11:05:14.531406    1498 main.go:141] libmachine: STDERR: 

	I0829 11:05:14.531475    1498 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2 +20000M

	I0829 11:05:14.542180    1498 main.go:141] libmachine: STDOUT: Image resized.

	I0829 11:05:14.542195    1498 main.go:141] libmachine: STDERR: 

	I0829 11:05:14.542207    1498 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2

	I0829 11:05:14.542214    1498 main.go:141] libmachine: Starting QEMU VM...

	I0829 11:05:14.542247    1498 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:05:14.542286    1498 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:2a:b4:2e:bf:78 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/disk.qcow2

	I0829 11:05:14.598172    1498 main.go:141] libmachine: STDOUT: 

	I0829 11:05:14.598209    1498 main.go:141] libmachine: STDERR: 

	I0829 11:05:14.598213    1498 main.go:141] libmachine: Attempt 0

	I0829 11:05:14.598224    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:14.598279    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:14.598300    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:16.599454    1498 main.go:141] libmachine: Attempt 1

	I0829 11:05:16.599539    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:16.599906    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:16.599990    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:18.601314    1498 main.go:141] libmachine: Attempt 2

	I0829 11:05:18.601512    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:18.601883    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:18.601992    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:20.603164    1498 main.go:141] libmachine: Attempt 3

	I0829 11:05:20.603211    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:20.603330    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:20.603382    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:22.604408    1498 main.go:141] libmachine: Attempt 4

	I0829 11:05:22.604419    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:22.604526    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:22.604547    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:24.605571    1498 main.go:141] libmachine: Attempt 5

	I0829 11:05:24.605577    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:24.605605    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:24.605610    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:26.606671    1498 main.go:141] libmachine: Attempt 6

	I0829 11:05:26.606686    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:26.606748    1498 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0829 11:05:26.606757    1498 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d208d1}

	I0829 11:05:28.607896    1498 main.go:141] libmachine: Attempt 7

	I0829 11:05:28.607925    1498 main.go:141] libmachine: Searching for 2a:2a:b4:2e:bf:78 in /var/db/dhcpd_leases ...

	I0829 11:05:28.608048    1498 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I0829 11:05:28.608066    1498 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:2a:2a:b4:2e:bf:78 ID:1,2a:2a:b4:2e:bf:78 Lease:0x66d209e7}

	I0829 11:05:28.608068    1498 main.go:141] libmachine: Found match: 2a:2a:b4:2e:bf:78

	I0829 11:05:28.608079    1498 main.go:141] libmachine: IP: 192.168.105.2

	I0829 11:05:28.608083    1498 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0829 11:05:30.616410    1498 machine.go:93] provisionDockerMachine start ...

	I0829 11:05:30.617723    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:30.617904    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:30.617914    1498 main.go:141] libmachine: About to run SSH command:

	hostname

	I0829 11:05:30.672723    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0829 11:05:30.672737    1498 buildroot.go:166] provisioning hostname "addons-048000"

	I0829 11:05:30.672783    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:30.672928    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:30.672934    1498 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-048000 && echo "addons-048000" | sudo tee /etc/hostname

	I0829 11:05:30.731593    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-048000

	I0829 11:05:30.731647    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:30.731762    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:30.731772    1498 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-048000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-048000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-048000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0829 11:05:30.784132    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0829 11:05:30.784164    1498 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19531-965/.minikube CaCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19531-965/.minikube}

	I0829 11:05:30.784183    1498 buildroot.go:174] setting up certificates

	I0829 11:05:30.784187    1498 provision.go:84] configureAuth start

	I0829 11:05:30.784191    1498 provision.go:143] copyHostCerts

	I0829 11:05:30.784286    1498 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/ca.pem (1082 bytes)

	I0829 11:05:30.784519    1498 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/cert.pem (1123 bytes)

	I0829 11:05:30.784625    1498 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/key.pem (1675 bytes)

	I0829 11:05:30.784701    1498 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem org=jenkins.addons-048000 san=[127.0.0.1 192.168.105.2 addons-048000 localhost minikube]

	I0829 11:05:30.846415    1498 provision.go:177] copyRemoteCerts

	I0829 11:05:30.846469    1498 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0829 11:05:30.846486    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:30.876185    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0829 11:05:30.884498    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0829 11:05:30.892829    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0829 11:05:30.901015    1498 provision.go:87] duration metric: took 116.823917ms to configureAuth

	I0829 11:05:30.901023    1498 buildroot.go:189] setting minikube options for container-runtime

	I0829 11:05:30.901115    1498 config.go:182] Loaded profile config "addons-048000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:05:30.901148    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:30.901230    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:30.901235    1498 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0829 11:05:30.951642    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0829 11:05:30.951649    1498 buildroot.go:70] root file system type: tmpfs

	I0829 11:05:30.951694    1498 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0829 11:05:30.951746    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:30.951854    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:30.951887    1498 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0829 11:05:31.005715    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0829 11:05:31.005771    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:31.005889    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:31.005897    1498 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0829 11:05:32.368887    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0829 11:05:32.368901    1498 machine.go:96] duration metric: took 1.752494458s to provisionDockerMachine

	I0829 11:05:32.368909    1498 client.go:171] duration metric: took 18.465604s to LocalClient.Create

	I0829 11:05:32.368922    1498 start.go:167] duration metric: took 18.465697041s to libmachine.API.Create "addons-048000"

	I0829 11:05:32.368929    1498 start.go:293] postStartSetup for "addons-048000" (driver="qemu2")

	I0829 11:05:32.368935    1498 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0829 11:05:32.369012    1498 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0829 11:05:32.369021    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:32.397477    1498 ssh_runner.go:195] Run: cat /etc/os-release

	I0829 11:05:32.399155    1498 info.go:137] Remote host: Buildroot 2023.02.9

	I0829 11:05:32.399163    1498 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19531-965/.minikube/addons for local assets ...

	I0829 11:05:32.399255    1498 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19531-965/.minikube/files for local assets ...

	I0829 11:05:32.399286    1498 start.go:296] duration metric: took 30.353167ms for postStartSetup

	I0829 11:05:32.399684    1498 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/config.json ...

	I0829 11:05:32.399860    1498 start.go:128] duration metric: took 19.563748792s to createHost

	I0829 11:05:32.399890    1498 main.go:141] libmachine: Using SSH client type: native

	I0829 11:05:32.399978    1498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10287c5a0] 0x10287ee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0829 11:05:32.399982    1498 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0829 11:05:32.449285    1498 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724954732.939319253

	I0829 11:05:32.449291    1498 fix.go:216] guest clock: 1724954732.939319253

	I0829 11:05:32.449295    1498 fix.go:229] Guest: 2024-08-29 11:05:32.939319253 -0700 PDT Remote: 2024-08-29 11:05:32.399866 -0700 PDT m=+19.670138834 (delta=539.453253ms)

	I0829 11:05:32.449306    1498 fix.go:200] guest clock delta is within tolerance: 539.453253ms

	I0829 11:05:32.449310    1498 start.go:83] releasing machines lock for "addons-048000", held for 19.613235583s

	I0829 11:05:32.449613    1498 ssh_runner.go:195] Run: cat /version.json

	I0829 11:05:32.449626    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:32.449629    1498 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0829 11:05:32.449676    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:32.477053    1498 ssh_runner.go:195] Run: systemctl --version

	I0829 11:05:32.527633    1498 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0829 11:05:32.529745    1498 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0829 11:05:32.529776    1498 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0829 11:05:32.535981    1498 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0829 11:05:32.535990    1498 start.go:495] detecting cgroup driver to use...

	I0829 11:05:32.536097    1498 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0829 11:05:32.543234    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0829 11:05:32.547424    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0829 11:05:32.551480    1498 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0829 11:05:32.551507    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0829 11:05:32.555551    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0829 11:05:32.559616    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0829 11:05:32.563693    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0829 11:05:32.567805    1498 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0829 11:05:32.571936    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0829 11:05:32.576097    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0829 11:05:32.580030    1498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0829 11:05:32.584277    1498 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0829 11:05:32.588118    1498 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0829 11:05:32.592060    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:32.671996    1498 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0829 11:05:32.682809    1498 start.go:495] detecting cgroup driver to use...

	I0829 11:05:32.682881    1498 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0829 11:05:32.689049    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0829 11:05:32.696050    1498 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0829 11:05:32.706786    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0829 11:05:32.712110    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0829 11:05:32.717728    1498 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0829 11:05:32.759796    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0829 11:05:32.765779    1498 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0829 11:05:32.772162    1498 ssh_runner.go:195] Run: which cri-dockerd

	I0829 11:05:32.773501    1498 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0829 11:05:32.776895    1498 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0829 11:05:32.782695    1498 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0829 11:05:32.852750    1498 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0829 11:05:32.946777    1498 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0829 11:05:32.946841    1498 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0829 11:05:32.953072    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:33.042212    1498 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0829 11:05:35.217271    1498 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.175059667s)

	I0829 11:05:35.217342    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0829 11:05:35.222776    1498 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0829 11:05:35.229380    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0829 11:05:35.234986    1498 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0829 11:05:35.327082    1498 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0829 11:05:35.408802    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:35.497998    1498 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0829 11:05:35.504781    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0829 11:05:35.510299    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:35.597798    1498 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0829 11:05:35.623382    1498 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0829 11:05:35.623469    1498 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0829 11:05:35.626758    1498 start.go:563] Will wait 60s for crictl version

	I0829 11:05:35.626813    1498 ssh_runner.go:195] Run: which crictl

	I0829 11:05:35.628295    1498 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0829 11:05:35.645265    1498 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.1.2

	RuntimeApiVersion:  v1

	I0829 11:05:35.645343    1498 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0829 11:05:35.655292    1498 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0829 11:05:35.670358    1498 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.1.2 ...

	I0829 11:05:35.670447    1498 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0829 11:05:35.671989    1498 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0829 11:05:35.676560    1498 kubeadm.go:883] updating cluster {Name:addons-048000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.0 ClusterName:addons-048000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort

:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0829 11:05:35.676612    1498 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:05:35.676654    1498 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0829 11:05:35.681976    1498 docker.go:685] Got preloaded images: 

	I0829 11:05:35.681984    1498 docker.go:691] registry.k8s.io/kube-apiserver:v1.31.0 wasn't preloaded

	I0829 11:05:35.682025    1498 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0829 11:05:35.685480    1498 ssh_runner.go:195] Run: which lz4

	I0829 11:05:35.686898    1498 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0829 11:05:35.688288    1498 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0829 11:05:35.688300    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (322549298 bytes)

	I0829 11:05:36.936083    1498 docker.go:649] duration metric: took 1.249225375s to copy over tarball

	I0829 11:05:36.936138    1498 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0829 11:05:37.908008    1498 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0829 11:05:37.922776    1498 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0829 11:05:37.926705    1498 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)

	I0829 11:05:37.932698    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:38.024422    1498 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0829 11:05:40.223342    1498 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.19892275s)

	I0829 11:05:40.223456    1498 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0829 11:05:40.229801    1498 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0829 11:05:40.229822    1498 cache_images.go:84] Images are preloaded, skipping loading

	I0829 11:05:40.229827    1498 kubeadm.go:934] updating node { 192.168.105.2 8443 v1.31.0 docker true true} ...

	I0829 11:05:40.229910    1498 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-048000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:addons-048000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0829 11:05:40.229976    1498 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0829 11:05:40.254104    1498 cni.go:84] Creating CNI manager for ""

	I0829 11:05:40.254120    1498 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:05:40.254125    1498 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0829 11:05:40.254135    1498 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-048000 NodeName:addons-048000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0829 11:05:40.254206    1498 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-048000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0829 11:05:40.254270    1498 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0829 11:05:40.257867    1498 binaries.go:44] Found k8s binaries, skipping transfer

	I0829 11:05:40.257896    1498 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0829 11:05:40.261038    1498 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0829 11:05:40.266798    1498 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0829 11:05:40.272571    1498 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0829 11:05:40.278479    1498 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0829 11:05:40.279738    1498 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0829 11:05:40.284056    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:40.357071    1498 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0829 11:05:40.366829    1498 certs.go:68] Setting up /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000 for IP: 192.168.105.2

	I0829 11:05:40.366838    1498 certs.go:194] generating shared ca certs ...

	I0829 11:05:40.366846    1498 certs.go:226] acquiring lock for ca certs: {Name:mk29df1c1b696cda1cc19a90487167bb76984cb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.367020    1498 certs.go:240] generating "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key

	I0829 11:05:40.497631    1498 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt ...

	I0829 11:05:40.497641    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt: {Name:mkc4743cd374b0147c94c96da34c7e0a51fdbdbd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.497946    1498 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key ...

	I0829 11:05:40.497949    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key: {Name:mk6980af8391c12e20fb2e50b124c003fd4f98d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.498062    1498 certs.go:240] generating "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key

	I0829 11:05:40.673911    1498 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.crt ...

	I0829 11:05:40.673921    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.crt: {Name:mk94291c56e75e2123816f6ea97cc346e30225e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.674106    1498 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key ...

	I0829 11:05:40.674109    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key: {Name:mkb58f7a861598287ab409195614d91ff6d7e1ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.674239    1498 certs.go:256] generating profile certs ...

	I0829 11:05:40.674286    1498 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.key

	I0829 11:05:40.674293    1498 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt with IP's: []

	I0829 11:05:40.933525    1498 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt ...

	I0829 11:05:40.933538    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: {Name:mkca40d9ae0c572f0c49f5f4f365866f3bb94fc7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.933834    1498 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.key ...

	I0829 11:05:40.933838    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.key: {Name:mk86e1d0e8970123900125779a6b13d2f3396b0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.933963    1498 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key.ec3197e4

	I0829 11:05:40.933973    1498 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt.ec3197e4 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.105.2]

	I0829 11:05:40.997064    1498 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt.ec3197e4 ...

	I0829 11:05:40.997068    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt.ec3197e4: {Name:mkbc8e5f21b1e7a61d826f0dcd8f3c2fc6018071 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.997211    1498 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key.ec3197e4 ...

	I0829 11:05:40.997215    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key.ec3197e4: {Name:mkeaf5135d0a1e4918abc61606973de9542df389 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:40.997326    1498 certs.go:381] copying /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt.ec3197e4 -> /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt

	I0829 11:05:40.997533    1498 certs.go:385] copying /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key.ec3197e4 -> /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key

	I0829 11:05:40.997628    1498 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.key

	I0829 11:05:40.997636    1498 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.crt with IP's: []

	I0829 11:05:41.163583    1498 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.crt ...

	I0829 11:05:41.163594    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.crt: {Name:mka7385ea01241075429ed6d9781d1ccfd44aff2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:41.163824    1498 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.key ...

	I0829 11:05:41.163827    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.key: {Name:mk2354903bcb22fe4caa500df0140450ea931bbe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:41.164079    1498 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem (1675 bytes)

	I0829 11:05:41.164105    1498 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem (1082 bytes)

	I0829 11:05:41.164122    1498 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem (1123 bytes)

	I0829 11:05:41.164139    1498 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem (1675 bytes)

	I0829 11:05:41.164539    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0829 11:05:41.173652    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0829 11:05:41.182079    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0829 11:05:41.190185    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0829 11:05:41.198458    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0829 11:05:41.206979    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0829 11:05:41.215479    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0829 11:05:41.223969    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0829 11:05:41.232379    1498 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0829 11:05:41.240746    1498 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0829 11:05:41.247849    1498 ssh_runner.go:195] Run: openssl version

	I0829 11:05:41.250327    1498 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0829 11:05:41.254080    1498 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:05:41.255721    1498 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 29 18:05 /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:05:41.255741    1498 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:05:41.257875    1498 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0829 11:05:41.261539    1498 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0829 11:05:41.263002    1498 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0829 11:05:41.263049    1498 kubeadm.go:392] StartCluster: {Name:addons-048000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0

ClusterName:addons-048000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:05:41.263110    1498 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0829 11:05:41.268893    1498 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0829 11:05:41.272668    1498 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0829 11:05:41.276350    1498 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0829 11:05:41.279951    1498 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0829 11:05:41.279958    1498 kubeadm.go:157] found existing configuration files:

	I0829 11:05:41.279985    1498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0829 11:05:41.283442    1498 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0829 11:05:41.283466    1498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0829 11:05:41.286931    1498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0829 11:05:41.290094    1498 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0829 11:05:41.290119    1498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0829 11:05:41.293248    1498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0829 11:05:41.296540    1498 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0829 11:05:41.296566    1498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0829 11:05:41.300251    1498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0829 11:05:41.303959    1498 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0829 11:05:41.303986    1498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0829 11:05:41.307686    1498 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0829 11:05:41.330158    1498 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0

	I0829 11:05:41.330189    1498 kubeadm.go:310] [preflight] Running pre-flight checks

	I0829 11:05:41.368207    1498 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0829 11:05:41.368261    1498 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0829 11:05:41.368321    1498 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0829 11:05:41.372176    1498 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0829 11:05:41.388331    1498 out.go:235]   - Generating certificates and keys ...

	I0829 11:05:41.388362    1498 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0829 11:05:41.388391    1498 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0829 11:05:41.557570    1498 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0829 11:05:41.677616    1498 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0829 11:05:41.784368    1498 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0829 11:05:41.915112    1498 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0829 11:05:41.958000    1498 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0829 11:05:41.958068    1498 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-048000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0829 11:05:42.130021    1498 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0829 11:05:42.130085    1498 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-048000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0829 11:05:42.229365    1498 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0829 11:05:42.331045    1498 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0829 11:05:42.438199    1498 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0829 11:05:42.438236    1498 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0829 11:05:42.553336    1498 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0829 11:05:42.591568    1498 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0829 11:05:42.692167    1498 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0829 11:05:42.743851    1498 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0829 11:05:42.839055    1498 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0829 11:05:42.839282    1498 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0829 11:05:42.840552    1498 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0829 11:05:42.844770    1498 out.go:235]   - Booting up control plane ...

	I0829 11:05:42.844832    1498 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0829 11:05:42.844877    1498 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0829 11:05:42.844924    1498 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0829 11:05:42.851436    1498 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0829 11:05:42.854041    1498 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0829 11:05:42.854062    1498 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0829 11:05:42.954590    1498 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0829 11:05:42.954650    1498 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0829 11:05:43.455564    1498 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.153292ms

	I0829 11:05:43.455614    1498 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0829 11:05:46.957718    1498 kubeadm.go:310] [api-check] The API server is healthy after 3.502072043s

	I0829 11:05:46.967192    1498 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0829 11:05:46.973504    1498 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0829 11:05:46.983539    1498 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0829 11:05:46.983684    1498 kubeadm.go:310] [mark-control-plane] Marking the node addons-048000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0829 11:05:46.987359    1498 kubeadm.go:310] [bootstrap-token] Using token: jjdb3v.bbxz5y5c4ktww97e

	I0829 11:05:46.999713    1498 out.go:235]   - Configuring RBAC rules ...

	I0829 11:05:46.999773    1498 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0829 11:05:46.999815    1498 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0829 11:05:47.001375    1498 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0829 11:05:47.002392    1498 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0829 11:05:47.003436    1498 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0829 11:05:47.004791    1498 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0829 11:05:47.370714    1498 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0829 11:05:47.768445    1498 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0829 11:05:48.365059    1498 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0829 11:05:48.366725    1498 kubeadm.go:310] 

	I0829 11:05:48.366815    1498 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0829 11:05:48.366827    1498 kubeadm.go:310] 

	I0829 11:05:48.366993    1498 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0829 11:05:48.367011    1498 kubeadm.go:310] 

	I0829 11:05:48.367048    1498 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0829 11:05:48.367170    1498 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0829 11:05:48.367281    1498 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0829 11:05:48.367294    1498 kubeadm.go:310] 

	I0829 11:05:48.367397    1498 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0829 11:05:48.367414    1498 kubeadm.go:310] 

	I0829 11:05:48.367490    1498 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0829 11:05:48.367505    1498 kubeadm.go:310] 

	I0829 11:05:48.367589    1498 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0829 11:05:48.367719    1498 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0829 11:05:48.367821    1498 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0829 11:05:48.367832    1498 kubeadm.go:310] 

	I0829 11:05:48.367949    1498 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0829 11:05:48.368132    1498 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0829 11:05:48.368146    1498 kubeadm.go:310] 

	I0829 11:05:48.368347    1498 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token jjdb3v.bbxz5y5c4ktww97e \

	I0829 11:05:48.368582    1498 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:a85be241893e40b79217c6f73688d370693933870156b869b3fa902a9be4179f \

	I0829 11:05:48.368623    1498 kubeadm.go:310] 	--control-plane 

	I0829 11:05:48.368633    1498 kubeadm.go:310] 

	I0829 11:05:48.368845    1498 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0829 11:05:48.368864    1498 kubeadm.go:310] 

	I0829 11:05:48.368987    1498 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token jjdb3v.bbxz5y5c4ktww97e \

	I0829 11:05:48.369166    1498 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:a85be241893e40b79217c6f73688d370693933870156b869b3fa902a9be4179f 

	I0829 11:05:48.370160    1498 kubeadm.go:310] W0829 18:05:41.819179    1590 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0829 11:05:48.370619    1498 kubeadm.go:310] W0829 18:05:41.819521    1590 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0829 11:05:48.370820    1498 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0829 11:05:48.370845    1498 cni.go:84] Creating CNI manager for ""

	I0829 11:05:48.370870    1498 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:05:48.374046    1498 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0829 11:05:48.377156    1498 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0829 11:05:48.387990    1498 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0829 11:05:48.401841    1498 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0829 11:05:48.401957    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:48.402086    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-048000 minikube.k8s.io/updated_at=2024_08_29T11_05_48_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=95341f0b655cea8be5ebfc6bf112c8367dc08d33 minikube.k8s.io/name=addons-048000 minikube.k8s.io/primary=true

	I0829 11:05:48.415556    1498 ops.go:34] apiserver oom_adj: -16

	I0829 11:05:48.469207    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:48.970006    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:49.471398    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:49.971338    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:50.471357    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:50.969851    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:51.471334    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:51.971380    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:52.471308    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:52.971308    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:53.471215    1498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0829 11:05:53.559320    1498 kubeadm.go:1113] duration metric: took 5.15749675s to wait for elevateKubeSystemPrivileges

	I0829 11:05:53.559338    1498 kubeadm.go:394] duration metric: took 12.2964015s to StartCluster

	I0829 11:05:53.559349    1498 settings.go:142] acquiring lock: {Name:mk4c43097bad4576952ccc223d0a8a031914c5a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:53.559534    1498 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:05:53.559713    1498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/kubeconfig: {Name:mk8af293b3e18a99fbcb2b7e12f57a5251bf5686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:05:53.559952    1498 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0829 11:05:53.559976    1498 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:05:53.560019    1498 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0829 11:05:53.560135    1498 addons.go:69] Setting yakd=true in profile "addons-048000"

	I0829 11:05:53.560149    1498 config.go:182] Loaded profile config "addons-048000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:05:53.560156    1498 addons.go:234] Setting addon yakd=true in "addons-048000"

	I0829 11:05:53.560158    1498 addons.go:69] Setting inspektor-gadget=true in profile "addons-048000"

	I0829 11:05:53.560168    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560172    1498 addons.go:234] Setting addon inspektor-gadget=true in "addons-048000"

	I0829 11:05:53.560182    1498 addons.go:69] Setting default-storageclass=true in profile "addons-048000"

	I0829 11:05:53.560186    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560191    1498 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-048000"

	I0829 11:05:53.560234    1498 addons.go:69] Setting ingress=true in profile "addons-048000"

	I0829 11:05:53.560250    1498 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-048000"

	I0829 11:05:53.560267    1498 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-048000"

	I0829 11:05:53.560261    1498 addons.go:69] Setting storage-provisioner=true in profile "addons-048000"

	I0829 11:05:53.560277    1498 addons.go:69] Setting ingress-dns=true in profile "addons-048000"

	I0829 11:05:53.560278    1498 addons.go:69] Setting gcp-auth=true in profile "addons-048000"

	I0829 11:05:53.560284    1498 addons.go:234] Setting addon ingress-dns=true in "addons-048000"

	I0829 11:05:53.560292    1498 addons.go:234] Setting addon storage-provisioner=true in "addons-048000"

	I0829 11:05:53.560297    1498 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-048000"

	I0829 11:05:53.560302    1498 mustload.go:65] Loading cluster: addons-048000

	I0829 11:05:53.560322    1498 addons.go:69] Setting volcano=true in profile "addons-048000"

	I0829 11:05:53.560329    1498 addons.go:234] Setting addon volcano=true in "addons-048000"

	I0829 11:05:53.560332    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560270    1498 addons.go:234] Setting addon ingress=true in "addons-048000"

	I0829 11:05:53.560355    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560295    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560492    1498 retry.go:31] will retry after 990.527634ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560501    1498 addons.go:69] Setting volumesnapshots=true in profile "addons-048000"

	I0829 11:05:53.560508    1498 addons.go:234] Setting addon volumesnapshots=true in "addons-048000"

	I0829 11:05:53.560514    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560516    1498 config.go:182] Loaded profile config "addons-048000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:05:53.560574    1498 retry.go:31] will retry after 1.243738138s: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560248    1498 addons.go:69] Setting cloud-spanner=true in profile "addons-048000"

	I0829 11:05:53.560305    1498 addons.go:69] Setting metrics-server=true in profile "addons-048000"

	I0829 11:05:53.560706    1498 addons.go:234] Setting addon cloud-spanner=true in "addons-048000"

	I0829 11:05:53.560731    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560760    1498 retry.go:31] will retry after 625.923091ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560304    1498 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-048000"

	I0829 11:05:53.560772    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560772    1498 retry.go:31] will retry after 593.838937ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560759    1498 addons.go:234] Setting addon metrics-server=true in "addons-048000"

	I0829 11:05:53.560814    1498 retry.go:31] will retry after 503.447936ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560335    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560831    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560865    1498 addons.go:69] Setting registry=true in profile "addons-048000"

	I0829 11:05:53.560872    1498 addons.go:234] Setting addon registry=true in "addons-048000"

	I0829 11:05:53.560879    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560933    1498 retry.go:31] will retry after 1.380746802s: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560275    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:53.560976    1498 retry.go:31] will retry after 656.469318ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.560336    1498 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-048000"

	I0829 11:05:53.560987    1498 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-048000"

	I0829 11:05:53.561023    1498 retry.go:31] will retry after 1.047449792s: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.561083    1498 retry.go:31] will retry after 542.693569ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.561101    1498 retry.go:31] will retry after 1.067166418s: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.561138    1498 retry.go:31] will retry after 959.698199ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.561211    1498 retry.go:31] will retry after 693.088272ms: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.561257    1498 retry.go:31] will retry after 1.422321555s: connect: dial unix /Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/monitor: connect: connection refused

	I0829 11:05:53.564510    1498 out.go:177] * Verifying Kubernetes components...

	I0829 11:05:53.572414    1498 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0829 11:05:53.576436    1498 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0829 11:05:53.576484    1498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:05:53.579463    1498 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0829 11:05:53.579470    1498 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0829 11:05:53.579478    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:53.585457    1498 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0829 11:05:53.585464    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0829 11:05:53.585471    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:53.640544    1498 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0829 11:05:53.691985    1498 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0829 11:05:53.771698    1498 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0829 11:05:53.771710    1498 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0829 11:05:53.787485    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0829 11:05:53.788225    1498 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0829 11:05:53.788232    1498 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0829 11:05:53.819431    1498 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0829 11:05:53.819443    1498 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0829 11:05:53.885108    1498 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0829 11:05:53.885118    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0829 11:05:53.894111    1498 start.go:971] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0829 11:05:53.895518    1498 node_ready.go:35] waiting up to 6m0s for node "addons-048000" to be "Ready" ...

	I0829 11:05:53.904091    1498 node_ready.go:49] node "addons-048000" has status "Ready":"True"

	I0829 11:05:53.904103    1498 node_ready.go:38] duration metric: took 8.571542ms for node "addons-048000" to be "Ready" ...

	I0829 11:05:53.904108    1498 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:05:53.913169    1498 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace to be "Ready" ...

	I0829 11:05:53.945314    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0829 11:05:54.071352    1498 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0829 11:05:54.074392    1498 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0829 11:05:54.074400    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0829 11:05:54.074410    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.109405    1498 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0829 11:05:54.113372    1498 out.go:177]   - Using image docker.io/registry:2.8.3

	I0829 11:05:54.116327    1498 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0829 11:05:54.116336    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0829 11:05:54.116347    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.158331    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0829 11:05:54.162388    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0829 11:05:54.162397    1498 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0829 11:05:54.162410    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.187334    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0829 11:05:54.187794    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:54.221295    1498 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0829 11:05:54.225379    1498 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0829 11:05:54.225389    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0829 11:05:54.225400    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.230338    1498 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0829 11:05:54.230350    1498 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0829 11:05:54.237713    1498 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0829 11:05:54.237724    1498 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0829 11:05:54.259348    1498 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23

	I0829 11:05:54.263401    1498 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0829 11:05:54.263413    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0829 11:05:54.263423    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.290175    1498 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0829 11:05:54.290186    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0829 11:05:54.292253    1498 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0829 11:05:54.292260    1498 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0829 11:05:54.316790    1498 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0829 11:05:54.316802    1498 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0829 11:05:54.319000    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0829 11:05:54.346128    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0829 11:05:54.359064    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0829 11:05:54.359078    1498 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0829 11:05:54.393313    1498 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-048000 service yakd-dashboard -n yakd-dashboard

	I0829 11:05:54.403574    1498 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-048000" context rescaled to 1 replicas

	I0829 11:05:54.406810    1498 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0829 11:05:54.406819    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0829 11:05:54.423053    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0829 11:05:54.438020    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0829 11:05:54.524859    1498 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0829 11:05:54.527915    1498 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0829 11:05:54.527926    1498 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0829 11:05:54.527937    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.556888    1498 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0

	I0829 11:05:54.560865    1498 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0829 11:05:54.560874    1498 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0829 11:05:54.560884    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.609857    1498 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0829 11:05:54.609867    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0829 11:05:54.612933    1498 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0

	I0829 11:05:54.622900    1498 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0

	I0829 11:05:54.629359    1498 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-048000"

	I0829 11:05:54.629379    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:54.629713    1498 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0

	I0829 11:05:54.632894    1498 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0829 11:05:54.633298    1498 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml

	I0829 11:05:54.633306    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)

	I0829 11:05:54.633316    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.642825    1498 out.go:177]   - Using image docker.io/busybox:stable

	I0829 11:05:54.645861    1498 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0829 11:05:54.645869    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0829 11:05:54.645878    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.657050    1498 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0829 11:05:54.657066    1498 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0829 11:05:54.663151    1498 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0829 11:05:54.663167    1498 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0829 11:05:54.670740    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0829 11:05:54.698298    1498 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0829 11:05:54.698311    1498 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0829 11:05:54.805277    1498 addons.go:234] Setting addon default-storageclass=true in "addons-048000"

	I0829 11:05:54.805299    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:05:54.805851    1498 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0829 11:05:54.805858    1498 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0829 11:05:54.805865    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.814065    1498 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0829 11:05:54.814078    1498 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0829 11:05:54.840510    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml

	I0829 11:05:54.892984    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0829 11:05:54.906330    1498 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0829 11:05:54.906347    1498 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0829 11:05:54.937260    1498 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0829 11:05:54.937273    1498 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0829 11:05:54.947398    1498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0829 11:05:54.951426    1498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0829 11:05:54.961371    1498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0829 11:05:54.965428    1498 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0829 11:05:54.965438    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0829 11:05:54.965449    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:54.989409    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0829 11:05:54.993459    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0829 11:05:54.997397    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0829 11:05:55.007388    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0829 11:05:55.010409    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0829 11:05:55.014430    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0829 11:05:55.018349    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0829 11:05:55.022410    1498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0829 11:05:55.028369    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0829 11:05:55.028393    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0829 11:05:55.028403    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:05:55.058253    1498 addons.go:475] Verifying addon registry=true in "addons-048000"

	I0829 11:05:55.061402    1498 out.go:177] * Verifying registry addon...

	I0829 11:05:55.069647    1498 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0829 11:05:55.069658    1498 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0829 11:05:55.070861    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0829 11:05:55.072896    1498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0829 11:05:55.088335    1498 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry

	I0829 11:05:55.088347    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:55.096048    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0829 11:05:55.255619    1498 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0829 11:05:55.255634    1498 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0829 11:05:55.438487    1498 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0829 11:05:55.438500    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0829 11:05:55.508530    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0829 11:05:55.508545    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0829 11:05:55.576750    1498 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0829 11:05:55.576760    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:55.628426    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0829 11:05:55.637547    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0829 11:05:55.637562    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0829 11:05:55.761396    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0829 11:05:55.761408    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0829 11:05:55.845812    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0829 11:05:55.845826    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0829 11:05:55.922694    1498 pod_ready.go:103] pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace has status "Ready":"False"

	I0829 11:05:55.959223    1498 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0829 11:05:55.959236    1498 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0829 11:05:56.002770    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0829 11:05:56.002781    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0829 11:05:56.048097    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0829 11:05:56.048110    1498 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0829 11:05:56.080453    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:56.082962    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0829 11:05:56.082970    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0829 11:05:56.122588    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0829 11:05:56.122598    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0829 11:05:56.130722    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.45997675s)

	I0829 11:05:56.130745    1498 addons.go:475] Verifying addon metrics-server=true in "addons-048000"

	I0829 11:05:56.131827    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.69380625s)

	W0829 11:05:56.131841    1498 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0829 11:05:56.131854    1498 retry.go:31] will retry after 325.204464ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0829 11:05:56.157030    1498 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0829 11:05:56.157042    1498 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0829 11:05:56.182972    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0829 11:05:56.458480    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0829 11:05:56.577050    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:57.076777    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:57.606977    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:57.936793    1498 pod_ready.go:103] pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace has status "Ready":"False"

	I0829 11:05:58.097245    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:58.157285    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (3.316787625s)

	I0829 11:05:58.157346    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.264379416s)

	I0829 11:05:58.157381    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.086538s)

	I0829 11:05:58.157447    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (3.061413916s)

	I0829 11:05:58.157456    1498 addons.go:475] Verifying addon ingress=true in "addons-048000"

	I0829 11:05:58.157483    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (2.529064834s)

	I0829 11:05:58.165397    1498 out.go:177] * Verifying ingress addon...

	I0829 11:05:58.171725    1498 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	W0829 11:05:58.189440    1498 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0829 11:05:58.192940    1498 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0829 11:05:58.192948    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:05:58.526765    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (2.343794125s)

	I0829 11:05:58.526787    1498 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-048000"

	I0829 11:05:58.526840    1498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.0683625s)

	I0829 11:05:58.529823    1498 out.go:177] * Verifying csi-hostpath-driver addon...

	I0829 11:05:58.537195    1498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0829 11:05:58.539726    1498 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0829 11:05:58.539732    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:05:58.649024    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:58.675702    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:05:59.041941    1498 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0829 11:05:59.041954    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:05:59.076932    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:59.175825    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:05:59.540807    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:05:59.640733    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:05:59.675846    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:00.041920    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:00.076537    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:00.175790    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:00.416271    1498 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-l9rg4" not found

	I0829 11:06:00.416283    1498 pod_ready.go:82] duration metric: took 6.50316125s for pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace to be "Ready" ...

	E0829 11:06:00.416288    1498 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-l9rg4" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-l9rg4" not found

	I0829 11:06:00.416291    1498 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-rvdk4" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.418388    1498 pod_ready.go:93] pod "coredns-6f6b679f8f-rvdk4" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:00.418394    1498 pod_ready.go:82] duration metric: took 2.100125ms for pod "coredns-6f6b679f8f-rvdk4" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.418398    1498 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.420166    1498 pod_ready.go:93] pod "etcd-addons-048000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:00.420171    1498 pod_ready.go:82] duration metric: took 1.770583ms for pod "etcd-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.420175    1498 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.421977    1498 pod_ready.go:93] pod "kube-apiserver-addons-048000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:00.421983    1498 pod_ready.go:82] duration metric: took 1.804625ms for pod "kube-apiserver-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.421987    1498 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.423842    1498 pod_ready.go:93] pod "kube-controller-manager-addons-048000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:00.423847    1498 pod_ready.go:82] duration metric: took 1.857375ms for pod "kube-controller-manager-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.423851    1498 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-nhfsw" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.540884    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:00.576492    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:00.618741    1498 pod_ready.go:93] pod "kube-proxy-nhfsw" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:00.618750    1498 pod_ready.go:82] duration metric: took 194.897167ms for pod "kube-proxy-nhfsw" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.618755    1498 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:00.675797    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:01.018658    1498 pod_ready.go:93] pod "kube-scheduler-addons-048000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:06:01.018667    1498 pod_ready.go:82] duration metric: took 399.912625ms for pod "kube-scheduler-addons-048000" in "kube-system" namespace to be "Ready" ...

	I0829 11:06:01.018671    1498 pod_ready.go:39] duration metric: took 7.114622167s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:06:01.018704    1498 api_server.go:52] waiting for apiserver process to appear ...

	I0829 11:06:01.018765    1498 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0829 11:06:01.025576    1498 api_server.go:72] duration metric: took 7.465654834s to wait for apiserver process to appear ...

	I0829 11:06:01.025586    1498 api_server.go:88] waiting for apiserver healthz status ...

	I0829 11:06:01.025598    1498 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0829 11:06:01.028075    1498 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0829 11:06:01.028518    1498 api_server.go:141] control plane version: v1.31.0

	I0829 11:06:01.028524    1498 api_server.go:131] duration metric: took 2.935583ms to wait for apiserver health ...

	I0829 11:06:01.028529    1498 system_pods.go:43] waiting for kube-system pods to appear ...

	I0829 11:06:01.041943    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:01.075545    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:01.175949    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:01.222340    1498 system_pods.go:59] 17 kube-system pods found

	I0829 11:06:01.222354    1498 system_pods.go:61] "coredns-6f6b679f8f-rvdk4" [67fcbd30-f94c-48e5-9601-e5bfdd79113d] Running

	I0829 11:06:01.222359    1498 system_pods.go:61] "csi-hostpath-attacher-0" [fb9138d9-d25d-449b-8496-709f6c4d5967] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0829 11:06:01.222362    1498 system_pods.go:61] "csi-hostpath-resizer-0" [77f98eb9-82ed-4691-8578-579e58a06a8d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0829 11:06:01.222366    1498 system_pods.go:61] "csi-hostpathplugin-mjsnx" [252aa175-8fd6-41a6-91d6-c6f4613c380e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0829 11:06:01.222368    1498 system_pods.go:61] "etcd-addons-048000" [e57f47b4-05ee-4ec1-9acb-57573964d6ca] Running

	I0829 11:06:01.222370    1498 system_pods.go:61] "kube-apiserver-addons-048000" [fed4ef15-005b-49d9-aad3-c833c00e6c90] Running

	I0829 11:06:01.222372    1498 system_pods.go:61] "kube-controller-manager-addons-048000" [a4487cc2-1dc8-4035-a190-2fe2aad19ac3] Running

	I0829 11:06:01.222375    1498 system_pods.go:61] "kube-ingress-dns-minikube" [fa6eb63b-6fa1-4c76-8fdd-f4e08708a8fe] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0829 11:06:01.222376    1498 system_pods.go:61] "kube-proxy-nhfsw" [4d1e0d40-7591-492f-a42f-a818d22b938e] Running

	I0829 11:06:01.222378    1498 system_pods.go:61] "kube-scheduler-addons-048000" [a111fc7b-789c-4a3c-a0c1-04618a5fac2c] Running

	I0829 11:06:01.222380    1498 system_pods.go:61] "metrics-server-8988944d9-b7srg" [13439dd5-2130-4f2a-aa96-82686d84633f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0829 11:06:01.222384    1498 system_pods.go:61] "nvidia-device-plugin-daemonset-t7r5k" [2700f353-f50b-4859-8e8b-852b4f080fb8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0829 11:06:01.222386    1498 system_pods.go:61] "registry-6fb4cdfc84-2xddm" [c5b53102-3848-4204-9379-99d61d77a524] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0829 11:06:01.222388    1498 system_pods.go:61] "registry-proxy-vr87j" [3059ef24-0a76-4ac9-bc80-747fc239f276] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0829 11:06:01.222391    1498 system_pods.go:61] "snapshot-controller-56fcc65765-28ktw" [754616ba-25fe-48eb-87bd-f2109d5484a6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0829 11:06:01.222393    1498 system_pods.go:61] "snapshot-controller-56fcc65765-qftpg" [2e8f93ca-e751-44e4-9493-dd72dd5e3988] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0829 11:06:01.222395    1498 system_pods.go:61] "storage-provisioner" [7eee403f-6a9d-4527-bc52-8dbd8cd7c96e] Running

	I0829 11:06:01.222398    1498 system_pods.go:74] duration metric: took 193.868292ms to wait for pod list to return data ...

	I0829 11:06:01.222401    1498 default_sa.go:34] waiting for default service account to be created ...

	I0829 11:06:01.393652    1498 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0829 11:06:01.393668    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:06:01.418549    1498 default_sa.go:45] found service account: "default"

	I0829 11:06:01.418559    1498 default_sa.go:55] duration metric: took 196.15675ms for default service account to be created ...

	I0829 11:06:01.418563    1498 system_pods.go:116] waiting for k8s-apps to be running ...

	I0829 11:06:01.426641    1498 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0829 11:06:01.433630    1498 addons.go:234] Setting addon gcp-auth=true in "addons-048000"

	I0829 11:06:01.433652    1498 host.go:66] Checking if "addons-048000" exists ...

	I0829 11:06:01.434390    1498 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0829 11:06:01.434398    1498 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/addons-048000/id_rsa Username:docker}

	I0829 11:06:01.463853    1498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0829 11:06:01.467197    1498 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0829 11:06:01.470200    1498 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0829 11:06:01.470206    1498 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0829 11:06:01.476462    1498 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0829 11:06:01.476469    1498 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0829 11:06:01.483424    1498 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0829 11:06:01.483431    1498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0829 11:06:01.492170    1498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0829 11:06:01.540112    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:01.640378    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:01.643951    1498 system_pods.go:86] 17 kube-system pods found

	I0829 11:06:01.643962    1498 system_pods.go:89] "coredns-6f6b679f8f-rvdk4" [67fcbd30-f94c-48e5-9601-e5bfdd79113d] Running

	I0829 11:06:01.643967    1498 system_pods.go:89] "csi-hostpath-attacher-0" [fb9138d9-d25d-449b-8496-709f6c4d5967] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0829 11:06:01.643970    1498 system_pods.go:89] "csi-hostpath-resizer-0" [77f98eb9-82ed-4691-8578-579e58a06a8d] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0829 11:06:01.643975    1498 system_pods.go:89] "csi-hostpathplugin-mjsnx" [252aa175-8fd6-41a6-91d6-c6f4613c380e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0829 11:06:01.643978    1498 system_pods.go:89] "etcd-addons-048000" [e57f47b4-05ee-4ec1-9acb-57573964d6ca] Running

	I0829 11:06:01.643980    1498 system_pods.go:89] "kube-apiserver-addons-048000" [fed4ef15-005b-49d9-aad3-c833c00e6c90] Running

	I0829 11:06:01.643983    1498 system_pods.go:89] "kube-controller-manager-addons-048000" [a4487cc2-1dc8-4035-a190-2fe2aad19ac3] Running

	I0829 11:06:01.643987    1498 system_pods.go:89] "kube-ingress-dns-minikube" [fa6eb63b-6fa1-4c76-8fdd-f4e08708a8fe] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0829 11:06:01.643990    1498 system_pods.go:89] "kube-proxy-nhfsw" [4d1e0d40-7591-492f-a42f-a818d22b938e] Running

	I0829 11:06:01.643991    1498 system_pods.go:89] "kube-scheduler-addons-048000" [a111fc7b-789c-4a3c-a0c1-04618a5fac2c] Running

	I0829 11:06:01.643994    1498 system_pods.go:89] "metrics-server-8988944d9-b7srg" [13439dd5-2130-4f2a-aa96-82686d84633f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0829 11:06:01.643998    1498 system_pods.go:89] "nvidia-device-plugin-daemonset-t7r5k" [2700f353-f50b-4859-8e8b-852b4f080fb8] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0829 11:06:01.644001    1498 system_pods.go:89] "registry-6fb4cdfc84-2xddm" [c5b53102-3848-4204-9379-99d61d77a524] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0829 11:06:01.644003    1498 system_pods.go:89] "registry-proxy-vr87j" [3059ef24-0a76-4ac9-bc80-747fc239f276] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0829 11:06:01.644006    1498 system_pods.go:89] "snapshot-controller-56fcc65765-28ktw" [754616ba-25fe-48eb-87bd-f2109d5484a6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0829 11:06:01.644009    1498 system_pods.go:89] "snapshot-controller-56fcc65765-qftpg" [2e8f93ca-e751-44e4-9493-dd72dd5e3988] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0829 11:06:01.644011    1498 system_pods.go:89] "storage-provisioner" [7eee403f-6a9d-4527-bc52-8dbd8cd7c96e] Running

	I0829 11:06:01.644015    1498 system_pods.go:126] duration metric: took 225.451375ms to wait for k8s-apps to be running ...

	I0829 11:06:01.644020    1498 system_svc.go:44] waiting for kubelet service to be running ....

	I0829 11:06:01.644074    1498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0829 11:06:01.675700    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:01.850950    1498 system_svc.go:56] duration metric: took 206.927709ms WaitForService to wait for kubelet

	I0829 11:06:01.850966    1498 kubeadm.go:582] duration metric: took 8.291052292s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:06:01.850977    1498 node_conditions.go:102] verifying NodePressure condition ...

	I0829 11:06:01.851779    1498 addons.go:475] Verifying addon gcp-auth=true in "addons-048000"

	I0829 11:06:01.853266    1498 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0829 11:06:01.853277    1498 node_conditions.go:123] node cpu capacity is 2

	I0829 11:06:01.853283    1498 node_conditions.go:105] duration metric: took 2.303209ms to run NodePressure ...

	I0829 11:06:01.853290    1498 start.go:241] waiting for startup goroutines ...

	I0829 11:06:01.859399    1498 out.go:177] * Verifying gcp-auth addon...

	I0829 11:06:01.862802    1498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0829 11:06:01.867617    1498 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0829 11:06:02.041022    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:02.076829    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:02.206540    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:02.543855    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:02.576947    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:02.675474    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:03.047891    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:03.079848    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:03.179574    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:03.542620    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:03.577881    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:03.674450    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:04.041443    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:04.076371    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:04.176032    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:04.541729    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:04.576220    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:04.675691    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:05.041448    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:05.076280    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:05.175820    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:05.540956    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:05.576541    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:05.675568    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:06.040606    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:06.135983    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:06.237726    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:06.541650    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:06.576836    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:06.676147    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:07.041899    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:07.076178    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:07.175809    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:07.540687    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:07.575851    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:07.675906    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:08.041951    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:08.076453    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:08.173522    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:08.541758    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:08.576427    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:08.749323    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:09.041632    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:09.076969    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:09.175608    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:09.542513    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:09.576597    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:09.674418    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:10.040600    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:10.076831    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:10.175629    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:10.541517    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:10.576249    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:10.675689    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:11.041510    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:11.076388    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:11.175764    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:11.541354    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:11.576401    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:11.675661    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:12.043592    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:12.076617    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:12.198902    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:12.541529    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:12.576524    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:12.675546    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:13.041945    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:13.077035    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:13.178688    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:13.548821    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:13.582213    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:13.675674    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:14.045011    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:14.077460    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:14.176088    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:14.549834    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:14.585189    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:14.677827    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:15.041466    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:15.076289    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:15.175361    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:15.542085    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:15.576819    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:15.676107    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:16.043806    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:16.077445    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:16.176906    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:16.544480    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:16.577558    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:16.675683    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:17.041559    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:17.076420    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:17.175625    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:17.545539    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:17.577931    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:17.675513    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:18.041335    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:18.076318    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:18.175758    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:18.545976    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:18.581327    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:18.676872    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:19.041979    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:19.076654    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:19.175583    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:19.539965    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:19.576991    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:19.677036    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:20.045499    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:20.079132    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:20.174419    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:20.541621    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:20.576504    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:20.675457    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:21.041476    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:21.081005    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:21.175961    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:21.543338    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:21.577300    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:21.676193    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:22.048218    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:22.079479    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:22.177044    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:22.543465    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:22.577609    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:22.675742    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:23.044280    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:23.077932    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:23.175368    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:23.541308    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:23.576203    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:23.676457    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:24.041850    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:24.075485    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:24.175756    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:24.541628    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:24.576220    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:24.675182    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:25.040188    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:25.076334    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:25.175655    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:25.541230    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:25.576449    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:25.675512    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:26.041152    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:26.075315    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:26.175647    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:26.541608    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:26.639631    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:26.740555    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:27.047500    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:27.078667    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0829 11:06:27.177913    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:27.546297    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:27.578733    1498 kapi.go:107] duration metric: took 32.506126833s to wait for kubernetes.io/minikube-addons=registry ...

	I0829 11:06:27.676746    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:28.041294    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:28.175514    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:28.540561    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:28.675278    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:29.043095    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:29.175701    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:29.541855    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:29.673452    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:30.041738    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:30.175667    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:30.541257    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:30.675440    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:31.042710    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:31.178062    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:31.541743    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:31.675427    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:32.041214    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:32.175495    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:32.543811    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:32.676480    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:33.046911    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:33.181573    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:33.540960    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:33.675209    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:34.041112    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:34.174304    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:34.541267    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:34.675155    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:35.041411    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:35.176260    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:35.541424    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:35.675560    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:36.044716    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:36.180806    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:36.542212    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:36.675831    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:37.041146    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:37.175497    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:37.539665    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:37.675158    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:38.041192    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:38.175344    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:38.541323    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:38.675195    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:39.045479    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:39.176333    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:39.542353    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:39.675644    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:40.046359    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:40.178102    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:40.541030    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:40.675255    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:41.040922    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:41.173492    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:41.539676    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:41.675479    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:42.040846    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:42.175380    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:42.541852    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:42.675759    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:43.042449    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:43.176787    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:43.551085    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:43.675502    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:44.041651    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:44.175311    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:44.541095    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:44.675436    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:45.041275    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:45.173563    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:45.541100    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:45.675361    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:46.042188    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:46.176668    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:46.543859    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:46.675526    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:47.041238    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:47.175647    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:47.541510    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:47.674649    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:48.041829    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:48.177535    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:48.544626    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:48.676495    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:49.041031    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:49.176836    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:49.541330    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:49.675060    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:50.041089    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:50.175575    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:50.555431    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:50.677026    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:51.044767    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:51.182001    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:51.547210    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:51.678619    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:52.041924    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:52.173634    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:52.540802    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:52.675108    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:53.040943    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:53.174952    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:53.541105    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:53.675413    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:54.043029    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:54.177796    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:54.556715    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:54.677004    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:55.043503    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:55.176097    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:55.541682    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:55.674989    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:56.041251    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:56.175409    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:56.541223    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:56.675095    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:57.042987    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:57.177077    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:57.548666    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:57.675348    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:58.042223    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:58.175604    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:58.541028    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:58.675063    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:59.039384    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:59.175196    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:06:59.541204    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:06:59.675450    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:00.041136    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:00.174761    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:00.544053    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:00.677341    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:01.040251    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:01.175225    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:01.541123    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:01.674937    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:02.040895    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:02.175033    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:02.542975    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:02.676590    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:03.046441    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:03.177945    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:03.543329    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:03.675896    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:04.040754    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:04.175249    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:04.541388    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:04.675339    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:05.039687    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:05.175126    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:05.541706    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:05.675271    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:06.040654    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:06.175350    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:06.540161    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:06.675320    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:07.040919    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:07.175281    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:07.540992    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:07.674950    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:08.040933    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:08.175158    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:08.540774    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:08.674998    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:09.040899    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:09.175198    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:09.541176    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:09.675140    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:10.041090    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:10.175037    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:10.540810    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:10.676328    1498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0829 11:07:11.041625    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:11.175966    1498 kapi.go:107] duration metric: took 1m13.004895375s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0829 11:07:11.541464    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:12.041024    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:12.541013    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:13.041016    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:13.542481    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:14.041930    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:14.541589    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:15.041154    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:15.543547    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:16.043608    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:16.551314    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:17.041051    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:17.541410    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:18.041108    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:18.541720    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:19.041289    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:19.542313    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:20.041216    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:20.540886    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:21.040999    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:21.540971    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:22.041238    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0829 11:07:22.541800    1498 kapi.go:107] duration metric: took 1m24.005357542s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0829 11:07:23.865426    1498 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0829 11:07:23.865434    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:24.368798    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:24.867839    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:25.370822    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:25.866935    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:26.371068    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:26.867187    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:27.370773    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:27.865677    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:28.366496    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:28.864519    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:29.369898    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:29.866274    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:30.372363    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:30.866102    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:31.367833    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:31.866287    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:32.366382    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:32.867776    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:33.368368    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:33.866243    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:34.366637    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:34.867369    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:35.367221    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:35.865222    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:36.367639    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:36.864616    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:37.368299    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:37.865515    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:38.366691    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:38.866042    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:39.370835    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:39.867287    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:40.367285    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:40.867446    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:41.371785    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:41.866605    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:42.368193    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:42.867468    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:43.371335    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:43.868392    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:44.368742    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:44.866664    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:45.373052    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:45.865799    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:46.371423    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:46.866062    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:47.372477    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:47.865866    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:48.366288    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:48.865682    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:49.367798    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:49.866506    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:50.367415    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:50.866712    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:51.372763    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:51.866378    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:52.367488    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:52.866215    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:53.371423    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:53.866921    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:54.372357    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:54.866819    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:55.371763    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:55.865552    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:56.368719    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:56.866636    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:57.370067    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:57.865379    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:58.366008    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:58.866107    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:59.368527    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:07:59.866663    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:00.374005    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:00.866257    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:01.371514    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:01.870270    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:02.371422    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:02.867020    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:03.371171    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:03.866396    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:04.371849    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:04.867002    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:05.367866    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:05.866943    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:06.370150    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:06.867085    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:07.367044    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:07.865584    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:08.367103    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:08.867803    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:09.370300    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:09.872055    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:10.368666    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:10.866936    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:11.371432    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:11.867012    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:12.367041    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:12.867561    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:13.370116    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:13.866371    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:14.366561    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:14.866374    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:15.367085    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:15.866191    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:16.371484    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:16.865501    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:17.367023    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:17.865692    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:18.366686    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:18.870702    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:19.367692    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:19.866316    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:20.367258    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:20.866403    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:21.366585    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:21.866573    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:22.372107    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:22.870298    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:23.370433    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:23.865299    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:24.367470    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:24.867597    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:25.370867    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:25.867612    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:26.367210    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:26.866361    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:27.366739    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:27.865418    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:28.365482    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:28.867201    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:29.365621    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:29.864353    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:30.366103    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:30.865353    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:31.365078    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:31.865575    1498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0829 11:08:32.369602    1498 kapi.go:107] duration metric: took 2m30.508152583s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0829 11:08:32.373474    1498 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-048000 cluster.

	I0829 11:08:32.376358    1498 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0829 11:08:32.380466    1498 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0829 11:08:32.385469    1498 out.go:177] * Enabled addons: ingress-dns, yakd, storage-provisioner, nvidia-device-plugin, cloud-spanner, metrics-server, volcano, inspektor-gadget, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth

	I0829 11:08:32.389378    1498 addons.go:510] duration metric: took 2m38.830799458s for enable addons: enabled=[ingress-dns yakd storage-provisioner nvidia-device-plugin cloud-spanner metrics-server volcano inspektor-gadget default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]

	I0829 11:08:32.389392    1498 start.go:246] waiting for cluster config update ...

	I0829 11:08:32.389406    1498 start.go:255] writing updated cluster config ...

	I0829 11:08:32.391288    1498 ssh_runner.go:195] Run: rm -f paused

	I0829 11:08:32.550513    1498 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0829 11:08:32.554446    1498 out.go:201] 

	W0829 11:08:32.558391    1498 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0829 11:08:32.562312    1498 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0829 11:08:32.575427    1498 out.go:177] * Done! kubectl is now configured to use "addons-048000" cluster and "default" namespace by default

	==> Docker <==

	Aug 29 18:18:19 addons-048000 cri-dockerd[1179]: time="2024-08-29T18:18:19Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"

	Aug 29 18:18:19 addons-048000 dockerd[1282]: time="2024-08-29T18:18:19.612444842Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 29 18:18:19 addons-048000 dockerd[1282]: time="2024-08-29T18:18:19.612476383Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 29 18:18:19 addons-048000 dockerd[1282]: time="2024-08-29T18:18:19.612493507Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:18:19 addons-048000 dockerd[1282]: time="2024-08-29T18:18:19.612526673Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:18:23 addons-048000 dockerd[1276]: time="2024-08-29T18:18:23.369987350Z" level=info msg="ignoring event" container=48fc94d551cd68b1a166e2ef48e03c5989411df1f5d685caefba1d34874e0cca module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.369981559Z" level=info msg="shim disconnected" id=48fc94d551cd68b1a166e2ef48e03c5989411df1f5d685caefba1d34874e0cca namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.370012225Z" level=warning msg="cleaning up after shim disconnected" id=48fc94d551cd68b1a166e2ef48e03c5989411df1f5d685caefba1d34874e0cca namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.370016516Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.512830150Z" level=info msg="shim disconnected" id=4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.512884482Z" level=warning msg="cleaning up after shim disconnected" id=4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.512890357Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1276]: time="2024-08-29T18:18:23.513099476Z" level=info msg="ignoring event" container=4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.554735844Z" level=info msg="shim disconnected" id=497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.554768926Z" level=warning msg="cleaning up after shim disconnected" id=497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.554773259Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1276]: time="2024-08-29T18:18:23.554906006Z" level=info msg="ignoring event" container=497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.609041421Z" level=info msg="shim disconnected" id=7c1d83eaee1b24864035c93678a56ae994d472dc681e42901db579a41d2a8a04 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1276]: time="2024-08-29T18:18:23.609090462Z" level=info msg="ignoring event" container=7c1d83eaee1b24864035c93678a56ae994d472dc681e42901db579a41d2a8a04 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.609157585Z" level=warning msg="cleaning up after shim disconnected" id=7c1d83eaee1b24864035c93678a56ae994d472dc681e42901db579a41d2a8a04 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.609178376Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1276]: time="2024-08-29T18:18:23.676550861Z" level=info msg="ignoring event" container=0d8be53995da2b19de07d0f947e38413cf5f4b7aab95303ea204b36a59c08da1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.676681024Z" level=info msg="shim disconnected" id=0d8be53995da2b19de07d0f947e38413cf5f4b7aab95303ea204b36a59c08da1 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.676986600Z" level=warning msg="cleaning up after shim disconnected" id=0d8be53995da2b19de07d0f947e38413cf5f4b7aab95303ea204b36a59c08da1 namespace=moby

	Aug 29 18:18:23 addons-048000 dockerd[1282]: time="2024-08-29T18:18:23.677007349Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                       ATTEMPT             POD ID              POD

	5cef6d3fbef29       nginx@sha256:c04c18adc2a407740a397c8407c011fc6c90026a9b65cceddef7ae5484360158                                                4 seconds ago       Running             nginx                      0                   0712a6a2d8b53       nginx

	1f5d77a9498f4       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb                 9 minutes ago       Running             gcp-auth                   0                   cc53b982336ce       gcp-auth-89d5ffd79-6tgp6

	441c7c7d5ff81       registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce             11 minutes ago      Running             controller                 0                   cc33052372bb4       ingress-nginx-controller-bc57996ff-vv9dw

	60877db28f13e       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   11 minutes ago      Exited              patch                      0                   aa7bf4ef483a2       ingress-nginx-admission-patch-d8mvk

	05cf1c02fd52f       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   11 minutes ago      Exited              create                     0                   66c6af881e449       ingress-nginx-admission-create-mlsl6

	dd4042f55f569       rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246                       11 minutes ago      Running             local-path-provisioner     0                   c276852165810       local-path-provisioner-86d989889c-2ckzc

	497714a41c509       gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367              11 minutes ago      Exited              registry-proxy             0                   0d8be53995da2       registry-proxy-vr87j

	37278a0b8e331       gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc               12 minutes ago      Running             cloud-spanner-emulator     0                   f526fcc76f524       cloud-spanner-emulator-769b77f747-2gqs5

	daeff120b2637       nvcr.io/nvidia/k8s-device-plugin@sha256:ed39e22c8b71343fb996737741a99da88ce6c75dd83b5c520e0b3d8e8a884c47                     12 minutes ago      Running             nvidia-device-plugin-ctr   0                   eea61c92d97a1       nvidia-device-plugin-daemonset-t7r5k

	4410a5c85d11a       registry@sha256:12120425f07de11a1b899e418d4b0ea174c8d4d572d45bdb640f93bc7ca06a3d                                             12 minutes ago      Exited              registry                   0                   7c1d83eaee1b2       registry-6fb4cdfc84-2xddm

	e3033bf808770       marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624                                        12 minutes ago      Running             yakd                       0                   0842fc5076de5       yakd-dashboard-67d98fc6b-fntc9

	032beb891c95e       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             12 minutes ago      Running             minikube-ingress-dns       0                   a5d99750711a2       kube-ingress-dns-minikube

	46c9aa4000fac       ba04bb24b9575                                                                                                                12 minutes ago      Running             storage-provisioner        0                   fb78aa5d189d9       storage-provisioner

	e0b66861880f7       2437cf7621777                                                                                                                12 minutes ago      Running             coredns                    0                   d1e683408d6f9       coredns-6f6b679f8f-rvdk4

	12c6b62da3a0f       71d55d66fd4ee                                                                                                                12 minutes ago      Running             kube-proxy                 0                   f9126e8eee8f9       kube-proxy-nhfsw

	d2989d442fb2b       fbbbd428abb4d                                                                                                                12 minutes ago      Running             kube-scheduler             0                   0bde560671b51       kube-scheduler-addons-048000

	a3376fc3007c3       27e3830e14027                                                                                                                12 minutes ago      Running             etcd                       0                   d45b986aeff0b       etcd-addons-048000

	1fdf130a238ea       fcb0683e6bdbd                                                                                                                12 minutes ago      Running             kube-controller-manager    0                   04bb25cbec2d9       kube-controller-manager-addons-048000

	c41defbf78378       cd0f0ae0ec9e0                                                                                                                12 minutes ago      Running             kube-apiserver             0                   4766f8436e2ec       kube-apiserver-addons-048000

	==> controller_ingress [441c7c7d5ff8] <==

	I0829 18:07:10.237032       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"6dc4abb1-2489-4cfd-9409-4f7ceadb82ad", APIVersion:"v1", ResourceVersion:"634", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services

	I0829 18:07:10.237065       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"c9f92bc3-ac3e-43c1-9596-18c79e8af292", APIVersion:"v1", ResourceVersion:"635", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services

	I0829 18:07:11.434834       7 nginx.go:317] "Starting NGINX process"

	I0829 18:07:11.435191       7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...

	I0829 18:07:11.435913       7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"

	I0829 18:07:11.437238       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0829 18:07:11.449752       7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader

	I0829 18:07:11.450398       7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-vv9dw"

	I0829 18:07:11.464798       7 controller.go:213] "Backend successfully reloaded"

	I0829 18:07:11.464910       7 controller.go:224] "Initial sync, sleeping for 1 second"

	I0829 18:07:11.465150       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-vv9dw", UID:"43de9018-8fe4-4332-83cf-e5a3ba7a9c39", APIVersion:"v1", ResourceVersion:"662", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	I0829 18:07:11.472653       7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-vv9dw" node="addons-048000"

	W0829 18:18:16.229365       7 controller.go:1110] Error obtaining Endpoints for Service "default/nginx": no object matching key "default/nginx" in local store

	I0829 18:18:16.238675       7 admission.go:149] processed ingress via admission controller {testedIngressLength:1 testedIngressTime:0.009s renderingIngressLength:1 renderingIngressTime:0s admissionTime:0.009s testedConfigurationSize:18.1kB}

	I0829 18:18:16.238698       7 main.go:107] "successfully validated configuration, accepting" ingress="default/nginx-ingress"

	I0829 18:18:16.241523       7 store.go:440] "Found valid IngressClass" ingress="default/nginx-ingress" ingressclass="nginx"

	W0829 18:18:16.241778       7 controller.go:1110] Error obtaining Endpoints for Service "default/nginx": no object matching key "default/nginx" in local store

	I0829 18:18:16.241844       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0829 18:18:16.241905       7 event.go:377] Event(v1.ObjectReference{Kind:"Ingress", Namespace:"default", Name:"nginx-ingress", UID:"7c0fd94a-f883-49a8-a31b-85923d17afb9", APIVersion:"networking.k8s.io/v1", ResourceVersion:"2698", FieldPath:""}): type: 'Normal' reason: 'Sync' Scheduled for sync

	I0829 18:18:16.263855       7 controller.go:213] "Backend successfully reloaded"

	I0829 18:18:16.264199       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-vv9dw", UID:"43de9018-8fe4-4332-83cf-e5a3ba7a9c39", APIVersion:"v1", ResourceVersion:"662", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	W0829 18:18:19.578284       7 controller.go:1216] Service "default/nginx" does not have any active Endpoint.

	I0829 18:18:19.578365       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0829 18:18:19.601343       7 controller.go:213] "Backend successfully reloaded"

	I0829 18:18:19.601719       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-vv9dw", UID:"43de9018-8fe4-4332-83cf-e5a3ba7a9c39", APIVersion:"v1", ResourceVersion:"662", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	==> coredns [e0b66861880f] <==

	[INFO] 127.0.0.1:54910 - 26817 "HINFO IN 3112745777569883698.9048178716321599015. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.010181949s

	[INFO] 10.244.0.8:60509 - 13641 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000090375s

	[INFO] 10.244.0.8:60509 - 32587 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000097792s

	[INFO] 10.244.0.8:45693 - 46145 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000030458s

	[INFO] 10.244.0.8:45693 - 34654 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000077958s

	[INFO] 10.244.0.8:45959 - 506 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000039792s

	[INFO] 10.244.0.8:45959 - 53499 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000021333s

	[INFO] 10.244.0.8:60441 - 38122 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.0000645s

	[INFO] 10.244.0.8:60441 - 28138 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000026875s

	[INFO] 10.244.0.8:51405 - 32822 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000038958s

	[INFO] 10.244.0.8:51405 - 16946 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000059208s

	[INFO] 10.244.0.8:49711 - 29239 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000012584s

	[INFO] 10.244.0.8:49711 - 3888 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000056125s

	[INFO] 10.244.0.8:58716 - 372 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000011959s

	[INFO] 10.244.0.8:58716 - 12405 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000028167s

	[INFO] 10.244.0.8:52852 - 37161 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000012083s

	[INFO] 10.244.0.8:52852 - 20264 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000012875s

	[INFO] 10.244.0.25:46950 - 7143 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000149457s

	[INFO] 10.244.0.25:40020 - 1467 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000062167s

	[INFO] 10.244.0.25:59021 - 14998 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000035292s

	[INFO] 10.244.0.25:46554 - 46270 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000108041s

	[INFO] 10.244.0.25:38157 - 55658 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000034292s

	[INFO] 10.244.0.25:34685 - 30617 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000037958s

	[INFO] 10.244.0.25:58790 - 31671 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001106034s

	[INFO] 10.244.0.25:52597 - 31249 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.001175076s

	==> describe nodes <==

	Name:               addons-048000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-048000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=95341f0b655cea8be5ebfc6bf112c8367dc08d33

	                    minikube.k8s.io/name=addons-048000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_29T11_05_48_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-048000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Thu, 29 Aug 2024 18:05:46 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-048000

	  AcquireTime:     <unset>

	  RenewTime:       Thu, 29 Aug 2024 18:18:23 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Thu, 29 Aug 2024 18:14:29 +0000   Thu, 29 Aug 2024 18:05:44 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Thu, 29 Aug 2024 18:14:29 +0000   Thu, 29 Aug 2024 18:05:44 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Thu, 29 Aug 2024 18:14:29 +0000   Thu, 29 Aug 2024 18:05:44 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Thu, 29 Aug 2024 18:14:29 +0000   Thu, 29 Aug 2024 18:05:51 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-048000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 7a1f210fee9d465396233089da4e8e25

	  System UUID:                7a1f210fee9d465396233089da4e8e25

	  Boot ID:                    ae226006-53a9-4024-9ef8-fa55bcabb191

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.1.2

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (17 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m13s

	  default                     cloud-spanner-emulator-769b77f747-2gqs5     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  default                     nginx                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         7s

	  default                     registry-test                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         60s

	  gcp-auth                    gcp-auth-89d5ffd79-6tgp6                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  ingress-nginx               ingress-nginx-controller-bc57996ff-vv9dw    100m (5%)     0 (0%)      90Mi (2%)        0 (0%)         12m

	  kube-system                 coredns-6f6b679f8f-rvdk4                    100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     12m

	  kube-system                 etcd-addons-048000                          100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         12m

	  kube-system                 kube-apiserver-addons-048000                250m (12%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-controller-manager-addons-048000       200m (10%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-proxy-nhfsw                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-scheduler-addons-048000                100m (5%)     0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 nvidia-device-plugin-daemonset-t7r5k        0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  local-path-storage          local-path-provisioner-86d989889c-2ckzc     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  yakd-dashboard              yakd-dashboard-67d98fc6b-fntc9              0 (0%)        0 (0%)      128Mi (3%)       256Mi (6%)     12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                850m (42%)   0 (0%)

	  memory             388Mi (10%)  426Mi (11%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-1Gi      0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	  hugepages-32Mi     0 (0%)       0 (0%)

	  hugepages-64Ki     0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 12m   kube-proxy       

	  Normal  Starting                 12m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  12m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  12m   kubelet          Node addons-048000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m   kubelet          Node addons-048000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m   kubelet          Node addons-048000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                12m   kubelet          Node addons-048000 status is now: NodeReady

	  Normal  RegisteredNode           12m   node-controller  Node addons-048000 event: Registered Node addons-048000 in Controller

	==> dmesg <==

	[  +4.952197] kauditd_printk_skb: 288 callbacks suppressed

	[Aug29 18:06] kauditd_printk_skb: 54 callbacks suppressed

	[  +6.746149] kauditd_printk_skb: 4 callbacks suppressed

	[ +18.948093] kauditd_printk_skb: 4 callbacks suppressed

	[  +7.087389] kauditd_printk_skb: 5 callbacks suppressed

	[  +5.644138] kauditd_printk_skb: 14 callbacks suppressed

	[  +5.354242] kauditd_printk_skb: 22 callbacks suppressed

	[  +6.548380] kauditd_printk_skb: 2 callbacks suppressed

	[Aug29 18:07] kauditd_printk_skb: 44 callbacks suppressed

	[ +16.355138] kauditd_printk_skb: 16 callbacks suppressed

	[ +29.433263] kauditd_printk_skb: 16 callbacks suppressed

	[Aug29 18:08] kauditd_printk_skb: 2 callbacks suppressed

	[ +22.797824] kauditd_printk_skb: 46 callbacks suppressed

	[ +21.975897] kauditd_printk_skb: 21 callbacks suppressed

	[  +5.577549] kauditd_printk_skb: 2 callbacks suppressed

	[Aug29 18:09] kauditd_printk_skb: 20 callbacks suppressed

	[ +20.016619] kauditd_printk_skb: 2 callbacks suppressed

	[Aug29 18:12] kauditd_printk_skb: 2 callbacks suppressed

	[Aug29 18:17] kauditd_printk_skb: 2 callbacks suppressed

	[  +8.896589] kauditd_printk_skb: 19 callbacks suppressed

	[ +25.465294] kauditd_printk_skb: 7 callbacks suppressed

	[Aug29 18:18] kauditd_printk_skb: 45 callbacks suppressed

	[  +5.292785] kauditd_printk_skb: 6 callbacks suppressed

	[  +5.251438] kauditd_printk_skb: 4 callbacks suppressed

	[ +12.341836] kauditd_printk_skb: 13 callbacks suppressed

	==> etcd [a3376fc3007c] <==

	{"level":"info","ts":"2024-08-29T18:05:44.618620Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2024-08-29T18:05:45.605074Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2024-08-29T18:05:45.605185Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2024-08-29T18:05:45.605231Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2024-08-29T18:05:45.605255Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2024-08-29T18:05:45.605264Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-08-29T18:05:45.605310Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2024-08-29T18:05:45.605346Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-08-29T18:05:45.606640Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-048000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-29T18:05:45.606665Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:05:45.607078Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-29T18:05:45.607099Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-29T18:05:45.606707Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:05:45.607594Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:05:45.607771Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:05:45.606720Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:05:45.608118Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:05:45.608775Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:05:45.608776Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:05:45.610421Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-08-29T18:05:45.611170Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2024-08-29T18:08:54.102689Z","caller":"traceutil/trace.go:171","msg":"trace[749155615] transaction","detail":"{read_only:false; response_revision:1509; number_of_response:1; }","duration":"109.970251ms","start":"2024-08-29T18:08:53.990229Z","end":"2024-08-29T18:08:54.100200Z","steps":["trace[749155615] 'process raft request'  (duration: 109.870294ms)"],"step_count":1}

	{"level":"info","ts":"2024-08-29T18:15:45.174661Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1828}

	{"level":"info","ts":"2024-08-29T18:15:45.269614Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1828,"took":"93.675051ms","hash":2936028612,"current-db-size-bytes":8790016,"current-db-size":"8.8 MB","current-db-size-in-use-bytes":4710400,"current-db-size-in-use":"4.7 MB"}

	{"level":"info","ts":"2024-08-29T18:15:45.269706Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2936028612,"revision":1828,"compact-revision":-1}

	==> gcp-auth [1f5d77a9498f] <==

	2024/08/29 18:08:31 GCP Auth Webhook started!

	2024/08/29 18:08:47 Ready to marshal response ...

	2024/08/29 18:08:47 Ready to write response ...

	2024/08/29 18:08:48 Ready to marshal response ...

	2024/08/29 18:08:48 Ready to write response ...

	2024/08/29 18:09:10 Ready to marshal response ...

	2024/08/29 18:09:10 Ready to write response ...

	2024/08/29 18:09:10 Ready to marshal response ...

	2024/08/29 18:09:10 Ready to write response ...

	2024/08/29 18:09:11 Ready to marshal response ...

	2024/08/29 18:09:11 Ready to write response ...

	2024/08/29 18:17:18 Ready to marshal response ...

	2024/08/29 18:17:18 Ready to write response ...

	2024/08/29 18:17:23 Ready to marshal response ...

	2024/08/29 18:17:23 Ready to write response ...

	2024/08/29 18:17:44 Ready to marshal response ...

	2024/08/29 18:17:44 Ready to write response ...

	2024/08/29 18:18:16 Ready to marshal response ...

	2024/08/29 18:18:16 Ready to write response ...

	==> kernel <==

	 18:18:24 up 12 min,  0 users,  load average: 0.46, 0.60, 0.46

	Linux addons-048000 5.10.207 #1 SMP PREEMPT Tue Aug 27 17:57:16 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [c41defbf7837] <==

	I0829 18:09:01.567316       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0829 18:09:01.716835       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	W0829 18:09:02.288866       1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh

	W0829 18:09:02.409952       1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh

	W0829 18:09:02.476069       1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh

	W0829 18:09:02.613255       1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh

	W0829 18:09:02.613323       1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh

	W0829 18:09:02.717833       1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh

	W0829 18:09:02.761984       1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh

	I0829 18:17:26.465903       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I0829 18:18:00.322487       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0829 18:18:00.322504       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0829 18:18:00.332993       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0829 18:18:00.336762       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0829 18:18:00.350608       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0829 18:18:00.350627       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0829 18:18:00.366256       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0829 18:18:00.366281       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W0829 18:18:01.339618       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W0829 18:18:01.370234       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W0829 18:18:01.371720       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	I0829 18:18:10.911255       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	W0829 18:18:12.021987       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io

	I0829 18:18:16.239203       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io

	I0829 18:18:16.339860       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.111.247.66"}

	==> kube-controller-manager [1fdf130a238e] <==

	W0829 18:18:09.477443       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:09.477561       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:10.081781       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:10.082132       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:10.325177       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:10.325274       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	E0829 18:18:12.022796       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:13.541905       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:13.542033       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:16.446223       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:16.446251       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:18.191794       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:18.191946       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0829 18:18:20.995645       1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="gadget"

	W0829 18:18:21.802371       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:21.802421       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:22.372366       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:22.372603       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0829 18:18:22.742569       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0829 18:18:22.742614       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0829 18:18:22.856094       1 shared_informer.go:313] Waiting for caches to sync for resource quota

	I0829 18:18:22.856809       1 shared_informer.go:320] Caches are synced for resource quota

	I0829 18:18:23.428362       1 shared_informer.go:313] Waiting for caches to sync for garbage collector

	I0829 18:18:23.428379       1 shared_informer.go:320] Caches are synced for garbage collector

	I0829 18:18:23.490673       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-6fb4cdfc84" duration="1.5µs"

	==> kube-proxy [12c6b62da3a0] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0829 18:05:54.184747       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0829 18:05:54.198937       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.2"]

	E0829 18:05:54.198971       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0829 18:05:54.223988       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0829 18:05:54.224008       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0829 18:05:54.224024       1 server_linux.go:169] "Using iptables Proxier"

	I0829 18:05:54.228298       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0829 18:05:54.228401       1 server.go:483] "Version info" version="v1.31.0"

	I0829 18:05:54.228406       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0829 18:05:54.228928       1 config.go:197] "Starting service config controller"

	I0829 18:05:54.228951       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0829 18:05:54.228965       1 config.go:104] "Starting endpoint slice config controller"

	I0829 18:05:54.228969       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0829 18:05:54.229273       1 config.go:326] "Starting node config controller"

	I0829 18:05:54.229275       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0829 18:05:54.329592       1 shared_informer.go:320] Caches are synced for node config

	I0829 18:05:54.329630       1 shared_informer.go:320] Caches are synced for service config

	I0829 18:05:54.329643       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [d2989d442fb2] <==

	W0829 18:05:46.177142       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0829 18:05:46.177147       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:46.177168       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:46.177176       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:46.177193       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:46.177198       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:46.177222       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:46.177229       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:46.177246       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0829 18:05:46.177251       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:46.987667       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:46.987722       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.030165       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0829 18:05:47.030282       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.096579       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0829 18:05:47.096641       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.119600       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:47.119893       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.174634       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0829 18:05:47.174729       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.183893       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0829 18:05:47.183918       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0829 18:05:47.225819       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0829 18:05:47.225842       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"

	I0829 18:05:47.775117       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Aug 29 18:18:16 addons-048000 kubelet[2052]: I0829 18:18:16.319265    2052 memory_manager.go:354] "RemoveStaleState removing state" podUID="d3ba83d9-53f3-4399-b695-a537ea82efad" containerName="task-pv-container"

	Aug 29 18:18:16 addons-048000 kubelet[2052]: I0829 18:18:16.361017    2052 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/15267d08-9c88-4381-8d32-53fd2f55bf90-gcp-creds\") pod \"nginx\" (UID: \"15267d08-9c88-4381-8d32-53fd2f55bf90\") " pod="default/nginx"

	Aug 29 18:18:16 addons-048000 kubelet[2052]: I0829 18:18:16.361041    2052 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv42l\" (UniqueName: \"kubernetes.io/projected/15267d08-9c88-4381-8d32-53fd2f55bf90-kube-api-access-hv42l\") pod \"nginx\" (UID: \"15267d08-9c88-4381-8d32-53fd2f55bf90\") " pod="default/nginx"

	Aug 29 18:18:17 addons-048000 kubelet[2052]: E0829 18:18:17.643752    2052 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-test\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox\\\"\"" pod="default/registry-test" podUID="5307fd4b-725e-41cd-8f3d-8049fba6a389"

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.273257    2052 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/nginx" podStartSLOduration=4.489671122 podStartE2EDuration="7.273154341s" podCreationTimestamp="2024-08-29 18:18:16 +0000 UTC" firstStartedPulling="2024-08-29 18:18:16.730717457 +0000 UTC m=+749.145421112" lastFinishedPulling="2024-08-29 18:18:19.514200635 +0000 UTC m=+751.928904331" observedRunningTime="2024-08-29 18:18:19.930884965 +0000 UTC m=+752.345588662" watchObservedRunningTime="2024-08-29 18:18:23.273154341 +0000 UTC m=+755.687858080"

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.431698    2052 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjnhg\" (UniqueName: \"kubernetes.io/projected/5307fd4b-725e-41cd-8f3d-8049fba6a389-kube-api-access-jjnhg\") pod \"5307fd4b-725e-41cd-8f3d-8049fba6a389\" (UID: \"5307fd4b-725e-41cd-8f3d-8049fba6a389\") "

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.431732    2052 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5307fd4b-725e-41cd-8f3d-8049fba6a389-gcp-creds\") pod \"5307fd4b-725e-41cd-8f3d-8049fba6a389\" (UID: \"5307fd4b-725e-41cd-8f3d-8049fba6a389\") "

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.431772    2052 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5307fd4b-725e-41cd-8f3d-8049fba6a389-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "5307fd4b-725e-41cd-8f3d-8049fba6a389" (UID: "5307fd4b-725e-41cd-8f3d-8049fba6a389"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.432572    2052 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5307fd4b-725e-41cd-8f3d-8049fba6a389-kube-api-access-jjnhg" (OuterVolumeSpecName: "kube-api-access-jjnhg") pod "5307fd4b-725e-41cd-8f3d-8049fba6a389" (UID: "5307fd4b-725e-41cd-8f3d-8049fba6a389"). InnerVolumeSpecName "kube-api-access-jjnhg". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.531969    2052 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-jjnhg\" (UniqueName: \"kubernetes.io/projected/5307fd4b-725e-41cd-8f3d-8049fba6a389-kube-api-access-jjnhg\") on node \"addons-048000\" DevicePath \"\""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.532000    2052 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5307fd4b-725e-41cd-8f3d-8049fba6a389-gcp-creds\") on node \"addons-048000\" DevicePath \"\""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.732889    2052 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmxcq\" (UniqueName: \"kubernetes.io/projected/3059ef24-0a76-4ac9-bc80-747fc239f276-kube-api-access-jmxcq\") pod \"3059ef24-0a76-4ac9-bc80-747fc239f276\" (UID: \"3059ef24-0a76-4ac9-bc80-747fc239f276\") "

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.732911    2052 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvf9c\" (UniqueName: \"kubernetes.io/projected/c5b53102-3848-4204-9379-99d61d77a524-kube-api-access-gvf9c\") pod \"c5b53102-3848-4204-9379-99d61d77a524\" (UID: \"c5b53102-3848-4204-9379-99d61d77a524\") "

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.733963    2052 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b53102-3848-4204-9379-99d61d77a524-kube-api-access-gvf9c" (OuterVolumeSpecName: "kube-api-access-gvf9c") pod "c5b53102-3848-4204-9379-99d61d77a524" (UID: "c5b53102-3848-4204-9379-99d61d77a524"). InnerVolumeSpecName "kube-api-access-gvf9c". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.733985    2052 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3059ef24-0a76-4ac9-bc80-747fc239f276-kube-api-access-jmxcq" (OuterVolumeSpecName: "kube-api-access-jmxcq") pod "3059ef24-0a76-4ac9-bc80-747fc239f276" (UID: "3059ef24-0a76-4ac9-bc80-747fc239f276"). InnerVolumeSpecName "kube-api-access-jmxcq". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.834017    2052 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-jmxcq\" (UniqueName: \"kubernetes.io/projected/3059ef24-0a76-4ac9-bc80-747fc239f276-kube-api-access-jmxcq\") on node \"addons-048000\" DevicePath \"\""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.834034    2052 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-gvf9c\" (UniqueName: \"kubernetes.io/projected/c5b53102-3848-4204-9379-99d61d77a524-kube-api-access-gvf9c\") on node \"addons-048000\" DevicePath \"\""

	Aug 29 18:18:23 addons-048000 kubelet[2052]: I0829 18:18:23.979381    2052 scope.go:117] "RemoveContainer" containerID="4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: I0829 18:18:24.014237    2052 scope.go:117] "RemoveContainer" containerID="4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: E0829 18:18:24.014886    2052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91" containerID="4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: I0829 18:18:24.014923    2052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91"} err="failed to get container status \"4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91\": rpc error: code = Unknown desc = Error response from daemon: No such container: 4410a5c85d11aaa66dab3ce8719bc84b984886aa1a5db38526650bb5f37bbb91"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: I0829 18:18:24.014936    2052 scope.go:117] "RemoveContainer" containerID="497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: I0829 18:18:24.022182    2052 scope.go:117] "RemoveContainer" containerID="497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: E0829 18:18:24.022705    2052 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba" containerID="497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba"

	Aug 29 18:18:24 addons-048000 kubelet[2052]: I0829 18:18:24.022737    2052 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba"} err="failed to get container status \"497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba\": rpc error: code = Unknown desc = Error response from daemon: No such container: 497714a41c5098db7e2fd992481b124d9fcfa1a57ae48885260e7f70cb63aeba"

	==> storage-provisioner [46c9aa4000fa] <==

	I0829 18:05:55.321253       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0829 18:05:55.343403       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0829 18:05:55.355614       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0829 18:05:55.363917       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0829 18:05:55.364025       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-048000_c151fe5c-7fa1-4993-b236-8ae5854b1917!

	I0829 18:05:55.364526       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1abe05d6-1897-48b6-830c-17212181446e", APIVersion:"v1", ResourceVersion:"474", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-048000_c151fe5c-7fa1-4993-b236-8ae5854b1917 became leader

	I0829 18:05:55.464513       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-048000_c151fe5c-7fa1-4993-b236-8ae5854b1917!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-048000 -n addons-048000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-048000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-mlsl6 ingress-nginx-admission-patch-d8mvk

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-048000 describe pod busybox ingress-nginx-admission-create-mlsl6 ingress-nginx-admission-patch-d8mvk

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-048000 describe pod busybox ingress-nginx-admission-create-mlsl6 ingress-nginx-admission-patch-d8mvk: exit status 1 (41.844584ms)

-- stdout --

	Name:             busybox

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-048000/192.168.105.2

	Start Time:       Thu, 29 Aug 2024 11:09:10 -0700

	Labels:           integration-test=busybox

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.27

	IPs:

	  IP:  10.244.0.27

	Containers:

	  busybox:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      sleep

	      3600

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-f454t (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   True 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  kube-api-access-f454t:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  9m14s                  default-scheduler  Successfully assigned default/busybox to addons-048000

	  Normal   Pulling    7m50s (x4 over 9m13s)  kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Warning  Failed     7m49s (x4 over 9m13s)  kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed

	  Warning  Failed     7m49s (x4 over 9m13s)  kubelet            Error: ErrImagePull

	  Warning  Failed     7m24s (x6 over 9m12s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m9s (x20 over 9m12s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-mlsl6" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-d8mvk" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-048000 describe pod busybox ingress-nginx-admission-create-mlsl6 ingress-nginx-admission-patch-d8mvk: exit status 1

--- FAIL: TestAddons/parallel/Registry (72.30s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-272000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-272000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.850616209s)

-- stdout --

	* [cert-options-272000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-272000" primary control-plane node in "cert-options-272000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-272000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-272000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-272000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-272000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-272000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (78.964208ms)

-- stdout --

	* The control-plane node cert-options-272000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-272000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-272000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-272000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-272000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-272000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (40.141833ms)

-- stdout --

	* The control-plane node cert-options-272000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-272000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-272000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-272000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-272000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-08-29 12:04:28.644386 -0700 PDT m=+3593.601817376

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-272000 -n cert-options-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-272000 -n cert-options-272000: exit status 7 (29.744417ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-272000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-272000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-272000

--- FAIL: TestCertOptions (10.12s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (10.232617208s)

-- stdout --

	* [cert-expiration-916000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-916000" primary control-plane node in "cert-expiration-916000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-916000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-916000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.246618708s)

-- stdout --

	* [cert-expiration-916000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-916000" primary control-plane node in "cert-expiration-916000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-916000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-916000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-916000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-916000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-916000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-916000" primary control-plane node in "cert-expiration-916000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-916000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-916000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-916000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-08-29 12:07:18.464463 -0700 PDT m=+3763.449203626

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-916000 -n cert-expiration-916000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-916000 -n cert-expiration-916000: exit status 7 (67.422541ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-916000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-916000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-916000

--- FAIL: TestCertExpiration (195.63s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-830000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-830000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.94556525s)

-- stdout --

	* [docker-flags-830000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-830000" primary control-plane node in "docker-flags-830000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-830000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 12:04:08.484746    4866 out.go:345] Setting OutFile to fd 1 ...

	I0829 12:04:08.484885    4866 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:04:08.484889    4866 out.go:358] Setting ErrFile to fd 2...

	I0829 12:04:08.484891    4866 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:04:08.485017    4866 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 12:04:08.486094    4866 out.go:352] Setting JSON to false

	I0829 12:04:08.501993    4866 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3812,"bootTime":1724954436,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 12:04:08.502055    4866 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 12:04:08.505697    4866 out.go:177] * [docker-flags-830000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 12:04:08.512673    4866 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 12:04:08.512749    4866 notify.go:220] Checking for updates...

	I0829 12:04:08.519685    4866 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 12:04:08.522781    4866 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 12:04:08.525633    4866 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 12:04:08.528642    4866 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 12:04:08.531697    4866 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 12:04:08.533428    4866 config.go:182] Loaded profile config "cert-expiration-916000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 12:04:08.533510    4866 config.go:182] Loaded profile config "multinode-531000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 12:04:08.533566    4866 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 12:04:08.537682    4866 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 12:04:08.544506    4866 start.go:297] selected driver: qemu2

	I0829 12:04:08.544515    4866 start.go:901] validating driver "qemu2" against <nil>

	I0829 12:04:08.544539    4866 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 12:04:08.546937    4866 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 12:04:08.549735    4866 out.go:177] * Automatically selected the socket_vmnet network

	I0829 12:04:08.552765    4866 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0829 12:04:08.552795    4866 cni.go:84] Creating CNI manager for ""

	I0829 12:04:08.552806    4866 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 12:04:08.552812    4866 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0829 12:04:08.552855    4866 start.go:340] cluster config:

	{Name:docker-flags-830000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-830000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn

etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 12:04:08.556750    4866 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 12:04:08.564682    4866 out.go:177] * Starting "docker-flags-830000" primary control-plane node in "docker-flags-830000" cluster

	I0829 12:04:08.568627    4866 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 12:04:08.568642    4866 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 12:04:08.568652    4866 cache.go:56] Caching tarball of preloaded images

	I0829 12:04:08.568715    4866 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 12:04:08.568720    4866 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 12:04:08.568782    4866 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/docker-flags-830000/config.json ...

	I0829 12:04:08.568793    4866 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/docker-flags-830000/config.json: {Name:mka890bd510e433bb7d067b13a6fa4e09caa7e35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 12:04:08.569004    4866 start.go:360] acquireMachinesLock for docker-flags-830000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:04:08.569038    4866 start.go:364] duration metric: took 27.75µs to acquireMachinesLock for "docker-flags-830000"

	I0829 12:04:08.569049    4866 start.go:93] Provisioning new machine with config: &{Name:docker-flags-830000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-830000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:04:08.569078    4866 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:04:08.576667    4866 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:04:08.595253    4866 start.go:159] libmachine.API.Create for "docker-flags-830000" (driver="qemu2")

	I0829 12:04:08.595284    4866 client.go:168] LocalClient.Create starting

	I0829 12:04:08.595364    4866 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:04:08.595394    4866 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:08.595405    4866 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:08.595445    4866 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:04:08.595469    4866 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:08.595475    4866 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:08.595831    4866 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:04:08.757525    4866 main.go:141] libmachine: Creating SSH key...

	I0829 12:04:08.811819    4866 main.go:141] libmachine: Creating Disk image...

	I0829 12:04:08.811824    4866 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:04:08.811982    4866 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:08.821369    4866 main.go:141] libmachine: STDOUT: 

	I0829 12:04:08.821385    4866 main.go:141] libmachine: STDERR: 

	I0829 12:04:08.821443    4866 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2 +20000M

	I0829 12:04:08.829420    4866 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:04:08.829439    4866 main.go:141] libmachine: STDERR: 

	I0829 12:04:08.829452    4866 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:08.829458    4866 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:04:08.829467    4866 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:04:08.829496    4866 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:62:1f:7c:dc:60 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:08.831137    4866 main.go:141] libmachine: STDOUT: 

	I0829 12:04:08.831151    4866 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:04:08.831168    4866 client.go:171] duration metric: took 235.881334ms to LocalClient.Create

	I0829 12:04:10.833314    4866 start.go:128] duration metric: took 2.264245667s to createHost

	I0829 12:04:10.833373    4866 start.go:83] releasing machines lock for "docker-flags-830000", held for 2.264358875s

	W0829 12:04:10.833442    4866 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:10.859497    4866 out.go:177] * Deleting "docker-flags-830000" in qemu2 ...

	W0829 12:04:10.886994    4866 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:10.887018    4866 start.go:729] Will try again in 5 seconds ...

	I0829 12:04:15.889202    4866 start.go:360] acquireMachinesLock for docker-flags-830000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:04:15.889738    4866 start.go:364] duration metric: took 422.292µs to acquireMachinesLock for "docker-flags-830000"

	I0829 12:04:15.889880    4866 start.go:93] Provisioning new machine with config: &{Name:docker-flags-830000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-830000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:04:15.890163    4866 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:04:15.899812    4866 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:04:15.953199    4866 start.go:159] libmachine.API.Create for "docker-flags-830000" (driver="qemu2")

	I0829 12:04:15.953244    4866 client.go:168] LocalClient.Create starting

	I0829 12:04:15.953342    4866 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:04:15.953394    4866 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:15.953410    4866 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:15.953476    4866 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:04:15.953508    4866 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:15.953522    4866 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:15.954011    4866 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:04:16.133872    4866 main.go:141] libmachine: Creating SSH key...

	I0829 12:04:16.330520    4866 main.go:141] libmachine: Creating Disk image...

	I0829 12:04:16.330527    4866 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:04:16.330718    4866 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:16.340275    4866 main.go:141] libmachine: STDOUT: 

	I0829 12:04:16.340304    4866 main.go:141] libmachine: STDERR: 

	I0829 12:04:16.340350    4866 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2 +20000M

	I0829 12:04:16.348416    4866 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:04:16.348433    4866 main.go:141] libmachine: STDERR: 

	I0829 12:04:16.348442    4866 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:16.348446    4866 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:04:16.348458    4866 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:04:16.348494    4866 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b2:d5:11:ad:cc:27 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/docker-flags-830000/disk.qcow2

	I0829 12:04:16.350097    4866 main.go:141] libmachine: STDOUT: 

	I0829 12:04:16.350111    4866 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:04:16.350123    4866 client.go:171] duration metric: took 396.879833ms to LocalClient.Create

	I0829 12:04:18.352312    4866 start.go:128] duration metric: took 2.462144083s to createHost

	I0829 12:04:18.352397    4866 start.go:83] releasing machines lock for "docker-flags-830000", held for 2.462669708s

	W0829 12:04:18.352808    4866 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-830000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-830000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:18.367404    4866 out.go:201] 

	W0829 12:04:18.370573    4866 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 12:04:18.370605    4866 out.go:270] * 

	* 

	W0829 12:04:18.373153    4866 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 12:04:18.388515    4866 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-830000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-830000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-830000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (79.980083ms)

-- stdout --

	* The control-plane node docker-flags-830000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-830000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-830000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-830000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-830000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-830000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-830000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-830000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-830000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (45.088583ms)

-- stdout --

	* The control-plane node docker-flags-830000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-830000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-830000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-830000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-830000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-830000\"\n"

panic.go:626: *** TestDockerFlags FAILED at 2024-08-29 12:04:18.529635 -0700 PDT m=+3583.486920960

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-830000 -n docker-flags-830000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-830000 -n docker-flags-830000: exit status 7 (30.397667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-830000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-830000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-830000

--- FAIL: TestDockerFlags (10.18s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-855000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-855000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.96095625s)

-- stdout --

	* [force-systemd-flag-855000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-855000" primary control-plane node in "force-systemd-flag-855000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-855000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 12:03:38.998624    4719 out.go:345] Setting OutFile to fd 1 ...

	I0829 12:03:38.998764    4719 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:03:38.998767    4719 out.go:358] Setting ErrFile to fd 2...

	I0829 12:03:38.998769    4719 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:03:38.998907    4719 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 12:03:39.000027    4719 out.go:352] Setting JSON to false

	I0829 12:03:39.016255    4719 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3783,"bootTime":1724954436,"procs":480,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 12:03:39.016325    4719 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 12:03:39.019882    4719 out.go:177] * [force-systemd-flag-855000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 12:03:39.027836    4719 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 12:03:39.027889    4719 notify.go:220] Checking for updates...

	I0829 12:03:39.035684    4719 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 12:03:39.039760    4719 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 12:03:39.042860    4719 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 12:03:39.046718    4719 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 12:03:39.049771    4719 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 12:03:39.053135    4719 config.go:182] Loaded profile config "NoKubernetes-185000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v0.0.0

	I0829 12:03:39.053203    4719 config.go:182] Loaded profile config "multinode-531000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 12:03:39.053247    4719 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 12:03:39.057740    4719 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 12:03:39.064776    4719 start.go:297] selected driver: qemu2

	I0829 12:03:39.064782    4719 start.go:901] validating driver "qemu2" against <nil>

	I0829 12:03:39.064788    4719 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 12:03:39.067204    4719 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 12:03:39.069840    4719 out.go:177] * Automatically selected the socket_vmnet network

	I0829 12:03:39.072831    4719 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0829 12:03:39.072846    4719 cni.go:84] Creating CNI manager for ""

	I0829 12:03:39.072853    4719 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 12:03:39.072857    4719 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0829 12:03:39.072884    4719 start.go:340] cluster config:

	{Name:force-systemd-flag-855000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-855000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static

IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 12:03:39.076588    4719 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 12:03:39.083792    4719 out.go:177] * Starting "force-systemd-flag-855000" primary control-plane node in "force-systemd-flag-855000" cluster

	I0829 12:03:39.087849    4719 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 12:03:39.087867    4719 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 12:03:39.087878    4719 cache.go:56] Caching tarball of preloaded images

	I0829 12:03:39.087953    4719 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 12:03:39.087960    4719 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 12:03:39.088026    4719 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/force-systemd-flag-855000/config.json ...

	I0829 12:03:39.088044    4719 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/force-systemd-flag-855000/config.json: {Name:mk79df731930b488aa8c0d92b2c8b2def51d8a0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 12:03:39.088276    4719 start.go:360] acquireMachinesLock for force-systemd-flag-855000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:03:39.088313    4719 start.go:364] duration metric: took 30.125µs to acquireMachinesLock for "force-systemd-flag-855000"

	I0829 12:03:39.088325    4719 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-855000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-855000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:03:39.088354    4719 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:03:39.096784    4719 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:03:39.115450    4719 start.go:159] libmachine.API.Create for "force-systemd-flag-855000" (driver="qemu2")

	I0829 12:03:39.115479    4719 client.go:168] LocalClient.Create starting

	I0829 12:03:39.115545    4719 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:03:39.115576    4719 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:39.115586    4719 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:39.115630    4719 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:03:39.115654    4719 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:39.115663    4719 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:39.116024    4719 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:03:39.299275    4719 main.go:141] libmachine: Creating SSH key...

	I0829 12:03:39.383609    4719 main.go:141] libmachine: Creating Disk image...

	I0829 12:03:39.383614    4719 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:03:39.383803    4719 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:39.393112    4719 main.go:141] libmachine: STDOUT: 

	I0829 12:03:39.393126    4719 main.go:141] libmachine: STDERR: 

	I0829 12:03:39.393175    4719 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2 +20000M

	I0829 12:03:39.401096    4719 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:03:39.401111    4719 main.go:141] libmachine: STDERR: 

	I0829 12:03:39.401131    4719 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:39.401138    4719 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:03:39.401153    4719 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:03:39.401184    4719 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:41:dc:e9:bb:44 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:39.402791    4719 main.go:141] libmachine: STDOUT: 

	I0829 12:03:39.402808    4719 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:03:39.402828    4719 client.go:171] duration metric: took 287.347792ms to LocalClient.Create

	I0829 12:03:41.405006    4719 start.go:128] duration metric: took 2.316663s to createHost

	I0829 12:03:41.405055    4719 start.go:83] releasing machines lock for "force-systemd-flag-855000", held for 2.31676675s

	W0829 12:03:41.405104    4719 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:03:41.421246    4719 out.go:177] * Deleting "force-systemd-flag-855000" in qemu2 ...

	W0829 12:03:41.453228    4719 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:03:41.453257    4719 start.go:729] Will try again in 5 seconds ...

	I0829 12:03:46.455411    4719 start.go:360] acquireMachinesLock for force-systemd-flag-855000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:03:46.455817    4719 start.go:364] duration metric: took 315.75µs to acquireMachinesLock for "force-systemd-flag-855000"

	I0829 12:03:46.455945    4719 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-855000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-855000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:03:46.456268    4719 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:03:46.460942    4719 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:03:46.512103    4719 start.go:159] libmachine.API.Create for "force-systemd-flag-855000" (driver="qemu2")

	I0829 12:03:46.512156    4719 client.go:168] LocalClient.Create starting

	I0829 12:03:46.512279    4719 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:03:46.512360    4719 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:46.512379    4719 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:46.512444    4719 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:03:46.512493    4719 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:46.512509    4719 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:46.513136    4719 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:03:46.685358    4719 main.go:141] libmachine: Creating SSH key...

	I0829 12:03:46.852480    4719 main.go:141] libmachine: Creating Disk image...

	I0829 12:03:46.852488    4719 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:03:46.852692    4719 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:46.862554    4719 main.go:141] libmachine: STDOUT: 

	I0829 12:03:46.862580    4719 main.go:141] libmachine: STDERR: 

	I0829 12:03:46.862633    4719 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2 +20000M

	I0829 12:03:46.870696    4719 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:03:46.870714    4719 main.go:141] libmachine: STDERR: 

	I0829 12:03:46.870729    4719 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:46.870746    4719 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:03:46.870758    4719 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:03:46.870787    4719 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b2:e5:c6:68:24:32 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-flag-855000/disk.qcow2

	I0829 12:03:46.872387    4719 main.go:141] libmachine: STDOUT: 

	I0829 12:03:46.872408    4719 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:03:46.872419    4719 client.go:171] duration metric: took 360.261417ms to LocalClient.Create

	I0829 12:03:48.874609    4719 start.go:128] duration metric: took 2.418337s to createHost

	I0829 12:03:48.874746    4719 start.go:83] releasing machines lock for "force-systemd-flag-855000", held for 2.418875625s

	W0829 12:03:48.875084    4719 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-855000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-855000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:03:48.891825    4719 out.go:201] 

	W0829 12:03:48.895814    4719 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 12:03:48.895842    4719 out.go:270] * 

	* 

	W0829 12:03:48.899101    4719 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 12:03:48.912888    4719 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-855000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-855000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-855000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (87.209375ms)

-- stdout --

	* The control-plane node force-systemd-flag-855000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-855000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-855000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-08-29 12:03:49.021329 -0700 PDT m=+3553.978190293

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-855000 -n force-systemd-flag-855000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-855000 -n force-systemd-flag-855000: exit status 7 (34.93ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-855000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-855000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-855000

--- FAIL: TestForceSystemdFlag (10.17s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-088000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-088000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.064633458s)

-- stdout --

	* [force-systemd-env-088000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-088000" primary control-plane node in "force-systemd-env-088000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-088000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 12:03:58.215430    4820 out.go:345] Setting OutFile to fd 1 ...

	I0829 12:03:58.215559    4820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:03:58.215562    4820 out.go:358] Setting ErrFile to fd 2...

	I0829 12:03:58.215565    4820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 12:03:58.215692    4820 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 12:03:58.216761    4820 out.go:352] Setting JSON to false

	I0829 12:03:58.233509    4820 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3802,"bootTime":1724954436,"procs":480,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 12:03:58.233583    4820 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 12:03:58.239360    4820 out.go:177] * [force-systemd-env-088000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 12:03:58.246169    4820 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 12:03:58.246188    4820 notify.go:220] Checking for updates...

	I0829 12:03:58.253158    4820 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 12:03:58.256106    4820 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 12:03:58.259146    4820 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 12:03:58.262144    4820 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 12:03:58.265137    4820 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0829 12:03:58.268502    4820 config.go:182] Loaded profile config "multinode-531000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 12:03:58.268552    4820 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 12:03:58.272074    4820 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 12:03:58.279124    4820 start.go:297] selected driver: qemu2

	I0829 12:03:58.279129    4820 start.go:901] validating driver "qemu2" against <nil>

	I0829 12:03:58.279135    4820 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 12:03:58.281326    4820 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 12:03:58.282525    4820 out.go:177] * Automatically selected the socket_vmnet network

	I0829 12:03:58.285181    4820 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0829 12:03:58.285210    4820 cni.go:84] Creating CNI manager for ""

	I0829 12:03:58.285216    4820 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 12:03:58.285222    4820 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0829 12:03:58.285250    4820 start.go:340] cluster config:

	{Name:force-systemd-env-088000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-088000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l

ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 12:03:58.288728    4820 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 12:03:58.297119    4820 out.go:177] * Starting "force-systemd-env-088000" primary control-plane node in "force-systemd-env-088000" cluster

	I0829 12:03:58.301118    4820 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 12:03:58.301131    4820 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 12:03:58.301138    4820 cache.go:56] Caching tarball of preloaded images

	I0829 12:03:58.301186    4820 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 12:03:58.301191    4820 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 12:03:58.301247    4820 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/force-systemd-env-088000/config.json ...

	I0829 12:03:58.301259    4820 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/force-systemd-env-088000/config.json: {Name:mkff8153bc6e5b99e10574b52cb87fe67b3fba86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 12:03:58.301461    4820 start.go:360] acquireMachinesLock for force-systemd-env-088000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:03:58.301491    4820 start.go:364] duration metric: took 24.167µs to acquireMachinesLock for "force-systemd-env-088000"

	I0829 12:03:58.301502    4820 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-088000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-088000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:03:58.301531    4820 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:03:58.309099    4820 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:03:58.326305    4820 start.go:159] libmachine.API.Create for "force-systemd-env-088000" (driver="qemu2")

	I0829 12:03:58.326333    4820 client.go:168] LocalClient.Create starting

	I0829 12:03:58.326396    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:03:58.326424    4820 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:58.326434    4820 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:58.326468    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:03:58.326491    4820 main.go:141] libmachine: Decoding PEM data...

	I0829 12:03:58.326499    4820 main.go:141] libmachine: Parsing certificate...

	I0829 12:03:58.326876    4820 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:03:58.510359    4820 main.go:141] libmachine: Creating SSH key...

	I0829 12:03:58.629243    4820 main.go:141] libmachine: Creating Disk image...

	I0829 12:03:58.629256    4820 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:03:58.629472    4820 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:03:58.639302    4820 main.go:141] libmachine: STDOUT: 

	I0829 12:03:58.639325    4820 main.go:141] libmachine: STDERR: 

	I0829 12:03:58.639375    4820 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2 +20000M

	I0829 12:03:58.647651    4820 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:03:58.647669    4820 main.go:141] libmachine: STDERR: 

	I0829 12:03:58.647680    4820 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:03:58.647686    4820 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:03:58.647698    4820 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:03:58.647746    4820 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5a:ae:a4:a4:c6:ff -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:03:58.649394    4820 main.go:141] libmachine: STDOUT: 

	I0829 12:03:58.649415    4820 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:03:58.649438    4820 client.go:171] duration metric: took 323.102416ms to LocalClient.Create

	I0829 12:04:00.651739    4820 start.go:128] duration metric: took 2.350191834s to createHost

	I0829 12:04:00.651878    4820 start.go:83] releasing machines lock for "force-systemd-env-088000", held for 2.350410166s

	W0829 12:04:00.651935    4820 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:00.663308    4820 out.go:177] * Deleting "force-systemd-env-088000" in qemu2 ...

	W0829 12:04:00.697156    4820 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:00.697190    4820 start.go:729] Will try again in 5 seconds ...

	I0829 12:04:05.699292    4820 start.go:360] acquireMachinesLock for force-systemd-env-088000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 12:04:05.699743    4820 start.go:364] duration metric: took 365.625µs to acquireMachinesLock for "force-systemd-env-088000"

	I0829 12:04:05.699916    4820 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-088000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-088000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 12:04:05.700246    4820 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 12:04:05.709666    4820 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0829 12:04:05.760521    4820 start.go:159] libmachine.API.Create for "force-systemd-env-088000" (driver="qemu2")

	I0829 12:04:05.760572    4820 client.go:168] LocalClient.Create starting

	I0829 12:04:05.760697    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 12:04:05.760776    4820 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:05.760794    4820 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:05.760866    4820 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 12:04:05.760911    4820 main.go:141] libmachine: Decoding PEM data...

	I0829 12:04:05.760934    4820 main.go:141] libmachine: Parsing certificate...

	I0829 12:04:05.761521    4820 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 12:04:05.942230    4820 main.go:141] libmachine: Creating SSH key...

	I0829 12:04:06.178628    4820 main.go:141] libmachine: Creating Disk image...

	I0829 12:04:06.178637    4820 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 12:04:06.178891    4820 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:04:06.188757    4820 main.go:141] libmachine: STDOUT: 

	I0829 12:04:06.188782    4820 main.go:141] libmachine: STDERR: 

	I0829 12:04:06.188831    4820 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2 +20000M

	I0829 12:04:06.197121    4820 main.go:141] libmachine: STDOUT: Image resized.

	I0829 12:04:06.197138    4820 main.go:141] libmachine: STDERR: 

	I0829 12:04:06.197156    4820 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:04:06.197161    4820 main.go:141] libmachine: Starting QEMU VM...

	I0829 12:04:06.197170    4820 qemu.go:418] Using hvf for hardware acceleration

	I0829 12:04:06.197198    4820 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:47:9c:00:d0:3b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/force-systemd-env-088000/disk.qcow2

	I0829 12:04:06.198819    4820 main.go:141] libmachine: STDOUT: 

	I0829 12:04:06.198836    4820 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 12:04:06.198850    4820 client.go:171] duration metric: took 438.279833ms to LocalClient.Create

	I0829 12:04:08.201012    4820 start.go:128] duration metric: took 2.500767208s to createHost

	I0829 12:04:08.201075    4820 start.go:83] releasing machines lock for "force-systemd-env-088000", held for 2.50134225s

	W0829 12:04:08.201480    4820 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-088000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-088000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 12:04:08.211067    4820 out.go:201] 

	W0829 12:04:08.221297    4820 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 12:04:08.221379    4820 out.go:270] * 

	* 

	W0829 12:04:08.224247    4820 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 12:04:08.234047    4820 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-088000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-088000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-088000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (76.991042ms)

-- stdout --

	* The control-plane node force-systemd-env-088000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-088000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-088000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-08-29 12:04:08.328819 -0700 PDT m=+3573.285958001

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-088000 -n force-systemd-env-088000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-088000 -n force-systemd-env-088000: exit status 7 (32.820583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-088000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-088000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-088000

--- FAIL: TestForceSystemdEnv (10.27s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-312000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-312000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-65d86f57f4-zx8nc" [e04f2ba0-f5ea-43c6-8d83-acd4d77ecd75] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

E0829 11:23:32.584156    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.592444    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.604016    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.627352    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.670694    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.754063    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:32.917503    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:23:33.240965    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:344: "hello-node-connect-65d86f57f4-zx8nc" [e04f2ba0-f5ea-43c6-8d83-acd4d77ecd75] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 8.008354083s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-312000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:31418

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

E0829 11:23:42.853738    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:31418: Get "http://192.168.105.4:31418": dial tcp 192.168.105.4:31418: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-312000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-zx8nc

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-312000/192.168.105.4

Start Time:       Thu, 29 Aug 2024 11:23:31 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.8

IPs:

IP:           10.244.0.8

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://0650380888a9de102cd52e0446d3e56910d86dfb91e33ee9c1c3a25938ee9bf1

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Terminated

Reason:       Error

Exit Code:    1

Started:      Thu, 29 Aug 2024 11:23:47 -0700

Finished:     Thu, 29 Aug 2024 11:23:47 -0700

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Thu, 29 Aug 2024 11:23:32 -0700

Finished:     Thu, 29 Aug 2024 11:23:32 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fgjgr (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-fgjgr:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  28s                default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-zx8nc to functional-312000

Normal   Pulled     12s (x3 over 27s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Normal   Created    12s (x3 over 27s)  kubelet            Created container echoserver-arm

Normal   Started    12s (x3 over 27s)  kubelet            Started container echoserver-arm

Warning  BackOff    11s (x2 over 26s)  kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-zx8nc_default(e04f2ba0-f5ea-43c6-8d83-acd4d77ecd75)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-312000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-312000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.111.70.57

IPs:                      10.111.70.57

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  31418/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-312000 -n functional-312000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-312000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                                                      Args                                                       |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| image   | functional-312000 image ls                                                                                      | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	| image   | functional-312000 image save                                                                                    | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | kicbase/echo-server:functional-312000                                                                           |                   |         |         |                     |                     |

	|         | /Users/jenkins/workspace/echo-server-save.tar                                                                   |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-312000 image rm                                                                                      | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | kicbase/echo-server:functional-312000                                                                           |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-312000 image ls                                                                                      | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	| image   | functional-312000 image load                                                                                    | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | /Users/jenkins/workspace/echo-server-save.tar                                                                   |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-312000 image ls                                                                                      | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	| image   | functional-312000 image save --daemon                                                                           | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | kicbase/echo-server:functional-312000                                                                           |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh echo                                                                                      | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | hello                                                                                                           |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh cat                                                                                       | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | /etc/hostname                                                                                                   |                   |         |         |                     |                     |

	| tunnel  | functional-312000 tunnel                                                                                        | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| tunnel  | functional-312000 tunnel                                                                                        | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| tunnel  | functional-312000 tunnel                                                                                        | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| service | functional-312000 service list                                                                                  | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	| service | functional-312000 service list                                                                                  | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-312000 service                                                                                       | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | --namespace=default --https                                                                                     |                   |         |         |                     |                     |

	|         | --url hello-node                                                                                                |                   |         |         |                     |                     |

	| service | functional-312000                                                                                               | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | service hello-node --url                                                                                        |                   |         |         |                     |                     |

	|         | --format={{.IP}}                                                                                                |                   |         |         |                     |                     |

	| service | functional-312000 service                                                                                       | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | hello-node --url                                                                                                |                   |         |         |                     |                     |

	| addons  | functional-312000 addons list                                                                                   | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	| addons  | functional-312000 addons list                                                                                   | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-312000 service                                                                                       | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | hello-node-connect --url                                                                                        |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh findmnt                                                                                   | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT |                     |

	|         | -T /mount-9p | grep 9p                                                                                          |                   |         |         |                     |                     |

	| mount   | -p functional-312000                                                                                            | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT |                     |

	|         | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port1417900404/001:/mount-9p |                   |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh findmnt                                                                                   | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | -T /mount-9p | grep 9p                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh -- ls                                                                                     | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | -la /mount-9p                                                                                                   |                   |         |         |                     |                     |

	| ssh     | functional-312000 ssh cat                                                                                       | functional-312000 | jenkins | v1.33.1 | 29 Aug 24 11:23 PDT | 29 Aug 24 11:23 PDT |

	|         | /mount-9p/test-1724955835901787000                                                                              |                   |         |         |                     |                     |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/29 11:22:35

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0829 11:22:35.736753    2025 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:22:35.736866    2025 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:22:35.736868    2025 out.go:358] Setting ErrFile to fd 2...

	I0829 11:22:35.736869    2025 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:22:35.736978    2025 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:22:35.738016    2025 out.go:352] Setting JSON to false

	I0829 11:22:35.753985    2025 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1319,"bootTime":1724954436,"procs":462,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:22:35.754043    2025 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:22:35.759502    2025 out.go:177] * [functional-312000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:22:35.768521    2025 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:22:35.768604    2025 notify.go:220] Checking for updates...

	I0829 11:22:35.775506    2025 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:22:35.778506    2025 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:22:35.781497    2025 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:22:35.784543    2025 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:22:35.787430    2025 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:22:35.790766    2025 config.go:182] Loaded profile config "functional-312000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:22:35.790814    2025 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:22:35.795536    2025 out.go:177] * Using the qemu2 driver based on existing profile

	I0829 11:22:35.802490    2025 start.go:297] selected driver: qemu2

	I0829 11:22:35.802494    2025 start.go:901] validating driver "qemu2" against &{Name:functional-312000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub

ernetesVersion:v1.31.0 ClusterName:functional-312000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:22:35.802543    2025 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:22:35.804731    2025 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:22:35.804773    2025 cni.go:84] Creating CNI manager for ""

	I0829 11:22:35.804780    2025 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:22:35.804825    2025 start.go:340] cluster config:

	{Name:functional-312000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-312000 Namespace:default APIServe

rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:22:35.808290    2025 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:22:35.814476    2025 out.go:177] * Starting "functional-312000" primary control-plane node in "functional-312000" cluster

	I0829 11:22:35.818516    2025 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:22:35.818526    2025 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:22:35.818532    2025 cache.go:56] Caching tarball of preloaded images

	I0829 11:22:35.818581    2025 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:22:35.818585    2025 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:22:35.818627    2025 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/config.json ...

	I0829 11:22:35.819048    2025 start.go:360] acquireMachinesLock for functional-312000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:22:35.819077    2025 start.go:364] duration metric: took 25.542µs to acquireMachinesLock for "functional-312000"

	I0829 11:22:35.819088    2025 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:22:35.819092    2025 fix.go:54] fixHost starting: 

	I0829 11:22:35.819650    2025 fix.go:112] recreateIfNeeded on functional-312000: state=Running err=<nil>

	W0829 11:22:35.819655    2025 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:22:35.824494    2025 out.go:177] * Updating the running qemu2 "functional-312000" VM ...

	I0829 11:22:35.832346    2025 machine.go:93] provisionDockerMachine start ...

	I0829 11:22:35.832380    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:35.832497    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:35.832500    2025 main.go:141] libmachine: About to run SSH command:

	hostname

	I0829 11:22:35.886809    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-312000

	I0829 11:22:35.886820    2025 buildroot.go:166] provisioning hostname "functional-312000"

	I0829 11:22:35.886862    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:35.886984    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:35.886987    2025 main.go:141] libmachine: About to run SSH command:

	sudo hostname functional-312000 && echo "functional-312000" | sudo tee /etc/hostname

	I0829 11:22:35.945242    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-312000

	I0829 11:22:35.945294    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:35.945414    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:35.945420    2025 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-312000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-312000/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-312000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0829 11:22:36.010936    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0829 11:22:36.010945    2025 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19531-965/.minikube CaCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19531-965/.minikube}

	I0829 11:22:36.010952    2025 buildroot.go:174] setting up certificates

	I0829 11:22:36.010956    2025 provision.go:84] configureAuth start

	I0829 11:22:36.010964    2025 provision.go:143] copyHostCerts

	I0829 11:22:36.011069    2025 exec_runner.go:144] found /Users/jenkins/minikube-integration/19531-965/.minikube/ca.pem, removing ...

	I0829 11:22:36.011074    2025 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19531-965/.minikube/ca.pem

	I0829 11:22:36.011207    2025 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/ca.pem (1082 bytes)

	I0829 11:22:36.011379    2025 exec_runner.go:144] found /Users/jenkins/minikube-integration/19531-965/.minikube/cert.pem, removing ...

	I0829 11:22:36.011380    2025 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19531-965/.minikube/cert.pem

	I0829 11:22:36.011431    2025 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/cert.pem (1123 bytes)

	I0829 11:22:36.011537    2025 exec_runner.go:144] found /Users/jenkins/minikube-integration/19531-965/.minikube/key.pem, removing ...

	I0829 11:22:36.011538    2025 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19531-965/.minikube/key.pem

	I0829 11:22:36.011582    2025 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19531-965/.minikube/key.pem (1675 bytes)

	I0829 11:22:36.011660    2025 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem org=jenkins.functional-312000 san=[127.0.0.1 192.168.105.4 functional-312000 localhost minikube]

	I0829 11:22:36.131264    2025 provision.go:177] copyRemoteCerts

	I0829 11:22:36.131304    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0829 11:22:36.131311    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:22:36.161383    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0829 11:22:36.169848    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0829 11:22:36.177950    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)

	I0829 11:22:36.186011    2025 provision.go:87] duration metric: took 175.052083ms to configureAuth

	I0829 11:22:36.186017    2025 buildroot.go:189] setting minikube options for container-runtime

	I0829 11:22:36.186112    2025 config.go:182] Loaded profile config "functional-312000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:22:36.186159    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:36.186252    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:36.186254    2025 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0829 11:22:36.244097    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0829 11:22:36.244105    2025 buildroot.go:70] root file system type: tmpfs

	I0829 11:22:36.244160    2025 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0829 11:22:36.244223    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:36.244336    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:36.244367    2025 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0829 11:22:36.303665    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0829 11:22:36.303711    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:36.303821    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:36.303827    2025 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0829 11:22:36.360120    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0829 11:22:36.360127    2025 machine.go:96] duration metric: took 527.781625ms to provisionDockerMachine

	I0829 11:22:36.360131    2025 start.go:293] postStartSetup for "functional-312000" (driver="qemu2")

	I0829 11:22:36.360136    2025 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0829 11:22:36.360181    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0829 11:22:36.360188    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:22:36.390233    2025 ssh_runner.go:195] Run: cat /etc/os-release

	I0829 11:22:36.391742    2025 info.go:137] Remote host: Buildroot 2023.02.9

	I0829 11:22:36.391747    2025 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19531-965/.minikube/addons for local assets ...

	I0829 11:22:36.391832    2025 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19531-965/.minikube/files for local assets ...

	I0829 11:22:36.391958    2025 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/ssl/certs/14182.pem -> 14182.pem in /etc/ssl/certs

	I0829 11:22:36.392073    2025 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/test/nested/copy/1418/hosts -> hosts in /etc/test/nested/copy/1418

	I0829 11:22:36.392107    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/1418

	I0829 11:22:36.395310    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/ssl/certs/14182.pem --> /etc/ssl/certs/14182.pem (1708 bytes)

	I0829 11:22:36.402785    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/test/nested/copy/1418/hosts --> /etc/test/nested/copy/1418/hosts (40 bytes)

	I0829 11:22:36.410886    2025 start.go:296] duration metric: took 50.750875ms for postStartSetup

	I0829 11:22:36.410897    2025 fix.go:56] duration metric: took 591.811625ms for fixHost

	I0829 11:22:36.410932    2025 main.go:141] libmachine: Using SSH client type: native

	I0829 11:22:36.411034    2025 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100c685a0] 0x100c6ae00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0829 11:22:36.411036    2025 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0829 11:22:36.468144    2025 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724955756.458871192

	I0829 11:22:36.468150    2025 fix.go:216] guest clock: 1724955756.458871192

	I0829 11:22:36.468153    2025 fix.go:229] Guest: 2024-08-29 11:22:36.458871192 -0700 PDT Remote: 2024-08-29 11:22:36.410898 -0700 PDT m=+0.693424084 (delta=47.973192ms)

	I0829 11:22:36.468163    2025 fix.go:200] guest clock delta is within tolerance: 47.973192ms

	I0829 11:22:36.468165    2025 start.go:83] releasing machines lock for "functional-312000", held for 649.090833ms

	I0829 11:22:36.468493    2025 ssh_runner.go:195] Run: cat /version.json

	I0829 11:22:36.468500    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:22:36.468525    2025 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0829 11:22:36.468542    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:22:36.539340    2025 ssh_runner.go:195] Run: systemctl --version

	I0829 11:22:36.541610    2025 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0829 11:22:36.543519    2025 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0829 11:22:36.543541    2025 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0829 11:22:36.547094    2025 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I0829 11:22:36.547100    2025 start.go:495] detecting cgroup driver to use...

	I0829 11:22:36.547164    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0829 11:22:36.553726    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0829 11:22:36.557686    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0829 11:22:36.561580    2025 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0829 11:22:36.561604    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0829 11:22:36.565491    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0829 11:22:36.569565    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0829 11:22:36.573558    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0829 11:22:36.577425    2025 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0829 11:22:36.581259    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0829 11:22:36.585215    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0829 11:22:36.589009    2025 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0829 11:22:36.592815    2025 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0829 11:22:36.596474    2025 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0829 11:22:36.599990    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:22:36.694279    2025 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0829 11:22:36.701614    2025 start.go:495] detecting cgroup driver to use...

	I0829 11:22:36.701669    2025 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0829 11:22:36.710260    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0829 11:22:36.716248    2025 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0829 11:22:36.724476    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0829 11:22:36.730064    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0829 11:22:36.735590    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0829 11:22:36.742091    2025 ssh_runner.go:195] Run: which cri-dockerd

	I0829 11:22:36.743682    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0829 11:22:36.746879    2025 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0829 11:22:36.752914    2025 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0829 11:22:36.847518    2025 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0829 11:22:36.942354    2025 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0829 11:22:36.942411    2025 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0829 11:22:36.949007    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:22:37.042004    2025 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0829 11:22:49.441765    2025 ssh_runner.go:235] Completed: sudo systemctl restart docker: (12.399860542s)

	I0829 11:22:49.441831    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0829 11:22:49.448299    2025 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0829 11:22:49.456442    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0829 11:22:49.463023    2025 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0829 11:22:49.538075    2025 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0829 11:22:49.609827    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:22:49.681273    2025 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0829 11:22:49.688334    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0829 11:22:49.694382    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:22:49.783679    2025 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0829 11:22:49.820633    2025 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0829 11:22:49.820723    2025 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0829 11:22:49.823064    2025 start.go:563] Will wait 60s for crictl version

	I0829 11:22:49.823107    2025 ssh_runner.go:195] Run: which crictl

	I0829 11:22:49.824537    2025 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0829 11:22:49.837151    2025 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.1.2

	RuntimeApiVersion:  v1

	I0829 11:22:49.837220    2025 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0829 11:22:49.844791    2025 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0829 11:22:49.859243    2025 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.1.2 ...

	I0829 11:22:49.859321    2025 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0829 11:22:49.864145    2025 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0829 11:22:49.868163    2025 kubeadm.go:883] updating cluster {Name:functional-312000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.31.0 ClusterName:functional-312000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M

ount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0829 11:22:49.868231    2025 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:22:49.868287    2025 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0829 11:22:49.874291    2025 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-312000

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I0829 11:22:49.874296    2025 docker.go:615] Images already preloaded, skipping extraction

	I0829 11:22:49.874343    2025 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0829 11:22:49.879706    2025 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-312000

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I0829 11:22:49.879712    2025 cache_images.go:84] Images are preloaded, skipping loading

	I0829 11:22:49.879715    2025 kubeadm.go:934] updating node { 192.168.105.4 8441 v1.31.0 docker true true} ...

	I0829 11:22:49.879793    2025 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=functional-312000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.4

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:functional-312000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0829 11:22:49.879837    2025 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0829 11:22:49.896103    2025 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0829 11:22:49.896159    2025 cni.go:84] Creating CNI manager for ""

	I0829 11:22:49.896165    2025 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:22:49.896169    2025 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0829 11:22:49.896177    2025 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.4 APIServerPort:8441 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-312000 NodeName:functional-312000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.4"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.4 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOp

ts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0829 11:22:49.896238    2025 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.4

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "functional-312000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.4

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0829 11:22:49.896301    2025 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0829 11:22:49.900301    2025 binaries.go:44] Found k8s binaries, skipping transfer

	I0829 11:22:49.900331    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0829 11:22:49.903892    2025 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)

	I0829 11:22:49.909872    2025 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0829 11:22:49.915854    2025 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2012 bytes)

	I0829 11:22:49.922044    2025 ssh_runner.go:195] Run: grep 192.168.105.4	control-plane.minikube.internal$ /etc/hosts

	I0829 11:22:49.923550    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:22:49.993343    2025 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0829 11:22:49.998908    2025 certs.go:68] Setting up /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000 for IP: 192.168.105.4

	I0829 11:22:49.998915    2025 certs.go:194] generating shared ca certs ...

	I0829 11:22:49.998930    2025 certs.go:226] acquiring lock for ca certs: {Name:mk29df1c1b696cda1cc19a90487167bb76984cb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:22:49.999086    2025 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key

	I0829 11:22:49.999130    2025 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key

	I0829 11:22:49.999138    2025 certs.go:256] generating profile certs ...

	I0829 11:22:49.999196    2025 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.key

	I0829 11:22:49.999246    2025 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/apiserver.key.65ae9de7

	I0829 11:22:49.999290    2025 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/proxy-client.key

	I0829 11:22:49.999442    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/1418.pem (1338 bytes)

	W0829 11:22:49.999472    2025 certs.go:480] ignoring /Users/jenkins/minikube-integration/19531-965/.minikube/certs/1418_empty.pem, impossibly tiny 0 bytes

	I0829 11:22:49.999476    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca-key.pem (1675 bytes)

	I0829 11:22:49.999496    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem (1082 bytes)

	I0829 11:22:49.999516    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem (1123 bytes)

	I0829 11:22:49.999533    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/certs/key.pem (1675 bytes)

	I0829 11:22:49.999569    2025 certs.go:484] found cert: /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/ssl/certs/14182.pem (1708 bytes)

	I0829 11:22:49.999898    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0829 11:22:50.008683    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0829 11:22:50.016681    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0829 11:22:50.024726    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0829 11:22:50.032788    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0829 11:22:50.040860    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0829 11:22:50.048840    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0829 11:22:50.056757    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0829 11:22:50.064911    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/files/etc/ssl/certs/14182.pem --> /usr/share/ca-certificates/14182.pem (1708 bytes)

	I0829 11:22:50.072749    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0829 11:22:50.081195    2025 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19531-965/.minikube/certs/1418.pem --> /usr/share/ca-certificates/1418.pem (1338 bytes)

	I0829 11:22:50.089424    2025 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0829 11:22:50.095148    2025 ssh_runner.go:195] Run: openssl version

	I0829 11:22:50.097195    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1418.pem && ln -fs /usr/share/ca-certificates/1418.pem /etc/ssl/certs/1418.pem"

	I0829 11:22:50.100975    2025 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1418.pem

	I0829 11:22:50.102435    2025 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 29 18:20 /usr/share/ca-certificates/1418.pem

	I0829 11:22:50.102452    2025 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1418.pem

	I0829 11:22:50.104386    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1418.pem /etc/ssl/certs/51391683.0"

	I0829 11:22:50.108080    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14182.pem && ln -fs /usr/share/ca-certificates/14182.pem /etc/ssl/certs/14182.pem"

	I0829 11:22:50.111955    2025 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14182.pem

	I0829 11:22:50.113574    2025 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 29 18:20 /usr/share/ca-certificates/14182.pem

	I0829 11:22:50.113590    2025 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14182.pem

	I0829 11:22:50.115597    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14182.pem /etc/ssl/certs/3ec20f2e.0"

	I0829 11:22:50.119065    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0829 11:22:50.122682    2025 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:22:50.124342    2025 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 29 18:05 /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:22:50.124362    2025 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0829 11:22:50.126324    2025 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0829 11:22:50.129428    2025 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0829 11:22:50.130870    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0829 11:22:50.132764    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0829 11:22:50.134822    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0829 11:22:50.136832    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0829 11:22:50.138754    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0829 11:22:50.140642    2025 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0829 11:22:50.142585    2025 kubeadm.go:392] StartCluster: {Name:functional-312000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.3

1.0 ClusterName:functional-312000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Moun

t:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:22:50.142660    2025 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0829 11:22:50.148726    2025 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0829 11:22:50.152410    2025 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I0829 11:22:50.152413    2025 kubeadm.go:593] restartPrimaryControlPlane start ...

	I0829 11:22:50.152438    2025 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0829 11:22:50.155908    2025 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0829 11:22:50.156212    2025 kubeconfig.go:125] found "functional-312000" server: "https://192.168.105.4:8441"

	I0829 11:22:50.156829    2025 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0829 11:22:50.160220    2025 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml

	+++ /var/tmp/minikube/kubeadm.yaml.new

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0829 11:22:50.160224    2025 kubeadm.go:1160] stopping kube-system containers ...

	I0829 11:22:50.160260    2025 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0829 11:22:50.167180    2025 docker.go:483] Stopping containers: [9a60c0aa5924 180e98e77f5f b61a335098d4 488c997d8b28 88426a442243 fbd545c98f01 2045959df095 d35d8d1d0f5c 6139093704f1 8d9234bb7196 05833a52685b 7c93ae567b08 a8bfa396c38c c3de4ee2fb10 5ffc980043f7 0fae92e6caf9 23d397f4ac20 1505f31da467 9ab49a821bc7 49d254f9aff4 daa1fcd45e4e 69cc14406ac3 4a8abfc5dbd1 e6fa65b6ce9c 1dbee0f40197 e26a914af049 4d1de353c2d7 7da2b0a735e3]

	I0829 11:22:50.167244    2025 ssh_runner.go:195] Run: docker stop 9a60c0aa5924 180e98e77f5f b61a335098d4 488c997d8b28 88426a442243 fbd545c98f01 2045959df095 d35d8d1d0f5c 6139093704f1 8d9234bb7196 05833a52685b 7c93ae567b08 a8bfa396c38c c3de4ee2fb10 5ffc980043f7 0fae92e6caf9 23d397f4ac20 1505f31da467 9ab49a821bc7 49d254f9aff4 daa1fcd45e4e 69cc14406ac3 4a8abfc5dbd1 e6fa65b6ce9c 1dbee0f40197 e26a914af049 4d1de353c2d7 7da2b0a735e3

	I0829 11:22:50.174502    2025 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I0829 11:22:50.284074    2025 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0829 11:22:50.290192    2025 kubeadm.go:157] found existing configuration files:

	-rw------- 1 root root 5647 Aug 29 18:21 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5657 Aug 29 18:22 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2007 Aug 29 18:21 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5601 Aug 29 18:22 /etc/kubernetes/scheduler.conf

	I0829 11:22:50.290235    2025 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0829 11:22:50.294424    2025 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0829 11:22:50.298436    2025 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0829 11:22:50.302428    2025 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0829 11:22:50.302727    2025 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0829 11:22:50.307469    2025 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0829 11:22:50.311318    2025 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0829 11:22:50.311350    2025 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0829 11:22:50.314877    2025 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0829 11:22:50.318043    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:50.335199    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:51.033887    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:51.136569    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:51.158080    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:51.182955    2025 api_server.go:52] waiting for apiserver process to appear ...

	I0829 11:22:51.183026    2025 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0829 11:22:51.685388    2025 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0829 11:22:52.184157    2025 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0829 11:22:52.190150    2025 api_server.go:72] duration metric: took 1.007204584s to wait for apiserver process to appear ...

	I0829 11:22:52.190158    2025 api_server.go:88] waiting for apiserver healthz status ...

	I0829 11:22:52.190168    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:22:54.348611    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0829 11:22:54.348621    2025 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0829 11:22:54.348627    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:22:54.361745    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0829 11:22:54.361752    2025 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0829 11:22:54.692309    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:22:54.702155    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W0829 11:22:54.702177    2025 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I0829 11:22:55.192299    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:22:55.205543    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W0829 11:22:55.205566    2025 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I0829 11:22:55.692200    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:22:55.698493    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I0829 11:22:55.702713    2025 api_server.go:141] control plane version: v1.31.0

	I0829 11:22:55.702721    2025 api_server.go:131] duration metric: took 3.512591458s to wait for apiserver health ...

	I0829 11:22:55.702725    2025 cni.go:84] Creating CNI manager for ""

	I0829 11:22:55.702731    2025 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0829 11:22:55.706596    2025 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0829 11:22:55.710496    2025 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0829 11:22:55.714330    2025 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0829 11:22:55.722348    2025 system_pods.go:43] waiting for kube-system pods to appear ...

	I0829 11:22:55.727447    2025 system_pods.go:59] 7 kube-system pods found

	I0829 11:22:55.727459    2025 system_pods.go:61] "coredns-6f6b679f8f-4wppn" [6caa35af-dfdb-4344-a077-a7f450fbb4f9] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0829 11:22:55.727462    2025 system_pods.go:61] "etcd-functional-312000" [cb7cba37-45a5-4dff-9180-be1e88d124ea] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0829 11:22:55.727465    2025 system_pods.go:61] "kube-apiserver-functional-312000" [2435d05e-e4b4-4231-81b5-99d038e69b76] Pending

	I0829 11:22:55.727468    2025 system_pods.go:61] "kube-controller-manager-functional-312000" [83de2a98-b459-42e7-afeb-149bfc09e71a] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0829 11:22:55.727470    2025 system_pods.go:61] "kube-proxy-vgdtt" [51624d33-573a-49ac-b6cf-4af99ecdbdae] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0829 11:22:55.727472    2025 system_pods.go:61] "kube-scheduler-functional-312000" [6a6cb34b-5c51-41f0-9690-4a5dd8d107cf] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0829 11:22:55.727474    2025 system_pods.go:61] "storage-provisioner" [0b815560-b36d-412c-b4fa-17d80a9ac18f] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0829 11:22:55.727478    2025 system_pods.go:74] duration metric: took 5.124ms to wait for pod list to return data ...

	I0829 11:22:55.727481    2025 node_conditions.go:102] verifying NodePressure condition ...

	I0829 11:22:55.729602    2025 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0829 11:22:55.729615    2025 node_conditions.go:123] node cpu capacity is 2

	I0829 11:22:55.729620    2025 node_conditions.go:105] duration metric: took 2.136584ms to run NodePressure ...

	I0829 11:22:55.729627    2025 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0829 11:22:55.959610    2025 kubeadm.go:724] waiting for restarted kubelet to initialise ...

	I0829 11:22:55.961973    2025 kubeadm.go:739] kubelet initialised

	I0829 11:22:55.961977    2025 kubeadm.go:740] duration metric: took 2.359708ms waiting for restarted kubelet to initialise ...

	I0829 11:22:55.961981    2025 pod_ready.go:36] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:22:55.964510    2025 pod_ready.go:79] waiting up to 4m0s for pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace to be "Ready" ...

	I0829 11:22:57.971007    2025 pod_ready.go:103] pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace has status "Ready":"False"

	I0829 11:22:59.979405    2025 pod_ready.go:103] pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace has status "Ready":"False"

	I0829 11:23:01.970844    2025 pod_ready.go:93] pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:01.970853    2025 pod_ready.go:82] duration metric: took 6.006389709s for pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:01.970859    2025 pod_ready.go:79] waiting up to 4m0s for pod "etcd-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:02.479460    2025 pod_ready.go:93] pod "etcd-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:02.479474    2025 pod_ready.go:82] duration metric: took 508.613916ms for pod "etcd-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:02.479487    2025 pod_ready.go:79] waiting up to 4m0s for pod "kube-apiserver-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:04.486177    2025 pod_ready.go:93] pod "kube-apiserver-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:04.486187    2025 pod_ready.go:82] duration metric: took 2.006711333s for pod "kube-apiserver-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:04.486195    2025 pod_ready.go:79] waiting up to 4m0s for pod "kube-controller-manager-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:06.494262    2025 pod_ready.go:103] pod "kube-controller-manager-functional-312000" in "kube-system" namespace has status "Ready":"False"

	I0829 11:23:06.995820    2025 pod_ready.go:93] pod "kube-controller-manager-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:06.995835    2025 pod_ready.go:82] duration metric: took 2.509654875s for pod "kube-controller-manager-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:06.995846    2025 pod_ready.go:79] waiting up to 4m0s for pod "kube-proxy-vgdtt" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.000953    2025 pod_ready.go:93] pod "kube-proxy-vgdtt" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:07.000961    2025 pod_ready.go:82] duration metric: took 5.108417ms for pod "kube-proxy-vgdtt" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.000970    2025 pod_ready.go:79] waiting up to 4m0s for pod "kube-scheduler-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.005770    2025 pod_ready.go:93] pod "kube-scheduler-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:07.005776    2025 pod_ready.go:82] duration metric: took 4.800167ms for pod "kube-scheduler-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.005783    2025 pod_ready.go:39] duration metric: took 11.043897125s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:23:07.005802    2025 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0829 11:23:07.014923    2025 ops.go:34] apiserver oom_adj: -16

	I0829 11:23:07.014930    2025 kubeadm.go:597] duration metric: took 16.862664291s to restartPrimaryControlPlane

	I0829 11:23:07.014935    2025 kubeadm.go:394] duration metric: took 16.872503166s to StartCluster

	I0829 11:23:07.014950    2025 settings.go:142] acquiring lock: {Name:mk4c43097bad4576952ccc223d0a8a031914c5a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:23:07.015131    2025 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:23:07.015837    2025 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/kubeconfig: {Name:mk8af293b3e18a99fbcb2b7e12f57a5251bf5686 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:23:07.016305    2025 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:23:07.016329    2025 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0829 11:23:07.016401    2025 addons.go:69] Setting storage-provisioner=true in profile "functional-312000"

	I0829 11:23:07.016413    2025 addons.go:69] Setting default-storageclass=true in profile "functional-312000"

	I0829 11:23:07.016424    2025 addons.go:234] Setting addon storage-provisioner=true in "functional-312000"

	W0829 11:23:07.016428    2025 addons.go:243] addon storage-provisioner should already be in state true

	I0829 11:23:07.016437    2025 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-312000"

	I0829 11:23:07.016450    2025 host.go:66] Checking if "functional-312000" exists ...

	I0829 11:23:07.016495    2025 config.go:182] Loaded profile config "functional-312000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:23:07.017984    2025 addons.go:234] Setting addon default-storageclass=true in "functional-312000"

	W0829 11:23:07.017989    2025 addons.go:243] addon default-storageclass should already be in state true

	I0829 11:23:07.017997    2025 host.go:66] Checking if "functional-312000" exists ...

	I0829 11:23:07.020362    2025 out.go:177] * Verifying Kubernetes components...

	I0829 11:23:07.020875    2025 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0829 11:23:07.020881    2025 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0829 11:23:07.020892    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:23:07.023400    2025 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0829 11:23:07.026369    2025 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0829 11:23:07.030370    2025 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0829 11:23:07.030375    2025 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0829 11:23:07.030382    2025 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/functional-312000/id_rsa Username:docker}

	I0829 11:23:07.152288    2025 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0829 11:23:07.157849    2025 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0829 11:23:07.161621    2025 node_ready.go:35] waiting up to 6m0s for node "functional-312000" to be "Ready" ...

	I0829 11:23:07.163189    2025 node_ready.go:49] node "functional-312000" has status "Ready":"True"

	I0829 11:23:07.163192    2025 node_ready.go:38] duration metric: took 1.563542ms for node "functional-312000" to be "Ready" ...

	I0829 11:23:07.163195    2025 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:23:07.165782    2025 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.168088    2025 pod_ready.go:93] pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:07.168092    2025 pod_ready.go:82] duration metric: took 2.306625ms for pod "coredns-6f6b679f8f-4wppn" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.168095    2025 pod_ready.go:79] waiting up to 6m0s for pod "etcd-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.208171    2025 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0829 11:23:07.484685    2025 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0829 11:23:07.488707    2025 addons.go:510] duration metric: took 472.393042ms for enable addons: enabled=[default-storageclass storage-provisioner]

	I0829 11:23:07.570565    2025 pod_ready.go:93] pod "etcd-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:07.570571    2025 pod_ready.go:82] duration metric: took 402.4765ms for pod "etcd-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.570575    2025 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.975726    2025 pod_ready.go:93] pod "kube-apiserver-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:07.975755    2025 pod_ready.go:82] duration metric: took 405.170792ms for pod "kube-apiserver-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:07.975777    2025 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:08.374269    2025 pod_ready.go:93] pod "kube-controller-manager-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:08.374290    2025 pod_ready.go:82] duration metric: took 398.505208ms for pod "kube-controller-manager-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:08.374310    2025 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-vgdtt" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:08.774632    2025 pod_ready.go:93] pod "kube-proxy-vgdtt" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:08.774660    2025 pod_ready.go:82] duration metric: took 400.34125ms for pod "kube-proxy-vgdtt" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:08.774676    2025 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:09.175853    2025 pod_ready.go:93] pod "kube-scheduler-functional-312000" in "kube-system" namespace has status "Ready":"True"

	I0829 11:23:09.175884    2025 pod_ready.go:82] duration metric: took 401.198625ms for pod "kube-scheduler-functional-312000" in "kube-system" namespace to be "Ready" ...

	I0829 11:23:09.175907    2025 pod_ready.go:39] duration metric: took 2.012719417s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0829 11:23:09.175965    2025 api_server.go:52] waiting for apiserver process to appear ...

	I0829 11:23:09.176286    2025 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0829 11:23:09.197045    2025 api_server.go:72] duration metric: took 2.180739458s to wait for apiserver process to appear ...

	I0829 11:23:09.197056    2025 api_server.go:88] waiting for apiserver healthz status ...

	I0829 11:23:09.197072    2025 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0829 11:23:09.204510    2025 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I0829 11:23:09.205512    2025 api_server.go:141] control plane version: v1.31.0

	I0829 11:23:09.205520    2025 api_server.go:131] duration metric: took 8.459292ms to wait for apiserver health ...

	I0829 11:23:09.205526    2025 system_pods.go:43] waiting for kube-system pods to appear ...

	I0829 11:23:09.380288    2025 system_pods.go:59] 7 kube-system pods found

	I0829 11:23:09.380320    2025 system_pods.go:61] "coredns-6f6b679f8f-4wppn" [6caa35af-dfdb-4344-a077-a7f450fbb4f9] Running

	I0829 11:23:09.380329    2025 system_pods.go:61] "etcd-functional-312000" [cb7cba37-45a5-4dff-9180-be1e88d124ea] Running

	I0829 11:23:09.380333    2025 system_pods.go:61] "kube-apiserver-functional-312000" [2435d05e-e4b4-4231-81b5-99d038e69b76] Running

	I0829 11:23:09.380338    2025 system_pods.go:61] "kube-controller-manager-functional-312000" [83de2a98-b459-42e7-afeb-149bfc09e71a] Running

	I0829 11:23:09.380342    2025 system_pods.go:61] "kube-proxy-vgdtt" [51624d33-573a-49ac-b6cf-4af99ecdbdae] Running

	I0829 11:23:09.380346    2025 system_pods.go:61] "kube-scheduler-functional-312000" [6a6cb34b-5c51-41f0-9690-4a5dd8d107cf] Running

	I0829 11:23:09.380350    2025 system_pods.go:61] "storage-provisioner" [0b815560-b36d-412c-b4fa-17d80a9ac18f] Running

	I0829 11:23:09.380359    2025 system_pods.go:74] duration metric: took 174.828792ms to wait for pod list to return data ...

	I0829 11:23:09.380373    2025 default_sa.go:34] waiting for default service account to be created ...

	I0829 11:23:09.575288    2025 default_sa.go:45] found service account: "default"

	I0829 11:23:09.575331    2025 default_sa.go:55] duration metric: took 194.943417ms for default service account to be created ...

	I0829 11:23:09.575353    2025 system_pods.go:116] waiting for k8s-apps to be running ...

	I0829 11:23:09.778872    2025 system_pods.go:86] 7 kube-system pods found

	I0829 11:23:09.778904    2025 system_pods.go:89] "coredns-6f6b679f8f-4wppn" [6caa35af-dfdb-4344-a077-a7f450fbb4f9] Running

	I0829 11:23:09.778912    2025 system_pods.go:89] "etcd-functional-312000" [cb7cba37-45a5-4dff-9180-be1e88d124ea] Running

	I0829 11:23:09.778916    2025 system_pods.go:89] "kube-apiserver-functional-312000" [2435d05e-e4b4-4231-81b5-99d038e69b76] Running

	I0829 11:23:09.778921    2025 system_pods.go:89] "kube-controller-manager-functional-312000" [83de2a98-b459-42e7-afeb-149bfc09e71a] Running

	I0829 11:23:09.778925    2025 system_pods.go:89] "kube-proxy-vgdtt" [51624d33-573a-49ac-b6cf-4af99ecdbdae] Running

	I0829 11:23:09.778929    2025 system_pods.go:89] "kube-scheduler-functional-312000" [6a6cb34b-5c51-41f0-9690-4a5dd8d107cf] Running

	I0829 11:23:09.778933    2025 system_pods.go:89] "storage-provisioner" [0b815560-b36d-412c-b4fa-17d80a9ac18f] Running

	I0829 11:23:09.778944    2025 system_pods.go:126] duration metric: took 203.583542ms to wait for k8s-apps to be running ...

	I0829 11:23:09.778953    2025 system_svc.go:44] waiting for kubelet service to be running ....

	I0829 11:23:09.779138    2025 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0829 11:23:09.797618    2025 system_svc.go:56] duration metric: took 18.657042ms WaitForService to wait for kubelet

	I0829 11:23:09.797640    2025 kubeadm.go:582] duration metric: took 2.781342s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:23:09.797660    2025 node_conditions.go:102] verifying NodePressure condition ...

	I0829 11:23:09.970740    2025 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0829 11:23:09.970748    2025 node_conditions.go:123] node cpu capacity is 2

	I0829 11:23:09.970755    2025 node_conditions.go:105] duration metric: took 173.093458ms to run NodePressure ...

	I0829 11:23:09.970763    2025 start.go:241] waiting for startup goroutines ...

	I0829 11:23:09.970768    2025 start.go:246] waiting for cluster config update ...

	I0829 11:23:09.970775    2025 start.go:255] writing updated cluster config ...

	I0829 11:23:09.971176    2025 ssh_runner.go:195] Run: rm -f paused

	I0829 11:23:10.006069    2025 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0829 11:23:10.010407    2025 out.go:201] 

	W0829 11:23:10.013504    2025 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0829 11:23:10.018413    2025 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0829 11:23:10.026380    2025 out.go:177] * Done! kubectl is now configured to use "functional-312000" cluster and "default" namespace by default

	==> Docker <==

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.154394739Z" level=warning msg="cleaning up after shim disconnected" id=96065d2277a1d91e7e52d6a6de529b5b448b9df828a254f26310bddc5894f06b namespace=moby

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.154473146Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.209931669Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.209962582Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.209967998Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.210072027Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:47 functional-312000 dockerd[5741]: time="2024-08-29T18:23:47.231182758Z" level=info msg="ignoring event" container=0650380888a9de102cd52e0446d3e56910d86dfb91e33ee9c1c3a25938ee9bf1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.231330073Z" level=info msg="shim disconnected" id=0650380888a9de102cd52e0446d3e56910d86dfb91e33ee9c1c3a25938ee9bf1 namespace=moby

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.231381775Z" level=warning msg="cleaning up after shim disconnected" id=0650380888a9de102cd52e0446d3e56910d86dfb91e33ee9c1c3a25938ee9bf1 namespace=moby

	Aug 29 18:23:47 functional-312000 dockerd[5747]: time="2024-08-29T18:23:47.231386483Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 29 18:23:48 functional-312000 dockerd[5747]: time="2024-08-29T18:23:48.475358631Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 29 18:23:48 functional-312000 dockerd[5747]: time="2024-08-29T18:23:48.475394085Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 29 18:23:48 functional-312000 dockerd[5747]: time="2024-08-29T18:23:48.475409583Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:48 functional-312000 dockerd[5747]: time="2024-08-29T18:23:48.475444787Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:48 functional-312000 cri-dockerd[5999]: time="2024-08-29T18:23:48Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/bffc0a80b2962b321c0cec52a578ab00ae115f77b54f141ed13cfee1f63b82bc/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Aug 29 18:23:49 functional-312000 cri-dockerd[5999]: time="2024-08-29T18:23:49Z" level=info msg="Stop pulling image docker.io/nginx:latest: Status: Image is up to date for nginx:latest"

	Aug 29 18:23:49 functional-312000 dockerd[5747]: time="2024-08-29T18:23:49.294002121Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 29 18:23:49 functional-312000 dockerd[5747]: time="2024-08-29T18:23:49.294105609Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 29 18:23:49 functional-312000 dockerd[5747]: time="2024-08-29T18:23:49.294120065Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:49 functional-312000 dockerd[5747]: time="2024-08-29T18:23:49.294425945Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:57 functional-312000 dockerd[5747]: time="2024-08-29T18:23:57.291801676Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 29 18:23:57 functional-312000 dockerd[5747]: time="2024-08-29T18:23:57.291834839Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 29 18:23:57 functional-312000 dockerd[5747]: time="2024-08-29T18:23:57.291844587Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:57 functional-312000 dockerd[5747]: time="2024-08-29T18:23:57.291880083Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 29 18:23:57 functional-312000 cri-dockerd[5999]: time="2024-08-29T18:23:57Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/37cd522d1c52ca2950d810fa6eea5497502b9780101d9d42de9b5f2a400551a0/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	==> container status <==

	CONTAINER           IMAGE                                                                           CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	f4e8428f5f938       nginx@sha256:447a8665cc1dab95b1ca778e162215839ccbb9189104c79d7ec3a81e14577add   10 seconds ago       Running             myfrontend                0                   bffc0a80b2962       sp-pod

	0650380888a9d       72565bf5bbedf                                                                   12 seconds ago       Exited              echoserver-arm            2                   cd797acdb58be       hello-node-connect-65d86f57f4-zx8nc

	9863a801f6d10       72565bf5bbedf                                                                   20 seconds ago       Exited              echoserver-arm            2                   d2519695c0c24       hello-node-64b4f8f9ff-9zv77

	542c4a39a906c       nginx@sha256:c04c18adc2a407740a397c8407c011fc6c90026a9b65cceddef7ae5484360158   34 seconds ago       Running             nginx                     0                   ff2fe09fc9b26       nginx-svc

	c927b8c14fb9c       2437cf7621777                                                                   About a minute ago   Running             coredns                   2                   aefcc78cf2669       coredns-6f6b679f8f-4wppn

	a5ea9041885aa       ba04bb24b9575                                                                   About a minute ago   Running             storage-provisioner       2                   2b88d20442d31       storage-provisioner

	4a8801e5835d8       71d55d66fd4ee                                                                   About a minute ago   Running             kube-proxy                2                   8fc7a4586a06b       kube-proxy-vgdtt

	101bc7756c05e       fbbbd428abb4d                                                                   About a minute ago   Running             kube-scheduler            2                   26ad8af137f8d       kube-scheduler-functional-312000

	01c038f2b4cb1       27e3830e14027                                                                   About a minute ago   Running             etcd                      2                   9dc04fe51b55a       etcd-functional-312000

	853230991aa84       fcb0683e6bdbd                                                                   About a minute ago   Running             kube-controller-manager   2                   d63e160077967       kube-controller-manager-functional-312000

	1086d5ec258c7       cd0f0ae0ec9e0                                                                   About a minute ago   Running             kube-apiserver            0                   59b1ddf3125ea       kube-apiserver-functional-312000

	180e98e77f5f9       2437cf7621777                                                                   About a minute ago   Exited              coredns                   1                   88426a4422439       coredns-6f6b679f8f-4wppn

	b61a335098d49       71d55d66fd4ee                                                                   About a minute ago   Exited              kube-proxy                1                   2045959df0955       kube-proxy-vgdtt

	488c997d8b281       ba04bb24b9575                                                                   About a minute ago   Exited              storage-provisioner       1                   fbd545c98f016       storage-provisioner

	d35d8d1d0f5c7       27e3830e14027                                                                   About a minute ago   Exited              etcd                      1                   a8bfa396c38c8       etcd-functional-312000

	6139093704f18       fbbbd428abb4d                                                                   About a minute ago   Exited              kube-scheduler            1                   5ffc980043f75       kube-scheduler-functional-312000

	8d9234bb71965       fcb0683e6bdbd                                                                   About a minute ago   Exited              kube-controller-manager   1                   7c93ae567b087       kube-controller-manager-functional-312000

	==> coredns [180e98e77f5f] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:38744 - 22516 "HINFO IN 1324102400152104475.6972045167918144933. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009333687s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [c927b8c14fb9] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:49373 - 44223 "HINFO IN 335119254331106436.6742033756457883145. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.009903556s

	[INFO] 10.244.0.1:1776 - 42760 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000109445s

	[INFO] 10.244.0.1:45513 - 30046 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000102988s

	[INFO] 10.244.0.1:4596 - 4203 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001318005s

	[INFO] 10.244.0.1:9430 - 1319 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000049035s

	[INFO] 10.244.0.1:19082 - 42077 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.00005766s

	[INFO] 10.244.0.1:29125 - 4074 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000089447s

	==> describe nodes <==

	Name:               functional-312000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-312000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=95341f0b655cea8be5ebfc6bf112c8367dc08d33

	                    minikube.k8s.io/name=functional-312000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_29T11_21_32_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Thu, 29 Aug 2024 18:21:30 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-312000

	  AcquireTime:     <unset>

	  RenewTime:       Thu, 29 Aug 2024 18:23:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Thu, 29 Aug 2024 18:23:55 +0000   Thu, 29 Aug 2024 18:21:29 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Thu, 29 Aug 2024 18:23:55 +0000   Thu, 29 Aug 2024 18:21:29 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Thu, 29 Aug 2024 18:23:55 +0000   Thu, 29 Aug 2024 18:21:29 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Thu, 29 Aug 2024 18:23:55 +0000   Thu, 29 Aug 2024 18:21:35 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-312000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 82815d12401e406f985346768eea1b48

	  System UUID:                82815d12401e406f985346768eea1b48

	  Boot ID:                    61202e23-cfff-4b52-ad76-635aba0fb418

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.1.2

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (12 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     busybox-mount                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         3s

	  default                     hello-node-64b4f8f9ff-9zv77                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         42s

	  default                     hello-node-connect-65d86f57f4-zx8nc          0 (0%)        0 (0%)      0 (0%)           0 (0%)         28s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         38s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         11s

	  kube-system                 coredns-6f6b679f8f-4wppn                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m21s

	  kube-system                 etcd-functional-312000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         2m27s

	  kube-system                 kube-apiserver-functional-312000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         64s

	  kube-system                 kube-controller-manager-functional-312000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         2m27s

	  kube-system                 kube-proxy-vgdtt                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m23s

	  kube-system                 kube-scheduler-functional-312000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         2m27s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m22s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m20s                kube-proxy       

	  Normal  Starting                 63s                  kube-proxy       

	  Normal  Starting                 113s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  2m27s                kubelet          Node functional-312000 status is now: NodeHasSufficientMemory

	  Normal  NodeAllocatableEnforced  2m27s                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    2m27s                kubelet          Node functional-312000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m27s                kubelet          Node functional-312000 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m27s                kubelet          Starting kubelet.

	  Normal  NodeReady                2m24s                kubelet          Node functional-312000 status is now: NodeReady

	  Normal  RegisteredNode           2m23s                node-controller  Node functional-312000 event: Registered Node functional-312000 in Controller

	  Normal  NodeHasNoDiskPressure    117s (x8 over 117s)  kubelet          Node functional-312000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  117s (x8 over 117s)  kubelet          Node functional-312000 status is now: NodeHasSufficientMemory

	  Normal  Starting                 117s                 kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     117s (x7 over 117s)  kubelet          Node functional-312000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  117s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           111s                 node-controller  Node functional-312000 event: Registered Node functional-312000 in Controller

	  Normal  Starting                 68s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  68s (x8 over 68s)    kubelet          Node functional-312000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    68s (x8 over 68s)    kubelet          Node functional-312000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     68s (x7 over 68s)    kubelet          Node functional-312000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  68s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           62s                  node-controller  Node functional-312000 event: Registered Node functional-312000 in Controller

	==> dmesg <==

	[  +1.013387] systemd-fstab-generator[3893]: Ignoring "noauto" option for root device

	[  +3.432883] kauditd_printk_skb: 199 callbacks suppressed

	[  +6.606893] kauditd_printk_skb: 33 callbacks suppressed

	[ +10.459730] systemd-fstab-generator[4824]: Ignoring "noauto" option for root device

	[ +13.765462] systemd-fstab-generator[5265]: Ignoring "noauto" option for root device

	[  +0.055136] kauditd_printk_skb: 12 callbacks suppressed

	[  +0.101427] systemd-fstab-generator[5298]: Ignoring "noauto" option for root device

	[  +0.095389] systemd-fstab-generator[5310]: Ignoring "noauto" option for root device

	[  +0.102199] systemd-fstab-generator[5325]: Ignoring "noauto" option for root device

	[  +5.122553] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.384381] systemd-fstab-generator[5948]: Ignoring "noauto" option for root device

	[  +0.073900] systemd-fstab-generator[5960]: Ignoring "noauto" option for root device

	[  +0.070984] systemd-fstab-generator[5972]: Ignoring "noauto" option for root device

	[  +0.101115] systemd-fstab-generator[5987]: Ignoring "noauto" option for root device

	[  +0.211486] systemd-fstab-generator[6160]: Ignoring "noauto" option for root device

	[  +1.137620] systemd-fstab-generator[6283]: Ignoring "noauto" option for root device

	[  +4.409727] kauditd_printk_skb: 199 callbacks suppressed

	[Aug29 18:23] kauditd_printk_skb: 33 callbacks suppressed

	[  +5.137041] systemd-fstab-generator[7295]: Ignoring "noauto" option for root device

	[  +6.501838] kauditd_printk_skb: 28 callbacks suppressed

	[  +7.574090] kauditd_printk_skb: 19 callbacks suppressed

	[  +5.047130] kauditd_printk_skb: 27 callbacks suppressed

	[ +12.911603] kauditd_printk_skb: 32 callbacks suppressed

	[  +7.977727] kauditd_printk_skb: 1 callbacks suppressed

	[ +10.230414] kauditd_printk_skb: 21 callbacks suppressed

	==> etcd [01c038f2b4cb] <==

	{"level":"info","ts":"2024-08-29T18:22:52.199178Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2024-08-29T18:22:52.200552Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}

	{"level":"info","ts":"2024-08-29T18:22:52.200648Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-29T18:22:52.200656Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-29T18:22:52.200703Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-08-29T18:22:52.200756Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:22:52.200773Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-29T18:22:52.200849Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2024-08-29T18:22:52.200858Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-08-29T18:22:53.786317Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:53.786512Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:53.786596Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:53.786637Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-08-29T18:22:53.786653Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-08-29T18:22:53.786677Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-08-29T18:22:53.786700Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-08-29T18:22:53.789765Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:22:53.789778Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-312000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-29T18:22:53.790088Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:22:53.792417Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:22:53.793989Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-29T18:22:53.794049Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-29T18:22:53.792417Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:22:53.795214Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-08-29T18:22:53.796777Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	==> etcd [d35d8d1d0f5c] <==

	{"level":"info","ts":"2024-08-29T18:22:04.813000Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-08-29T18:22:04.813085Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-08-29T18:22:04.813121Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:04.813161Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:04.813191Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:04.813250Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-29T18:22:04.818279Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-312000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-29T18:22:04.818593Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:22:04.818845Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-29T18:22:04.818987Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-29T18:22:04.819148Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-29T18:22:04.821148Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:22:04.821152Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-29T18:22:04.823074Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-08-29T18:22:04.824596Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-08-29T18:22:37.058616Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-08-29T18:22:37.058649Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-312000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-08-29T18:22:37.058689Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-29T18:22:37.058731Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-29T18:22:37.073710Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-29T18:22:37.073736Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"info","ts":"2024-08-29T18:22:37.073766Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-08-29T18:22:37.075688Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-29T18:22:37.075727Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-29T18:22:37.075731Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-312000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> kernel <==

	 18:23:59 up 2 min,  0 users,  load average: 1.25, 0.72, 0.29

	Linux functional-312000 5.10.207 #1 SMP PREEMPT Tue Aug 27 17:57:16 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [1086d5ec258c] <==

	I0829 18:22:54.413585       1 autoregister_controller.go:144] Starting autoregister controller

	I0829 18:22:54.413604       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0829 18:22:54.413615       1 cache.go:39] Caches are synced for autoregister controller

	I0829 18:22:54.413891       1 shared_informer.go:320] Caches are synced for configmaps

	I0829 18:22:54.414016       1 apf_controller.go:382] Running API Priority and Fairness config worker

	I0829 18:22:54.414047       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process

	I0829 18:22:54.416519       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	E0829 18:22:54.416620       1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service

	I0829 18:22:54.444279       1 shared_informer.go:320] Caches are synced for node_authorizer

	I0829 18:22:54.450368       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0829 18:22:54.450400       1 policy_source.go:224] refreshing policies

	I0829 18:22:54.466698       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0829 18:22:55.310819       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0829 18:22:55.859582       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0829 18:22:55.863459       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0829 18:22:55.875903       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0829 18:22:55.884078       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0829 18:22:55.886843       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0829 18:22:58.072423       1 controller.go:615] quota admission added evaluator for: endpoints

	I0829 18:22:58.124227       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0829 18:23:11.470807       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.96.104.118"}

	I0829 18:23:17.040815       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0829 18:23:17.085473       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.103.136.27"}

	I0829 18:23:21.142440       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.96.160.208"}

	I0829 18:23:31.580747       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.111.70.57"}

	==> kube-controller-manager [853230991aa8] <==

	I0829 18:22:57.919920       1 shared_informer.go:320] Caches are synced for resource quota

	I0829 18:22:58.335416       1 shared_informer.go:320] Caches are synced for garbage collector

	I0829 18:22:58.384938       1 shared_informer.go:320] Caches are synced for garbage collector

	I0829 18:22:58.385013       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0829 18:23:01.928584       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="7.19249ms"

	I0829 18:23:01.928832       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="30.622µs"

	I0829 18:23:17.047518       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="5.007375ms"

	I0829 18:23:17.054333       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="6.646127ms"

	I0829 18:23:17.060388       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="5.990918ms"

	I0829 18:23:17.060422       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="14.415µs"

	I0829 18:23:22.631462       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="23.705µs"

	I0829 18:23:23.671423       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="38.912µs"

	I0829 18:23:24.677484       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="26.663µs"

	I0829 18:23:25.194951       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-312000"

	I0829 18:23:31.549030       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="8.335473ms"

	I0829 18:23:31.553331       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="4.273099ms"

	I0829 18:23:31.553364       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="12.29µs"

	I0829 18:23:31.553379       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="5.832µs"

	I0829 18:23:32.784363       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="31.787µs"

	I0829 18:23:33.791119       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="24.289µs"

	I0829 18:23:39.885608       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="21.872µs"

	I0829 18:23:47.190387       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="27.58µs"

	I0829 18:23:48.066856       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="33.455µs"

	I0829 18:23:52.201707       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="37.287µs"

	I0829 18:23:55.974819       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-312000"

	==> kube-controller-manager [8d9234bb7196] <==

	I0829 18:22:08.703247       1 shared_informer.go:320] Caches are synced for PV protection

	I0829 18:22:08.703909       1 shared_informer.go:320] Caches are synced for validatingadmissionpolicy-status

	I0829 18:22:08.706164       1 shared_informer.go:320] Caches are synced for TTL

	I0829 18:22:08.706228       1 shared_informer.go:320] Caches are synced for node

	I0829 18:22:08.706257       1 range_allocator.go:171] "Sending events to api server" logger="node-ipam-controller"

	I0829 18:22:08.706331       1 range_allocator.go:177] "Starting range CIDR allocator" logger="node-ipam-controller"

	I0829 18:22:08.706361       1 shared_informer.go:313] Waiting for caches to sync for cidrallocator

	I0829 18:22:08.706393       1 shared_informer.go:320] Caches are synced for cidrallocator

	I0829 18:22:08.706438       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-312000"

	I0829 18:22:08.779463       1 shared_informer.go:320] Caches are synced for endpoint_slice

	I0829 18:22:08.796986       1 shared_informer.go:320] Caches are synced for attach detach

	I0829 18:22:08.803885       1 shared_informer.go:320] Caches are synced for endpoint_slice_mirroring

	I0829 18:22:08.889320       1 shared_informer.go:320] Caches are synced for resource quota

	I0829 18:22:08.905752       1 shared_informer.go:320] Caches are synced for HPA

	I0829 18:22:08.910801       1 shared_informer.go:320] Caches are synced for resource quota

	I0829 18:22:09.324340       1 shared_informer.go:320] Caches are synced for garbage collector

	I0829 18:22:09.403939       1 shared_informer.go:320] Caches are synced for garbage collector

	I0829 18:22:09.404017       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0829 18:22:12.419394       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="26.774768ms"

	I0829 18:22:12.420674       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="1.249189ms"

	I0829 18:22:12.429917       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="8.623752ms"

	I0829 18:22:12.429961       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="19.366µs"

	I0829 18:22:12.616870       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="3.870887ms"

	I0829 18:22:12.617474       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="15.576µs"

	I0829 18:22:36.261714       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-312000"

	==> kube-proxy [4a8801e5835d] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0829 18:22:55.731741       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0829 18:22:55.747107       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0829 18:22:55.747146       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0829 18:22:55.766988       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0829 18:22:55.767010       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0829 18:22:55.767026       1 server_linux.go:169] "Using iptables Proxier"

	I0829 18:22:55.768956       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0829 18:22:55.769326       1 server.go:483] "Version info" version="v1.31.0"

	I0829 18:22:55.770198       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0829 18:22:55.771127       1 config.go:197] "Starting service config controller"

	I0829 18:22:55.771179       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0829 18:22:55.771208       1 config.go:104] "Starting endpoint slice config controller"

	I0829 18:22:55.771240       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0829 18:22:55.771461       1 config.go:326] "Starting node config controller"

	I0829 18:22:55.771484       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0829 18:22:55.871658       1 shared_informer.go:320] Caches are synced for node config

	I0829 18:22:55.871681       1 shared_informer.go:320] Caches are synced for service config

	I0829 18:22:55.871686       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-proxy [b61a335098d4] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0829 18:22:06.031070       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0829 18:22:06.039644       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0829 18:22:06.039678       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0829 18:22:06.053364       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0829 18:22:06.053382       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0829 18:22:06.053411       1 server_linux.go:169] "Using iptables Proxier"

	I0829 18:22:06.054083       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0829 18:22:06.054216       1 server.go:483] "Version info" version="v1.31.0"

	I0829 18:22:06.054229       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0829 18:22:06.055144       1 config.go:197] "Starting service config controller"

	I0829 18:22:06.055158       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0829 18:22:06.055296       1 config.go:104] "Starting endpoint slice config controller"

	I0829 18:22:06.055303       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0829 18:22:06.055781       1 config.go:326] "Starting node config controller"

	I0829 18:22:06.055785       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0829 18:22:06.155252       1 shared_informer.go:320] Caches are synced for service config

	I0829 18:22:06.156156       1 shared_informer.go:320] Caches are synced for node config

	I0829 18:22:06.156162       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [101bc7756c05] <==

	I0829 18:22:52.646868       1 serving.go:386] Generated self-signed cert in-memory

	W0829 18:22:54.344610       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0829 18:22:54.344661       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0829 18:22:54.344684       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0829 18:22:54.344692       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0829 18:22:54.367432       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0829 18:22:54.368623       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0829 18:22:54.370932       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0829 18:22:54.371948       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0829 18:22:54.371987       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0829 18:22:54.372011       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0829 18:22:54.472721       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kube-scheduler [6139093704f1] <==

	I0829 18:22:03.550183       1 serving.go:386] Generated self-signed cert in-memory

	W0829 18:22:05.346091       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0829 18:22:05.346537       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0829 18:22:05.346576       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0829 18:22:05.346595       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0829 18:22:05.372972       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0829 18:22:05.373854       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0829 18:22:05.375776       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0829 18:22:05.379430       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0829 18:22:05.379750       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0829 18:22:05.380802       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0829 18:22:05.481292       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0829 18:22:37.051085       1 run.go:72] "command failed" err="finished without leader elect"

	==> kubelet <==

	Aug 29 18:23:47 functional-312000 kubelet[6290]: I0829 18:23:47.283442    6290 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-8shqw\" (UniqueName: \"kubernetes.io/projected/4ab799f4-e2dd-4400-9c43-7f80f2533cc1-kube-api-access-8shqw\") on node \"functional-312000\" DevicePath \"\""

	Aug 29 18:23:47 functional-312000 kubelet[6290]: I0829 18:23:47.283456    6290 reconciler_common.go:288] "Volume detached for volume \"pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483\" (UniqueName: \"kubernetes.io/host-path/4ab799f4-e2dd-4400-9c43-7f80f2533cc1-pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483\") on node \"functional-312000\" DevicePath \"\""

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.029605    6290 scope.go:117] "RemoveContainer" containerID="8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.056866    6290 scope.go:117] "RemoveContainer" containerID="8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: E0829 18:23:48.057363    6290 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b" containerID="8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.057409    6290 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b"} err="failed to get container status \"8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b\": rpc error: code = Unknown desc = Error response from daemon: No such container: 8e1555fd09c1ca495431b11420eab3797e45cd0df5de444374dd3684ea15065b"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.057969    6290 scope.go:117] "RemoveContainer" containerID="c3cd26493d472b2405769ce537c1f25f1190febe2f8dfa29452626c2e2a6cff4"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.058188    6290 scope.go:117] "RemoveContainer" containerID="0650380888a9de102cd52e0446d3e56910d86dfb91e33ee9c1c3a25938ee9bf1"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: E0829 18:23:48.058323    6290 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-zx8nc_default(e04f2ba0-f5ea-43c6-8d83-acd4d77ecd75)\"" pod="default/hello-node-connect-65d86f57f4-zx8nc" podUID="e04f2ba0-f5ea-43c6-8d83-acd4d77ecd75"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: E0829 18:23:48.127864    6290 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="4ab799f4-e2dd-4400-9c43-7f80f2533cc1" containerName="myfrontend"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.127896    6290 memory_manager.go:354] "RemoveStaleState removing state" podUID="4ab799f4-e2dd-4400-9c43-7f80f2533cc1" containerName="myfrontend"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.290819    6290 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5974n\" (UniqueName: \"kubernetes.io/projected/5213967b-8c32-40bb-8deb-86bf6db2c6f3-kube-api-access-5974n\") pod \"sp-pod\" (UID: \"5213967b-8c32-40bb-8deb-86bf6db2c6f3\") " pod="default/sp-pod"

	Aug 29 18:23:48 functional-312000 kubelet[6290]: I0829 18:23:48.290862    6290 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483\" (UniqueName: \"kubernetes.io/host-path/5213967b-8c32-40bb-8deb-86bf6db2c6f3-pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483\") pod \"sp-pod\" (UID: \"5213967b-8c32-40bb-8deb-86bf6db2c6f3\") " pod="default/sp-pod"

	Aug 29 18:23:49 functional-312000 kubelet[6290]: I0829 18:23:49.191160    6290 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab799f4-e2dd-4400-9c43-7f80f2533cc1" path="/var/lib/kubelet/pods/4ab799f4-e2dd-4400-9c43-7f80f2533cc1/volumes"

	Aug 29 18:23:50 functional-312000 kubelet[6290]: I0829 18:23:50.124011    6290 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/sp-pod" podStartSLOduration=1.400602128 podStartE2EDuration="2.123995152s" podCreationTimestamp="2024-08-29 18:23:48 +0000 UTC" firstStartedPulling="2024-08-29 18:23:48.534364692 +0000 UTC m=+57.413493078" lastFinishedPulling="2024-08-29 18:23:49.257757716 +0000 UTC m=+58.136886102" observedRunningTime="2024-08-29 18:23:50.12366515 +0000 UTC m=+59.002793536" watchObservedRunningTime="2024-08-29 18:23:50.123995152 +0000 UTC m=+59.003123538"

	Aug 29 18:23:51 functional-312000 kubelet[6290]: E0829 18:23:51.190439    6290 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 29 18:23:51 functional-312000 kubelet[6290]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 29 18:23:51 functional-312000 kubelet[6290]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 29 18:23:51 functional-312000 kubelet[6290]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 29 18:23:51 functional-312000 kubelet[6290]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 29 18:23:51 functional-312000 kubelet[6290]: I0829 18:23:51.273059    6290 scope.go:117] "RemoveContainer" containerID="05833a52685b892ad67a940f019a22947a3b1173a3e60b9dddd514345d1d025b"

	Aug 29 18:23:52 functional-312000 kubelet[6290]: I0829 18:23:52.185061    6290 scope.go:117] "RemoveContainer" containerID="9863a801f6d1087db6a78952b287d149fe28a6ab704fbadca0da063237ee3617"

	Aug 29 18:23:52 functional-312000 kubelet[6290]: E0829 18:23:52.186071    6290 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-9zv77_default(cd27663d-a0ab-41d3-87b9-2100b179a622)\"" pod="default/hello-node-64b4f8f9ff-9zv77" podUID="cd27663d-a0ab-41d3-87b9-2100b179a622"

	Aug 29 18:23:57 functional-312000 kubelet[6290]: I0829 18:23:57.077773    6290 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/23abc6e1-92eb-40b1-9e2c-44bca706cc5f-test-volume\") pod \"busybox-mount\" (UID: \"23abc6e1-92eb-40b1-9e2c-44bca706cc5f\") " pod="default/busybox-mount"

	Aug 29 18:23:57 functional-312000 kubelet[6290]: I0829 18:23:57.077857    6290 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hff\" (UniqueName: \"kubernetes.io/projected/23abc6e1-92eb-40b1-9e2c-44bca706cc5f-kube-api-access-g6hff\") pod \"busybox-mount\" (UID: \"23abc6e1-92eb-40b1-9e2c-44bca706cc5f\") " pod="default/busybox-mount"

	==> storage-provisioner [488c997d8b28] <==

	I0829 18:22:05.977415       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0829 18:22:05.987447       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0829 18:22:05.987476       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0829 18:22:06.023920       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0829 18:22:06.024070       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-312000_b3aaa8dd-3316-4bc6-bf99-5234aaac8b62!

	I0829 18:22:06.024739       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f5eb3b31-59d8-41f4-8401-65d2c004c771", APIVersion:"v1", ResourceVersion:"451", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-312000_b3aaa8dd-3316-4bc6-bf99-5234aaac8b62 became leader

	I0829 18:22:06.124563       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-312000_b3aaa8dd-3316-4bc6-bf99-5234aaac8b62!

	==> storage-provisioner [a5ea9041885a] <==

	I0829 18:22:55.679964       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0829 18:22:55.705961       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0829 18:22:55.707610       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0829 18:23:13.120375       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0829 18:23:13.121188       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-312000_c6e33e8c-d34c-4262-98de-c61735789796!

	I0829 18:23:13.122535       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f5eb3b31-59d8-41f4-8401-65d2c004c771", APIVersion:"v1", ResourceVersion:"619", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-312000_c6e33e8c-d34c-4262-98de-c61735789796 became leader

	I0829 18:23:13.222352       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-312000_c6e33e8c-d34c-4262-98de-c61735789796!

	I0829 18:23:33.766805       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0829 18:23:33.766834       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    2b4e74d9-1bd7-42c7-a476-17deb26b8503 314 0 2024-08-29 18:21:37 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-08-29 18:21:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  edfe4e00-3b09-4727-a4a8-d3cdbc178483 733 0 2024-08-29 18:23:33 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-08-29 18:23:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-08-29 18:23:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0829 18:23:33.767418       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483" provisioned

	I0829 18:23:33.767440       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0829 18:23:33.767447       1 volume_store.go:212] Trying to save persistentvolume "pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483"

	I0829 18:23:33.767880       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"edfe4e00-3b09-4727-a4a8-d3cdbc178483", APIVersion:"v1", ResourceVersion:"733", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0829 18:23:33.771561       1 volume_store.go:219] persistentvolume "pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483" saved

	I0829 18:23:33.771845       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"edfe4e00-3b09-4727-a4a8-d3cdbc178483", APIVersion:"v1", ResourceVersion:"733", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-edfe4e00-3b09-4727-a4a8-d3cdbc178483

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-312000 -n functional-312000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-312000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-312000 describe pod busybox-mount

helpers_test.go:282: (dbg) kubectl --context functional-312000 describe pod busybox-mount:

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-312000/192.168.105.4

	Start Time:       Thu, 29 Aug 2024 11:23:56 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Pending

	IP:               

	IPs:              <none>

	Containers:

	  mount-munger:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Waiting

	      Reason:       ContainerCreating

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-g6hff (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-g6hff:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  4s    default-scheduler  Successfully assigned default/busybox-mount to functional-312000

	  Normal  Pulling    3s    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

helpers_test.go:285: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (28.68s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 node stop m02 -v=7 --alsologtostderr

ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-692000 node stop m02 -v=7 --alsologtostderr: (12.192440041s)

ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr

E0829 11:29:39.063031    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:31:00.968027    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr: exit status 7 (2m55.973822708s)

-- stdout --

	ha-692000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-692000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-692000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0829 11:29:19.979975    2674 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:29:19.980138    2674 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:29:19.980142    2674 out.go:358] Setting ErrFile to fd 2...

	I0829 11:29:19.980144    2674 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:29:19.980271    2674 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:29:19.980405    2674 out.go:352] Setting JSON to false

	I0829 11:29:19.980416    2674 mustload.go:65] Loading cluster: ha-692000

	I0829 11:29:19.980453    2674 notify.go:220] Checking for updates...

	I0829 11:29:19.980651    2674 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:29:19.980662    2674 status.go:255] checking status of ha-692000 ...

	I0829 11:29:19.981432    2674 status.go:330] ha-692000 host status = "Running" (err=<nil>)

	I0829 11:29:19.981444    2674 host.go:66] Checking if "ha-692000" exists ...

	I0829 11:29:19.981555    2674 host.go:66] Checking if "ha-692000" exists ...

	I0829 11:29:19.981669    2674 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:29:19.981678    2674 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/id_rsa Username:docker}

	W0829 11:29:45.905220    2674 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0829 11:29:45.905354    2674 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0829 11:29:45.905382    2674 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0829 11:29:45.905403    2674 status.go:257] ha-692000 status: &{Name:ha-692000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:29:45.905432    2674 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0829 11:29:45.905441    2674 status.go:255] checking status of ha-692000-m02 ...

	I0829 11:29:45.905787    2674 status.go:330] ha-692000-m02 host status = "Stopped" (err=<nil>)

	I0829 11:29:45.905799    2674 status.go:343] host is not running, skipping remaining checks

	I0829 11:29:45.905803    2674 status.go:257] ha-692000-m02 status: &{Name:ha-692000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:29:45.905810    2674 status.go:255] checking status of ha-692000-m03 ...

	I0829 11:29:45.906800    2674 status.go:330] ha-692000-m03 host status = "Running" (err=<nil>)

	I0829 11:29:45.906810    2674 host.go:66] Checking if "ha-692000-m03" exists ...

	I0829 11:29:45.906940    2674 host.go:66] Checking if "ha-692000-m03" exists ...

	I0829 11:29:45.907066    2674 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:29:45.907075    2674 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m03/id_rsa Username:docker}

	W0829 11:31:00.891294    2674 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0829 11:31:00.891360    2674 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0829 11:31:00.891369    2674 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0829 11:31:00.891373    2674 status.go:257] ha-692000-m03 status: &{Name:ha-692000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:31:00.891385    2674 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0829 11:31:00.891389    2674 status.go:255] checking status of ha-692000-m04 ...

	I0829 11:31:00.892136    2674 status.go:330] ha-692000-m04 host status = "Running" (err=<nil>)

	I0829 11:31:00.892144    2674 host.go:66] Checking if "ha-692000-m04" exists ...

	I0829 11:31:00.892252    2674 host.go:66] Checking if "ha-692000-m04" exists ...

	I0829 11:31:00.892379    2674 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:31:00.892385    2674 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m04/id_rsa Username:docker}

	W0829 11:32:15.893193    2674 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0829 11:32:15.893245    2674 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0829 11:32:15.893254    2674 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0829 11:32:15.893259    2674 status.go:257] ha-692000-m04 status: &{Name:ha-692000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:32:15.893267    2674 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-692000-m04

type: Worker

host: Error

kubelet: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 3 (25.954446209s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0829 11:32:41.847743    3027 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0829 11:32:41.847758    3027 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (214.12s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

E0829 11:33:17.080172    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:33:32.559756    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:33:44.807068    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m18.800205458s)

ha_test.go:413: expected profile "ha-692000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-692000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-692000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-692000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\

":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docke

r\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 3 (25.985396458s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0829 11:34:26.629732    3063 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0829 11:34:26.629763    3063 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (104.79s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 node start m02 -v=7 --alsologtostderr

ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.123580625s)

-- stdout --

	* Starting "ha-692000-m02" control-plane node in "ha-692000" cluster

	* Restarting existing qemu2 VM for "ha-692000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-692000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 11:34:26.690093    3070 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:34:26.690404    3070 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:34:26.690410    3070 out.go:358] Setting ErrFile to fd 2...

	I0829 11:34:26.690413    3070 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:34:26.690560    3070 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:34:26.690867    3070 mustload.go:65] Loading cluster: ha-692000

	I0829 11:34:26.691164    3070 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0829 11:34:26.691482    3070 host.go:58] "ha-692000-m02" host status: Stopped

	I0829 11:34:26.695049    3070 out.go:177] * Starting "ha-692000-m02" control-plane node in "ha-692000" cluster

	I0829 11:34:26.699838    3070 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:34:26.699859    3070 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:34:26.699867    3070 cache.go:56] Caching tarball of preloaded images

	I0829 11:34:26.699959    3070 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:34:26.699966    3070 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:34:26.700029    3070 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/ha-692000/config.json ...

	I0829 11:34:26.700444    3070 start.go:360] acquireMachinesLock for ha-692000-m02: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:34:26.700497    3070 start.go:364] duration metric: took 34.708µs to acquireMachinesLock for "ha-692000-m02"

	I0829 11:34:26.700506    3070 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:34:26.700512    3070 fix.go:54] fixHost starting: m02

	I0829 11:34:26.700659    3070 fix.go:112] recreateIfNeeded on ha-692000-m02: state=Stopped err=<nil>

	W0829 11:34:26.700665    3070 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:34:26.704008    3070 out.go:177] * Restarting existing qemu2 VM for "ha-692000-m02" ...

	I0829 11:34:26.707853    3070 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:34:26.707905    3070 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:70:88:5c:14:6f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/disk.qcow2

	I0829 11:34:26.710660    3070 main.go:141] libmachine: STDOUT: 

	I0829 11:34:26.710683    3070 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:34:26.710714    3070 fix.go:56] duration metric: took 10.201375ms for fixHost

	I0829 11:34:26.710718    3070 start.go:83] releasing machines lock for "ha-692000-m02", held for 10.21625ms

	W0829 11:34:26.710726    3070 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:34:26.710766    3070 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:34:26.710769    3070 start.go:729] Will try again in 5 seconds ...

	I0829 11:34:31.712855    3070 start.go:360] acquireMachinesLock for ha-692000-m02: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:34:31.713583    3070 start.go:364] duration metric: took 570.541µs to acquireMachinesLock for "ha-692000-m02"

	I0829 11:34:31.713854    3070 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:34:31.713878    3070 fix.go:54] fixHost starting: m02

	I0829 11:34:31.714693    3070 fix.go:112] recreateIfNeeded on ha-692000-m02: state=Stopped err=<nil>

	W0829 11:34:31.714717    3070 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:34:31.719638    3070 out.go:177] * Restarting existing qemu2 VM for "ha-692000-m02" ...

	I0829 11:34:31.723459    3070 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:34:31.723664    3070 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:70:88:5c:14:6f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/disk.qcow2

	I0829 11:34:31.731512    3070 main.go:141] libmachine: STDOUT: 

	I0829 11:34:31.731577    3070 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:34:31.731669    3070 fix.go:56] duration metric: took 17.795625ms for fixHost

	I0829 11:34:31.731687    3070 start.go:83] releasing machines lock for "ha-692000-m02", held for 18.012709ms

	W0829 11:34:31.731857    3070 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:34:31.736622    3070 out.go:201] 

	W0829 11:34:31.740716    3070 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:34:31.740735    3070 out.go:270] * 

	* 

	W0829 11:34:31.746547    3070 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:34:31.750556    3070 out.go:201] 

** /stderr **

ha_test.go:422: I0829 11:34:26.690093    3070 out.go:345] Setting OutFile to fd 1 ...

I0829 11:34:26.690404    3070 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0829 11:34:26.690410    3070 out.go:358] Setting ErrFile to fd 2...

I0829 11:34:26.690413    3070 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0829 11:34:26.690560    3070 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

I0829 11:34:26.690867    3070 mustload.go:65] Loading cluster: ha-692000

I0829 11:34:26.691164    3070 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

W0829 11:34:26.691482    3070 host.go:58] "ha-692000-m02" host status: Stopped

I0829 11:34:26.695049    3070 out.go:177] * Starting "ha-692000-m02" control-plane node in "ha-692000" cluster

I0829 11:34:26.699838    3070 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

I0829 11:34:26.699859    3070 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

I0829 11:34:26.699867    3070 cache.go:56] Caching tarball of preloaded images

I0829 11:34:26.699959    3070 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

I0829 11:34:26.699966    3070 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

I0829 11:34:26.700029    3070 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/ha-692000/config.json ...

I0829 11:34:26.700444    3070 start.go:360] acquireMachinesLock for ha-692000-m02: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0829 11:34:26.700497    3070 start.go:364] duration metric: took 34.708µs to acquireMachinesLock for "ha-692000-m02"

I0829 11:34:26.700506    3070 start.go:96] Skipping create...Using existing machine configuration

I0829 11:34:26.700512    3070 fix.go:54] fixHost starting: m02

I0829 11:34:26.700659    3070 fix.go:112] recreateIfNeeded on ha-692000-m02: state=Stopped err=<nil>

W0829 11:34:26.700665    3070 fix.go:138] unexpected machine state, will restart: <nil>

I0829 11:34:26.704008    3070 out.go:177] * Restarting existing qemu2 VM for "ha-692000-m02" ...

I0829 11:34:26.707853    3070 qemu.go:418] Using hvf for hardware acceleration

I0829 11:34:26.707905    3070 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:70:88:5c:14:6f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/disk.qcow2

I0829 11:34:26.710660    3070 main.go:141] libmachine: STDOUT: 

I0829 11:34:26.710683    3070 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0829 11:34:26.710714    3070 fix.go:56] duration metric: took 10.201375ms for fixHost

I0829 11:34:26.710718    3070 start.go:83] releasing machines lock for "ha-692000-m02", held for 10.21625ms

W0829 11:34:26.710726    3070 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0829 11:34:26.710766    3070 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0829 11:34:26.710769    3070 start.go:729] Will try again in 5 seconds ...

I0829 11:34:31.712855    3070 start.go:360] acquireMachinesLock for ha-692000-m02: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0829 11:34:31.713583    3070 start.go:364] duration metric: took 570.541µs to acquireMachinesLock for "ha-692000-m02"

I0829 11:34:31.713854    3070 start.go:96] Skipping create...Using existing machine configuration

I0829 11:34:31.713878    3070 fix.go:54] fixHost starting: m02

I0829 11:34:31.714693    3070 fix.go:112] recreateIfNeeded on ha-692000-m02: state=Stopped err=<nil>

W0829 11:34:31.714717    3070 fix.go:138] unexpected machine state, will restart: <nil>

I0829 11:34:31.719638    3070 out.go:177] * Restarting existing qemu2 VM for "ha-692000-m02" ...

I0829 11:34:31.723459    3070 qemu.go:418] Using hvf for hardware acceleration

I0829 11:34:31.723664    3070 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:70:88:5c:14:6f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m02/disk.qcow2

I0829 11:34:31.731512    3070 main.go:141] libmachine: STDOUT: 

I0829 11:34:31.731577    3070 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0829 11:34:31.731669    3070 fix.go:56] duration metric: took 17.795625ms for fixHost

I0829 11:34:31.731687    3070 start.go:83] releasing machines lock for "ha-692000-m02", held for 18.012709ms

W0829 11:34:31.731857    3070 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

* Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0829 11:34:31.736622    3070 out.go:201] 

W0829 11:34:31.740716    3070 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0829 11:34:31.740735    3070 out.go:270] * 

* 

W0829 11:34:31.746547    3070 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0829 11:34:31.750556    3070 out.go:201] 

ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-692000 node start m02 -v=7 --alsologtostderr": exit status 80

ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr: exit status 7 (2m57.852152125s)

-- stdout --

	ha-692000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-692000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-692000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0829 11:34:31.810319    3074 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:34:31.810742    3074 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:34:31.810748    3074 out.go:358] Setting ErrFile to fd 2...

	I0829 11:34:31.810751    3074 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:34:31.810961    3074 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:34:31.811142    3074 out.go:352] Setting JSON to false

	I0829 11:34:31.811154    3074 mustload.go:65] Loading cluster: ha-692000

	I0829 11:34:31.811330    3074 notify.go:220] Checking for updates...

	I0829 11:34:31.811695    3074 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:34:31.811707    3074 status.go:255] checking status of ha-692000 ...

	I0829 11:34:31.812544    3074 status.go:330] ha-692000 host status = "Running" (err=<nil>)

	I0829 11:34:31.812557    3074 host.go:66] Checking if "ha-692000" exists ...

	I0829 11:34:31.812676    3074 host.go:66] Checking if "ha-692000" exists ...

	I0829 11:34:31.812808    3074 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:34:31.812817    3074 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/id_rsa Username:docker}

	W0829 11:34:31.813020    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:31.813040    3074 retry.go:31] will retry after 167.350217ms: dial tcp 192.168.105.5:22: connect: host is down

	W0829 11:34:31.980645    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:31.980686    3074 retry.go:31] will retry after 485.698779ms: dial tcp 192.168.105.5:22: connect: host is down

	W0829 11:34:32.468539    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:32.468559    3074 retry.go:31] will retry after 767.804906ms: dial tcp 192.168.105.5:22: connect: host is down

	W0829 11:34:33.238512    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:33.238565    3074 retry.go:31] will retry after 129.102575ms: new client: new client: dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:33.369734    3074 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/id_rsa Username:docker}

	W0829 11:34:33.369994    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0829 11:34:33.370007    3074 retry.go:31] will retry after 307.929187ms: dial tcp 192.168.105.5:22: connect: host is down

	W0829 11:34:59.598310    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0829 11:34:59.598368    3074 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0829 11:34:59.598377    3074 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0829 11:34:59.598381    3074 status.go:257] ha-692000 status: &{Name:ha-692000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:34:59.598392    3074 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0829 11:34:59.598396    3074 status.go:255] checking status of ha-692000-m02 ...

	I0829 11:34:59.598630    3074 status.go:330] ha-692000-m02 host status = "Stopped" (err=<nil>)

	I0829 11:34:59.598637    3074 status.go:343] host is not running, skipping remaining checks

	I0829 11:34:59.598639    3074 status.go:257] ha-692000-m02 status: &{Name:ha-692000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:34:59.598644    3074 status.go:255] checking status of ha-692000-m03 ...

	I0829 11:34:59.599363    3074 status.go:330] ha-692000-m03 host status = "Running" (err=<nil>)

	I0829 11:34:59.599372    3074 host.go:66] Checking if "ha-692000-m03" exists ...

	I0829 11:34:59.599498    3074 host.go:66] Checking if "ha-692000-m03" exists ...

	I0829 11:34:59.599628    3074 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:34:59.599635    3074 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m03/id_rsa Username:docker}

	W0829 11:36:14.601328    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0829 11:36:14.601370    3074 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0829 11:36:14.601378    3074 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0829 11:36:14.601382    3074 status.go:257] ha-692000-m03 status: &{Name:ha-692000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:36:14.601392    3074 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0829 11:36:14.601395    3074 status.go:255] checking status of ha-692000-m04 ...

	I0829 11:36:14.602397    3074 status.go:330] ha-692000-m04 host status = "Running" (err=<nil>)

	I0829 11:36:14.602404    3074 host.go:66] Checking if "ha-692000-m04" exists ...

	I0829 11:36:14.602493    3074 host.go:66] Checking if "ha-692000-m04" exists ...

	I0829 11:36:14.602605    3074 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0829 11:36:14.602612    3074 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000-m04/id_rsa Username:docker}

	W0829 11:37:29.602787    3074 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0829 11:37:29.602969    3074 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0829 11:37:29.603013    3074 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0829 11:37:29.603036    3074 status.go:257] ha-692000-m04 status: &{Name:ha-692000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0829 11:37:29.603091    3074 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 3 (25.992020833s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0829 11:37:55.595425    3115 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0829 11:37:55.595530    3115 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (208.97s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-692000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-692000 -v=7 --alsologtostderr

E0829 11:39:55.644304    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:43:17.071908    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

E0829 11:43:32.551380    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-692000 -v=7 --alsologtostderr: (4m38.087878084s)

ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-692000 --wait=true -v=7 --alsologtostderr

ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-692000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.222080167s)

-- stdout --

	* [ha-692000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-692000" primary control-plane node in "ha-692000" cluster

	* Restarting existing qemu2 VM for "ha-692000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-692000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 11:43:53.857866    3235 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:43:53.858059    3235 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:53.858064    3235 out.go:358] Setting ErrFile to fd 2...

	I0829 11:43:53.858067    3235 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:53.858246    3235 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:43:53.859615    3235 out.go:352] Setting JSON to false

	I0829 11:43:53.879492    3235 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2597,"bootTime":1724954436,"procs":463,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:43:53.879566    3235 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:43:53.883641    3235 out.go:177] * [ha-692000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:43:53.890565    3235 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:43:53.890632    3235 notify.go:220] Checking for updates...

	I0829 11:43:53.898479    3235 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:43:53.902557    3235 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:43:53.905501    3235 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:43:53.908540    3235 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:43:53.911569    3235 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:43:53.913274    3235 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:43:53.913331    3235 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:43:53.917497    3235 out.go:177] * Using the qemu2 driver based on existing profile

	I0829 11:43:53.924388    3235 start.go:297] selected driver: qemu2

	I0829 11:43:53.924394    3235 start.go:901] validating driver "qemu2" against &{Name:ha-692000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-692000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:

false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mou

nt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:43:53.924463    3235 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:43:53.927423    3235 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:43:53.927473    3235 cni.go:84] Creating CNI manager for ""

	I0829 11:43:53.927479    3235 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0829 11:43:53.927526    3235 start.go:340] cluster config:

	{Name:ha-692000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-692000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:43:53.932096    3235 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:43:53.940571    3235 out.go:177] * Starting "ha-692000" primary control-plane node in "ha-692000" cluster

	I0829 11:43:53.944575    3235 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:43:53.944595    3235 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:43:53.944605    3235 cache.go:56] Caching tarball of preloaded images

	I0829 11:43:53.944675    3235 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:43:53.944682    3235 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:43:53.944770    3235 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/ha-692000/config.json ...

	I0829 11:43:53.945291    3235 start.go:360] acquireMachinesLock for ha-692000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:43:53.945331    3235 start.go:364] duration metric: took 33.667µs to acquireMachinesLock for "ha-692000"

	I0829 11:43:53.945341    3235 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:43:53.945346    3235 fix.go:54] fixHost starting: 

	I0829 11:43:53.945478    3235 fix.go:112] recreateIfNeeded on ha-692000: state=Stopped err=<nil>

	W0829 11:43:53.945487    3235 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:43:53.949593    3235 out.go:177] * Restarting existing qemu2 VM for "ha-692000" ...

	I0829 11:43:53.957527    3235 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:43:53.957573    3235 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:5f:87:92:d7:5c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/disk.qcow2

	I0829 11:43:53.959633    3235 main.go:141] libmachine: STDOUT: 

	I0829 11:43:53.959658    3235 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:43:53.959699    3235 fix.go:56] duration metric: took 14.351209ms for fixHost

	I0829 11:43:53.959704    3235 start.go:83] releasing machines lock for "ha-692000", held for 14.368041ms

	W0829 11:43:53.959712    3235 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:43:53.959747    3235 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:43:53.959753    3235 start.go:729] Will try again in 5 seconds ...

	I0829 11:43:58.961935    3235 start.go:360] acquireMachinesLock for ha-692000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:43:58.962340    3235 start.go:364] duration metric: took 290.708µs to acquireMachinesLock for "ha-692000"

	I0829 11:43:58.962467    3235 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:43:58.962485    3235 fix.go:54] fixHost starting: 

	I0829 11:43:58.963142    3235 fix.go:112] recreateIfNeeded on ha-692000: state=Stopped err=<nil>

	W0829 11:43:58.963169    3235 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:43:58.971595    3235 out.go:177] * Restarting existing qemu2 VM for "ha-692000" ...

	I0829 11:43:58.974586    3235 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:43:58.974861    3235 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:5f:87:92:d7:5c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/disk.qcow2

	I0829 11:43:58.983413    3235 main.go:141] libmachine: STDOUT: 

	I0829 11:43:58.983469    3235 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:43:58.983536    3235 fix.go:56] duration metric: took 21.051542ms for fixHost

	I0829 11:43:58.983551    3235 start.go:83] releasing machines lock for "ha-692000", held for 21.18675ms

	W0829 11:43:58.983736    3235 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:43:58.990592    3235 out.go:201] 

	W0829 11:43:58.994659    3235 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:43:58.994682    3235 out.go:270] * 

	* 

	W0829 11:43:58.997067    3235 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:43:59.004581    3235 out.go:201] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-692000 -v=7 --alsologtostderr" : exit status 80

ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-692000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (32.509916ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (283.48s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 node delete m03 -v=7 --alsologtostderr: exit status 83 (39.982292ms)

-- stdout --

	* The control-plane node ha-692000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-692000"

-- /stdout --

** stderr ** 

	I0829 11:43:59.145107    3247 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:43:59.145347    3247 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:59.145350    3247 out.go:358] Setting ErrFile to fd 2...

	I0829 11:43:59.145352    3247 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:59.145476    3247 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:43:59.145707    3247 mustload.go:65] Loading cluster: ha-692000

	I0829 11:43:59.145909    3247 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0829 11:43:59.146205    3247 out.go:270] ! The control-plane node ha-692000 host is not running (will try others): state=Stopped

	! The control-plane node ha-692000 host is not running (will try others): state=Stopped

	W0829 11:43:59.146320    3247 out.go:270] ! The control-plane node ha-692000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-692000-m02 host is not running (will try others): state=Stopped

	I0829 11:43:59.150366    3247 out.go:177] * The control-plane node ha-692000-m03 host is not running: state=Stopped

	I0829 11:43:59.153397    3247 out.go:177]   To start a cluster, run: "minikube start -p ha-692000"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-692000 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr: exit status 7 (29.516541ms)

-- stdout --

	ha-692000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0829 11:43:59.184832    3249 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:43:59.184961    3249 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:59.184964    3249 out.go:358] Setting ErrFile to fd 2...

	I0829 11:43:59.184967    3249 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:43:59.185089    3249 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:43:59.185201    3249 out.go:352] Setting JSON to false

	I0829 11:43:59.185211    3249 mustload.go:65] Loading cluster: ha-692000

	I0829 11:43:59.185273    3249 notify.go:220] Checking for updates...

	I0829 11:43:59.185429    3249 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:43:59.185437    3249 status.go:255] checking status of ha-692000 ...

	I0829 11:43:59.185653    3249 status.go:330] ha-692000 host status = "Stopped" (err=<nil>)

	I0829 11:43:59.185657    3249 status.go:343] host is not running, skipping remaining checks

	I0829 11:43:59.185659    3249 status.go:257] ha-692000 status: &{Name:ha-692000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:43:59.185669    3249 status.go:255] checking status of ha-692000-m02 ...

	I0829 11:43:59.185756    3249 status.go:330] ha-692000-m02 host status = "Stopped" (err=<nil>)

	I0829 11:43:59.185759    3249 status.go:343] host is not running, skipping remaining checks

	I0829 11:43:59.185761    3249 status.go:257] ha-692000-m02 status: &{Name:ha-692000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:43:59.185765    3249 status.go:255] checking status of ha-692000-m03 ...

	I0829 11:43:59.185856    3249 status.go:330] ha-692000-m03 host status = "Stopped" (err=<nil>)

	I0829 11:43:59.185858    3249 status.go:343] host is not running, skipping remaining checks

	I0829 11:43:59.185860    3249 status.go:257] ha-692000-m03 status: &{Name:ha-692000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:43:59.185864    3249 status.go:255] checking status of ha-692000-m04 ...

	I0829 11:43:59.185955    3249 status.go:330] ha-692000-m04 host status = "Stopped" (err=<nil>)

	I0829 11:43:59.185958    3249 status.go:343] host is not running, skipping remaining checks

	I0829 11:43:59.185960    3249 status.go:257] ha-692000-m04 status: &{Name:ha-692000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (29.9195ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1.005799083s)

ha_test.go:413: expected profile "ha-692000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-692000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-692000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-692000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (59.437584ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (1.07s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 stop -v=7 --alsologtostderr

E0829 11:44:40.161544    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/functional-312000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-692000 stop -v=7 --alsologtostderr: (4m11.056959209s)

ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr: exit status 7 (69.527959ms)

-- stdout --

	ha-692000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-692000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0829 11:48:11.403298    3349 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:48:11.403512    3349 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:11.403516    3349 out.go:358] Setting ErrFile to fd 2...

	I0829 11:48:11.403519    3349 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:11.403680    3349 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:48:11.403832    3349 out.go:352] Setting JSON to false

	I0829 11:48:11.403845    3349 mustload.go:65] Loading cluster: ha-692000

	I0829 11:48:11.403884    3349 notify.go:220] Checking for updates...

	I0829 11:48:11.404139    3349 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:48:11.404152    3349 status.go:255] checking status of ha-692000 ...

	I0829 11:48:11.404462    3349 status.go:330] ha-692000 host status = "Stopped" (err=<nil>)

	I0829 11:48:11.404467    3349 status.go:343] host is not running, skipping remaining checks

	I0829 11:48:11.404470    3349 status.go:257] ha-692000 status: &{Name:ha-692000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:48:11.404483    3349 status.go:255] checking status of ha-692000-m02 ...

	I0829 11:48:11.404618    3349 status.go:330] ha-692000-m02 host status = "Stopped" (err=<nil>)

	I0829 11:48:11.404623    3349 status.go:343] host is not running, skipping remaining checks

	I0829 11:48:11.404626    3349 status.go:257] ha-692000-m02 status: &{Name:ha-692000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:48:11.404632    3349 status.go:255] checking status of ha-692000-m03 ...

	I0829 11:48:11.404760    3349 status.go:330] ha-692000-m03 host status = "Stopped" (err=<nil>)

	I0829 11:48:11.404766    3349 status.go:343] host is not running, skipping remaining checks

	I0829 11:48:11.404769    3349 status.go:257] ha-692000-m03 status: &{Name:ha-692000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0829 11:48:11.404773    3349 status.go:255] checking status of ha-692000-m04 ...

	I0829 11:48:11.404906    3349 status.go:330] ha-692000-m04 host status = "Stopped" (err=<nil>)

	I0829 11:48:11.404910    3349 status.go:343] host is not running, skipping remaining checks

	I0829 11:48:11.404912    3349 status.go:257] ha-692000-m04 status: &{Name:ha-692000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-692000 status -v=7 --alsologtostderr": ha-692000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-692000-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (32.753208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (251.16s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-692000 --wait=true -v=7 --alsologtostderr --driver=qemu2 

ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-692000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.180278583s)

-- stdout --

	* [ha-692000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-692000" primary control-plane node in "ha-692000" cluster

	* Restarting existing qemu2 VM for "ha-692000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-692000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 11:48:11.466830    3353 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:48:11.466954    3353 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:11.466957    3353 out.go:358] Setting ErrFile to fd 2...

	I0829 11:48:11.466959    3353 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:11.467107    3353 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:48:11.468172    3353 out.go:352] Setting JSON to false

	I0829 11:48:11.484356    3353 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2855,"bootTime":1724954436,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:48:11.484420    3353 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:48:11.489997    3353 out.go:177] * [ha-692000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:48:11.497002    3353 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:48:11.497039    3353 notify.go:220] Checking for updates...

	I0829 11:48:11.504964    3353 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:48:11.507959    3353 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:48:11.511973    3353 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:48:11.515017    3353 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:48:11.517930    3353 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:48:11.521301    3353 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0829 11:48:11.521599    3353 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:48:11.526001    3353 out.go:177] * Using the qemu2 driver based on existing profile

	I0829 11:48:11.532972    3353 start.go:297] selected driver: qemu2

	I0829 11:48:11.532980    3353 start.go:901] validating driver "qemu2" against &{Name:ha-692000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-692000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storage

class:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho

st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:48:11.533100    3353 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:48:11.535541    3353 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:48:11.535594    3353 cni.go:84] Creating CNI manager for ""

	I0829 11:48:11.535600    3353 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0829 11:48:11.535659    3353 start.go:340] cluster config:

	{Name:ha-692000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-692000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:48:11.539373    3353 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:48:11.547956    3353 out.go:177] * Starting "ha-692000" primary control-plane node in "ha-692000" cluster

	I0829 11:48:11.551931    3353 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:48:11.551949    3353 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:48:11.551964    3353 cache.go:56] Caching tarball of preloaded images

	I0829 11:48:11.552020    3353 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:48:11.552025    3353 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:48:11.552099    3353 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/ha-692000/config.json ...

	I0829 11:48:11.552573    3353 start.go:360] acquireMachinesLock for ha-692000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:48:11.552610    3353 start.go:364] duration metric: took 29.959µs to acquireMachinesLock for "ha-692000"

	I0829 11:48:11.552618    3353 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:48:11.552625    3353 fix.go:54] fixHost starting: 

	I0829 11:48:11.552749    3353 fix.go:112] recreateIfNeeded on ha-692000: state=Stopped err=<nil>

	W0829 11:48:11.552757    3353 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:48:11.555973    3353 out.go:177] * Restarting existing qemu2 VM for "ha-692000" ...

	I0829 11:48:11.563858    3353 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:48:11.563900    3353 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:5f:87:92:d7:5c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/disk.qcow2

	I0829 11:48:11.566086    3353 main.go:141] libmachine: STDOUT: 

	I0829 11:48:11.566106    3353 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:48:11.566134    3353 fix.go:56] duration metric: took 13.510666ms for fixHost

	I0829 11:48:11.566138    3353 start.go:83] releasing machines lock for "ha-692000", held for 13.524042ms

	W0829 11:48:11.566145    3353 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:48:11.566176    3353 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:48:11.566181    3353 start.go:729] Will try again in 5 seconds ...

	I0829 11:48:16.567450    3353 start.go:360] acquireMachinesLock for ha-692000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:48:16.567922    3353 start.go:364] duration metric: took 364.458µs to acquireMachinesLock for "ha-692000"

	I0829 11:48:16.568064    3353 start.go:96] Skipping create...Using existing machine configuration

	I0829 11:48:16.568081    3353 fix.go:54] fixHost starting: 

	I0829 11:48:16.568755    3353 fix.go:112] recreateIfNeeded on ha-692000: state=Stopped err=<nil>

	W0829 11:48:16.568778    3353 fix.go:138] unexpected machine state, will restart: <nil>

	I0829 11:48:16.571056    3353 out.go:177] * Restarting existing qemu2 VM for "ha-692000" ...

	I0829 11:48:16.579336    3353 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:48:16.579534    3353 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:5f:87:92:d7:5c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/ha-692000/disk.qcow2

	I0829 11:48:16.587474    3353 main.go:141] libmachine: STDOUT: 

	I0829 11:48:16.587538    3353 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:48:16.587630    3353 fix.go:56] duration metric: took 19.552125ms for fixHost

	I0829 11:48:16.587646    3353 start.go:83] releasing machines lock for "ha-692000", held for 19.702ms

	W0829 11:48:16.587813    3353 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-692000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:48:16.595210    3353 out.go:201] 

	W0829 11:48:16.599206    3353 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:48:16.599237    3353 out.go:270] * 

	* 

	W0829 11:48:16.600859    3353 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:48:16.608140    3353 out.go:201] 

** /stderr **

ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-692000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (61.652125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.24s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-692000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-692000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-692000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-692000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (29.239042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

=== RUN   TestMultiControlPlane/serial/AddSecondaryNode

ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-692000 --control-plane -v=7 --alsologtostderr

ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-692000 --control-plane -v=7 --alsologtostderr: exit status 83 (41.36175ms)

-- stdout --

	* The control-plane node ha-692000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-692000"

-- /stdout --

** stderr ** 

	I0829 11:48:16.788053    3369 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:48:16.788212    3369 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:16.788215    3369 out.go:358] Setting ErrFile to fd 2...

	I0829 11:48:16.788217    3369 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:48:16.788336    3369 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:48:16.788582    3369 mustload.go:65] Loading cluster: ha-692000

	I0829 11:48:16.788788    3369 config.go:182] Loaded profile config "ha-692000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0829 11:48:16.789096    3369 out.go:270] ! The control-plane node ha-692000 host is not running (will try others): state=Stopped

	! The control-plane node ha-692000 host is not running (will try others): state=Stopped

	W0829 11:48:16.789222    3369 out.go:270] ! The control-plane node ha-692000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-692000-m02 host is not running (will try others): state=Stopped

	I0829 11:48:16.792414    3369 out.go:177] * The control-plane node ha-692000-m03 host is not running: state=Stopped

	I0829 11:48:16.796383    3369 out.go:177]   To start a cluster, run: "minikube start -p ha-692000"

** /stderr **

ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-692000 --control-plane -v=7 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-692000 -n ha-692000: exit status 7 (30.047083ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-692000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.07s)

=== RUN   TestImageBuild/serial/Setup

image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-192000 --driver=qemu2 

image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-192000 --driver=qemu2 : exit status 80 (9.867055s)

-- stdout --

	* [image-192000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "image-192000" primary control-plane node in "image-192000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "image-192000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p image-192000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-192000 --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-192000 -n image-192000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-192000 -n image-192000: exit status 7 (69.874167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "image-192000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestImageBuild/serial/Setup (9.94s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-526000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

E0829 11:48:32.547299    1418 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/addons-048000/client.crt: no such file or directory" logger="UnhandledError"

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-526000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.81193925s)

-- stdout --

	{"specversion":"1.0","id":"be670617-6529-4922-9af6-8d1cb2957d83","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-526000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"42485a51-3dea-4de4-b927-0a3e3021df47","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19531"}}

	{"specversion":"1.0","id":"a131a2a4-a31b-41a1-936b-8e9d1ad0c121","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig"}}

	{"specversion":"1.0","id":"418b0252-eab7-43a2-98d5-b90343096f3c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"63b89afe-8da2-42d2-8617-a99724b1383e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"b24bb176-4a14-44b0-a292-9e7bfb0293a2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube"}}

	{"specversion":"1.0","id":"2802d38f-e145-4d1d-b125-883dcdb20001","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"05f9496a-51cc-4f49-8c85-c161e78b03b2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"8fac5a67-9182-46d5-ac77-01624987de2a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"cc3066b4-2e5d-41a3-9059-9c0943e4e94b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-526000\" primary control-plane node in \"json-output-526000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"a465d0fb-0889-4b1c-8168-4603fc1fb206","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"441e3e4f-675d-4266-a0af-02e5d5acae50","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-526000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"5bbcce24-4e35-43bd-99e7-be1bd246743f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"b3438cfb-61e4-4b60-9e5a-cd615d1b8f89","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"2748a852-044f-433b-9ff5-2936181f24c5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-526000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"410e6506-b6d8-4837-ac26-38d94d69c225","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}

	{"specversion":"1.0","id":"04d25d5a-d43f-47ba-a689-18049aa1d3e9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-526000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80

json_output_test.go:213: unable to marshal output: OUTPUT: 

json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value

--- FAIL: TestJSONOutput/start/Command (9.81s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-526000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-526000 --output=json --user=testUser: exit status 83 (76.856917ms)

-- stdout --

	{"specversion":"1.0","id":"15c7223e-3321-486d-9b9f-5d683214f84a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-526000 host is not running: state=Stopped"}}

	{"specversion":"1.0","id":"3e1143f7-6d74-4744-aa06-7f5608c87e01","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-526000\""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-526000 --output=json --user=testUser": exit status 83

--- FAIL: TestJSONOutput/pause/Command (0.08s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-526000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-526000 --output=json --user=testUser: exit status 83 (44.372083ms)

-- stdout --

	* The control-plane node json-output-526000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p json-output-526000"

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-526000 --output=json --user=testUser": exit status 83

json_output_test.go:213: unable to marshal output: * The control-plane node json-output-526000 host is not running: state=Stopped

json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value

--- FAIL: TestJSONOutput/unpause/Command (0.04s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-554000 --driver=qemu2 

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-554000 --driver=qemu2 : exit status 80 (9.922582917s)

-- stdout --

	* [first-554000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "first-554000" primary control-plane node in "first-554000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "first-554000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p first-554000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-554000 --driver=qemu2 ": exit status 80

panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-29 11:48:51.026562 -0700 PDT m=+2655.970493751

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-556000 -n second-556000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-556000 -n second-556000: exit status 85 (88.072834ms)

-- stdout --

	* Profile "second-556000" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p second-556000"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "second-556000" host is not running, skipping log retrieval (state="* Profile \"second-556000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-556000\"")

helpers_test.go:175: Cleaning up "second-556000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-556000

panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-29 11:48:51.219526 -0700 PDT m=+2656.163460876

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-554000 -n first-554000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-554000 -n first-554000: exit status 7 (29.843292ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "first-554000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "first-554000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-554000

--- FAIL: TestMinikubeProfile (10.22s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-636000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-636000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.960774625s)

-- stdout --

	* [mount-start-1-636000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-636000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-636000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-636000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-636000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-636000 -n mount-start-1-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-636000 -n mount-start-1-636000: exit status 7 (67.533042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-636000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.03s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-531000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-531000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (10.106186458s)

-- stdout --

	* [multinode-531000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19531

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-531000" primary control-plane node in "multinode-531000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-531000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0829 11:49:01.562285    3522 out.go:345] Setting OutFile to fd 1 ...

	I0829 11:49:01.562412    3522 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:49:01.562416    3522 out.go:358] Setting ErrFile to fd 2...

	I0829 11:49:01.562418    3522 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0829 11:49:01.562538    3522 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19531-965/.minikube/bin

	I0829 11:49:01.563628    3522 out.go:352] Setting JSON to false

	I0829 11:49:01.579690    3522 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2905,"bootTime":1724954436,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0829 11:49:01.579762    3522 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0829 11:49:01.586888    3522 out.go:177] * [multinode-531000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0829 11:49:01.595722    3522 out.go:177]   - MINIKUBE_LOCATION=19531

	I0829 11:49:01.595765    3522 notify.go:220] Checking for updates...

	I0829 11:49:01.600738    3522 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19531-965/kubeconfig

	I0829 11:49:01.603701    3522 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0829 11:49:01.606712    3522 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0829 11:49:01.609681    3522 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19531-965/.minikube

	I0829 11:49:01.612653    3522 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0829 11:49:01.615932    3522 driver.go:392] Setting default libvirt URI to qemu:///system

	I0829 11:49:01.620665    3522 out.go:177] * Using the qemu2 driver based on user configuration

	I0829 11:49:01.627722    3522 start.go:297] selected driver: qemu2

	I0829 11:49:01.627730    3522 start.go:901] validating driver "qemu2" against <nil>

	I0829 11:49:01.627749    3522 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0829 11:49:01.630091    3522 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0829 11:49:01.632666    3522 out.go:177] * Automatically selected the socket_vmnet network

	I0829 11:49:01.635760    3522 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0829 11:49:01.635780    3522 cni.go:84] Creating CNI manager for ""

	I0829 11:49:01.635786    3522 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0829 11:49:01.635791    3522 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0829 11:49:01.635831    3522 start.go:340] cluster config:

	{Name:multinode-531000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-531000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm

net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0829 11:49:01.639620    3522 iso.go:125] acquiring lock: {Name:mke1867919ff797f263eb38fb348ce00bba9d753 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0829 11:49:01.645672    3522 out.go:177] * Starting "multinode-531000" primary control-plane node in "multinode-531000" cluster

	I0829 11:49:01.649685    3522 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0829 11:49:01.649698    3522 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0829 11:49:01.649710    3522 cache.go:56] Caching tarball of preloaded images

	I0829 11:49:01.649770    3522 preload.go:172] Found /Users/jenkins/minikube-integration/19531-965/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0829 11:49:01.649776    3522 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0829 11:49:01.649975    3522 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/multinode-531000/config.json ...

	I0829 11:49:01.649986    3522 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19531-965/.minikube/profiles/multinode-531000/config.json: {Name:mkc1529d415aae4c4886265867b2de5e881e8d22 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0829 11:49:01.650238    3522 start.go:360] acquireMachinesLock for multinode-531000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:49:01.650274    3522 start.go:364] duration metric: took 30µs to acquireMachinesLock for "multinode-531000"

	I0829 11:49:01.650288    3522 start.go:93] Provisioning new machine with config: &{Name:multinode-531000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-531000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:49:01.650319    3522 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 11:49:01.658658    3522 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0829 11:49:01.676816    3522 start.go:159] libmachine.API.Create for "multinode-531000" (driver="qemu2")

	I0829 11:49:01.676844    3522 client.go:168] LocalClient.Create starting

	I0829 11:49:01.676912    3522 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 11:49:01.676941    3522 main.go:141] libmachine: Decoding PEM data...

	I0829 11:49:01.676950    3522 main.go:141] libmachine: Parsing certificate...

	I0829 11:49:01.676985    3522 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 11:49:01.677007    3522 main.go:141] libmachine: Decoding PEM data...

	I0829 11:49:01.677016    3522 main.go:141] libmachine: Parsing certificate...

	I0829 11:49:01.677374    3522 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 11:49:01.836587    3522 main.go:141] libmachine: Creating SSH key...

	I0829 11:49:02.111928    3522 main.go:141] libmachine: Creating Disk image...

	I0829 11:49:02.111936    3522 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 11:49:02.112192    3522 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:02.122710    3522 main.go:141] libmachine: STDOUT: 

	I0829 11:49:02.122730    3522 main.go:141] libmachine: STDERR: 

	I0829 11:49:02.122800    3522 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2 +20000M

	I0829 11:49:02.131052    3522 main.go:141] libmachine: STDOUT: Image resized.

	I0829 11:49:02.131066    3522 main.go:141] libmachine: STDERR: 

	I0829 11:49:02.131077    3522 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:02.131083    3522 main.go:141] libmachine: Starting QEMU VM...

	I0829 11:49:02.131096    3522 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:49:02.131136    3522 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/qemu.pid -device virtio-net-pci,netdev=net0,mac=26:87:ad:da:85:d8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:02.132813    3522 main.go:141] libmachine: STDOUT: 

	I0829 11:49:02.132827    3522 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:49:02.132844    3522 client.go:171] duration metric: took 456.001584ms to LocalClient.Create

	I0829 11:49:04.134990    3522 start.go:128] duration metric: took 2.484685458s to createHost

	I0829 11:49:04.135051    3522 start.go:83] releasing machines lock for "multinode-531000", held for 2.484802792s

	W0829 11:49:04.135106    3522 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:49:04.145223    3522 out.go:177] * Deleting "multinode-531000" in qemu2 ...

	W0829 11:49:04.186090    3522 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:49:04.186114    3522 start.go:729] Will try again in 5 seconds ...

	I0829 11:49:09.188228    3522 start.go:360] acquireMachinesLock for multinode-531000: {Name:mk54c878341df5948b162b01843176e59d4f0973 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0829 11:49:09.188724    3522 start.go:364] duration metric: took 373.459µs to acquireMachinesLock for "multinode-531000"

	I0829 11:49:09.188851    3522 start.go:93] Provisioning new machine with config: &{Name:multinode-531000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-531000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0829 11:49:09.189119    3522 start.go:125] createHost starting for "" (driver="qemu2")

	I0829 11:49:09.209627    3522 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0829 11:49:09.263039    3522 start.go:159] libmachine.API.Create for "multinode-531000" (driver="qemu2")

	I0829 11:49:09.263086    3522 client.go:168] LocalClient.Create starting

	I0829 11:49:09.263211    3522 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/ca.pem

	I0829 11:49:09.263264    3522 main.go:141] libmachine: Decoding PEM data...

	I0829 11:49:09.263288    3522 main.go:141] libmachine: Parsing certificate...

	I0829 11:49:09.263360    3522 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19531-965/.minikube/certs/cert.pem

	I0829 11:49:09.263403    3522 main.go:141] libmachine: Decoding PEM data...

	I0829 11:49:09.263414    3522 main.go:141] libmachine: Parsing certificate...

	I0829 11:49:09.263942    3522 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19531-965/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19531-965/.minikube/cache/iso/arm64/minikube-v1.33.1-1724775098-19521-arm64.iso...

	I0829 11:49:09.431962    3522 main.go:141] libmachine: Creating SSH key...

	I0829 11:49:09.571130    3522 main.go:141] libmachine: Creating Disk image...

	I0829 11:49:09.571140    3522 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0829 11:49:09.571314    3522 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2.raw /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:09.580670    3522 main.go:141] libmachine: STDOUT: 

	I0829 11:49:09.580697    3522 main.go:141] libmachine: STDERR: 

	I0829 11:49:09.580751    3522 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2 +20000M

	I0829 11:49:09.588928    3522 main.go:141] libmachine: STDOUT: Image resized.

	I0829 11:49:09.588944    3522 main.go:141] libmachine: STDERR: 

	I0829 11:49:09.588960    3522 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:09.588965    3522 main.go:141] libmachine: Starting QEMU VM...

	I0829 11:49:09.588976    3522 qemu.go:418] Using hvf for hardware acceleration

	I0829 11:49:09.589010    3522 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:c1:13:22:1b:11 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19531-965/.minikube/machines/multinode-531000/disk.qcow2

	I0829 11:49:09.590639    3522 main.go:141] libmachine: STDOUT: 

	I0829 11:49:09.590655    3522 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0829 11:49:09.590668    3522 client.go:171] duration metric: took 327.580917ms to LocalClient.Create

	I0829 11:49:11.592822    3522 start.go:128] duration metric: took 2.40368975s to createHost

	I0829 11:49:11.592873    3522 start.go:83] releasing machines lock for "multinode-531000", held for 2.4041575s

	W0829 11:49:11.593218    3522 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-531000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-531000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0829 11:49:11.609670    3522 out.go:201] 

	W0829 11:49:11.614793    3522 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0829 11:49:11.614817    3522 out.go:270] * 

	* 

	W0829 11:49:11.617540    3522 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0829 11:49:11.626503    3522 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-531000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-531000 -n multinode-531000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-531000 -n multinode-531000: exit status 7 (66.271416ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-531000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (10.18s)