=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-445000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-445000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (12.832044875s)

-- stdout --

	{"specversion":"1.0","id":"6c9ea690-c7a1-4894-9c7f-84057c163d89","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-445000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"06dac9d9-27cc-4d61-bbde-701eb82f6063","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18943"}}

	{"specversion":"1.0","id":"a10aa005-1579-4e80-b1b9-7b52b52af9ef","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig"}}

	{"specversion":"1.0","id":"39a6b25e-1a9f-40a1-b027-5f45af996f6a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"8433144a-3309-43f6-a9cc-0e2848c57606","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"b835963d-54c3-4d4e-ac9b-638b5b01cbd6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube"}}

	{"specversion":"1.0","id":"ee503fcd-bc92-4e75-a645-cbb6f86de6a1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"6b982e44-8834-4185-8661-ae555bb017d1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"2a61a313-4dc9-4842-8ff7-c5db5312dce6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"a48b7a52-1124-4f07-bfb1-a94cb4fc0f08","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"67a42f6a-0d7a-4bdb-bf57-d20d8f2bb705","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-445000\" primary control-plane node in \"download-only-445000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"2cbd410d-3fd2-475e-9fd3-cd5030a95c5e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"c57e6d39-0e32-4c17-9732-c8d9f4e377b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/18943-972/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920] Decompressors:map[bz2:0x14000883af0 gz:0x14000883af8 tar:0x14000883aa0 tar.bz2:0x14000883ab0 tar.gz:0x14000883ac0 tar.xz:0x14000883ad0 tar.zst:0x14000883ae0 tbz2:0x14000883ab0 tgz:0x140

00883ac0 txz:0x14000883ad0 tzst:0x14000883ae0 xz:0x14000883b00 zip:0x14000883b10 zst:0x14000883b08] Getters:map[file:0x140009d8df0 http:0x140007565f0 https:0x14000756640] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"12da5abc-ba6c-4878-82f9-b03dcd57f5a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0831 15:04:53.212301    1434 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:04:53.212436    1434 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:04:53.212440    1434 out.go:358] Setting ErrFile to fd 2...

	I0831 15:04:53.212443    1434 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:04:53.212563    1434 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	W0831 15:04:53.212642    1434 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/18943-972/.minikube/config/config.json: open /Users/jenkins/minikube-integration/18943-972/.minikube/config/config.json: no such file or directory

	I0831 15:04:53.213857    1434 out.go:352] Setting JSON to true

	I0831 15:04:53.231229    1434 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":257,"bootTime":1725141636,"procs":455,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:04:53.231291    1434 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:04:53.235858    1434 out.go:97] [download-only-445000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:04:53.236036    1434 notify.go:220] Checking for updates...

	W0831 15:04:53.236024    1434 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball: no such file or directory

	I0831 15:04:53.239726    1434 out.go:169] MINIKUBE_LOCATION=18943

	I0831 15:04:53.242766    1434 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:04:53.247752    1434 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:04:53.250803    1434 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:04:53.253781    1434 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	W0831 15:04:53.259817    1434 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0831 15:04:53.260038    1434 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:04:53.264799    1434 out.go:97] Using the qemu2 driver based on user configuration

	I0831 15:04:53.264819    1434 start.go:297] selected driver: qemu2

	I0831 15:04:53.264823    1434 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:04:53.264919    1434 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:04:53.268786    1434 out.go:169] Automatically selected the socket_vmnet network

	I0831 15:04:53.274571    1434 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0831 15:04:53.274647    1434 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0831 15:04:53.274726    1434 cni.go:84] Creating CNI manager for ""

	I0831 15:04:53.274743    1434 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0831 15:04:53.274784    1434 start.go:340] cluster config:

	{Name:download-only-445000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-445000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo

ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:04:53.279852    1434 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:04:53.284805    1434 out.go:97] Downloading VM boot image ...

	I0831 15:04:53.284823    1434 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso

	I0831 15:04:58.394705    1434 out.go:97] Starting "download-only-445000" primary control-plane node in "download-only-445000" cluster

	I0831 15:04:58.394723    1434 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0831 15:04:58.456694    1434 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0831 15:04:58.456730    1434 cache.go:56] Caching tarball of preloaded images

	I0831 15:04:58.456908    1434 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0831 15:04:58.460948    1434 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I0831 15:04:58.460955    1434 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0831 15:04:58.539868    1434 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0831 15:05:04.741593    1434 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0831 15:05:04.741766    1434 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0831 15:05:05.436531    1434 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I0831 15:05:05.436712    1434 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/download-only-445000/config.json ...

	I0831 15:05:05.436728    1434 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/download-only-445000/config.json: {Name:mk7632ce36e65a62ce12d632696257046a80f598 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:05.436953    1434 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0831 15:05:05.437143    1434 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18943-972/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I0831 15:05:05.966382    1434 out.go:193] 

	W0831 15:05:05.974431    1434 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/18943-972/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920 0x104be7920] Decompressors:map[bz2:0x14000883af0 gz:0x14000883af8 tar:0x14000883aa0 tar.bz2:0x14000883ab0 tar.gz:0x14000883ac0 tar.xz:0x14000883ad0 tar.zst:0x14000883ae0 tbz2:0x14000883ab0 tgz:0x14000883ac0 txz:0x14000883ad0 tzst:0x14000883ae0 xz:0x14000883b00 zip:0x14000883b10 zst:0x14000883b08] Getters:map[file:0x140009d8df0 http:0x140007565f0 https:0x14000756640] Dir:false ProgressListe

ner:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0831 15:05:05.974454    1434 out_reason.go:110] 

	W0831 15:05:05.983133    1434 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:05:05.987263    1434 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-445000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (12.83s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/18943-972/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/18943-972/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-236000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-236000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.731530125s)

-- stdout --

	* [offline-docker-236000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-236000" primary control-plane node in "offline-docker-236000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-236000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:50:35.285666    4022 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:50:35.285798    4022 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:35.285801    4022 out.go:358] Setting ErrFile to fd 2...

	I0831 15:50:35.285804    4022 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:35.285938    4022 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:50:35.287159    4022 out.go:352] Setting JSON to false

	I0831 15:50:35.305178    4022 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2999,"bootTime":1725141636,"procs":472,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:50:35.305251    4022 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:50:35.310154    4022 out.go:177] * [offline-docker-236000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:50:35.318072    4022 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:50:35.318074    4022 notify.go:220] Checking for updates...

	I0831 15:50:35.324091    4022 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:50:35.327057    4022 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:50:35.330049    4022 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:50:35.333041    4022 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:50:35.336030    4022 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:50:35.339433    4022 config.go:182] Loaded profile config "multinode-334000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:35.339491    4022 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:50:35.342992    4022 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:50:35.350088    4022 start.go:297] selected driver: qemu2

	I0831 15:50:35.350098    4022 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:50:35.350105    4022 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:50:35.351991    4022 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:50:35.355023    4022 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:50:35.358117    4022 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:50:35.358140    4022 cni.go:84] Creating CNI manager for ""

	I0831 15:50:35.358147    4022 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:50:35.358155    4022 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0831 15:50:35.358208    4022 start.go:340] cluster config:

	{Name:offline-docker-236000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi

n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:50:35.361823    4022 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:50:35.369026    4022 out.go:177] * Starting "offline-docker-236000" primary control-plane node in "offline-docker-236000" cluster

	I0831 15:50:35.373066    4022 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:50:35.373089    4022 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:50:35.373099    4022 cache.go:56] Caching tarball of preloaded images

	I0831 15:50:35.373177    4022 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:50:35.373184    4022 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:50:35.373242    4022 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/offline-docker-236000/config.json ...

	I0831 15:50:35.373253    4022 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/offline-docker-236000/config.json: {Name:mk22e081a347a4d7d35bea8805d97007da9d144e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:50:35.373471    4022 start.go:360] acquireMachinesLock for offline-docker-236000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:35.373507    4022 start.go:364] duration metric: took 27.084µs to acquireMachinesLock for "offline-docker-236000"

	I0831 15:50:35.373523    4022 start.go:93] Provisioning new machine with config: &{Name:offline-docker-236000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:35.373563    4022 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:35.382037    4022 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:35.397806    4022 start.go:159] libmachine.API.Create for "offline-docker-236000" (driver="qemu2")

	I0831 15:50:35.397836    4022 client.go:168] LocalClient.Create starting

	I0831 15:50:35.397916    4022 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:35.397947    4022 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:35.397958    4022 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:35.398000    4022 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:35.398024    4022 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:35.398032    4022 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:35.398391    4022 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:35.557293    4022 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:35.599204    4022 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:35.599215    4022 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:35.599420    4022 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:35.609471    4022 main.go:141] libmachine: STDOUT: 

	I0831 15:50:35.609500    4022 main.go:141] libmachine: STDERR: 

	I0831 15:50:35.609566    4022 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2 +20000M

	I0831 15:50:35.618747    4022 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:35.618773    4022 main.go:141] libmachine: STDERR: 

	I0831 15:50:35.618793    4022 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:35.618807    4022 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:35.618820    4022 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:35.618852    4022 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:bd:0b:d3:23:03 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:35.620733    4022 main.go:141] libmachine: STDOUT: 

	I0831 15:50:35.620752    4022 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:35.620768    4022 client.go:171] duration metric: took 222.933584ms to LocalClient.Create

	I0831 15:50:37.622473    4022 start.go:128] duration metric: took 2.248960041s to createHost

	I0831 15:50:37.622484    4022 start.go:83] releasing machines lock for "offline-docker-236000", held for 2.249027417s

	W0831 15:50:37.622495    4022 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:37.629562    4022 out.go:177] * Deleting "offline-docker-236000" in qemu2 ...

	W0831 15:50:37.639656    4022 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:37.639667    4022 start.go:729] Will try again in 5 seconds ...

	I0831 15:50:42.641645    4022 start.go:360] acquireMachinesLock for offline-docker-236000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:42.641776    4022 start.go:364] duration metric: took 95.833µs to acquireMachinesLock for "offline-docker-236000"

	I0831 15:50:42.641809    4022 start.go:93] Provisioning new machine with config: &{Name:offline-docker-236000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:42.641853    4022 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:42.653004    4022 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:42.668947    4022 start.go:159] libmachine.API.Create for "offline-docker-236000" (driver="qemu2")

	I0831 15:50:42.668978    4022 client.go:168] LocalClient.Create starting

	I0831 15:50:42.669043    4022 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:42.669081    4022 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:42.669092    4022 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:42.669146    4022 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:42.669168    4022 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:42.669183    4022 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:42.669474    4022 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:42.835401    4022 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:42.924501    4022 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:42.924519    4022 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:42.924741    4022 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:42.934813    4022 main.go:141] libmachine: STDOUT: 

	I0831 15:50:42.934846    4022 main.go:141] libmachine: STDERR: 

	I0831 15:50:42.934925    4022 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2 +20000M

	I0831 15:50:42.944715    4022 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:42.944747    4022 main.go:141] libmachine: STDERR: 

	I0831 15:50:42.944767    4022 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:42.944772    4022 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:42.944785    4022 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:42.944829    4022 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/qemu.pid -device virtio-net-pci,netdev=net0,mac=02:70:60:c9:c8:b6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/offline-docker-236000/disk.qcow2

	I0831 15:50:42.946831    4022 main.go:141] libmachine: STDOUT: 

	I0831 15:50:42.946853    4022 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:42.946865    4022 client.go:171] duration metric: took 277.890209ms to LocalClient.Create

	I0831 15:50:44.949098    4022 start.go:128] duration metric: took 2.307253583s to createHost

	I0831 15:50:44.949184    4022 start.go:83] releasing machines lock for "offline-docker-236000", held for 2.30745675s

	W0831 15:50:44.949565    4022 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-236000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-236000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:44.959116    4022 out.go:201] 

	W0831 15:50:44.963194    4022 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:50:44.963243    4022 out.go:270] * 

	* 

	W0831 15:50:44.966106    4022 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:50:44.974078    4022 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-236000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:626: *** TestOffline FAILED at 2024-08-31 15:50:44.989436 -0700 PDT m=+2751.931066876

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-236000 -n offline-docker-236000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-236000 -n offline-docker-236000: exit status 7 (68.863667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "offline-docker-236000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "offline-docker-236000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-236000

--- FAIL: TestOffline (9.89s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:332: registry stabilized in 1.334125ms

addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:345: "registry-6fb4cdfc84-dbh5s" [f256bb8d-d37d-4371-a5a9-38e94d41cce2] Running

addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.011021667s

addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:345: "registry-proxy-7mcwz" [bb84f056-88e3-4c3d-845b-eb2704863b95] Running

addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004728125s

addons_test.go:342: (dbg) Run:  kubectl --context addons-492000 delete po -l run=registry-test --now

addons_test.go:347: (dbg) Run:  kubectl --context addons-492000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-492000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.053374542s)

-- stdout --

	pod "registry-test" deleted

-- /stdout --

** stderr ** 

	error: timed out waiting for the condition

** /stderr **

addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-492000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1

addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted

*

addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-492000 ip

2024/08/31 15:17:22 [DEBUG] GET http://192.168.105.2:5000

addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-492000 addons disable registry --alsologtostderr -v=1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-492000 -n addons-492000

helpers_test.go:245: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p addons-492000 logs -n 25

helpers_test.go:253: TestAddons/parallel/Registry logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only              | download-only-445000 | jenkins | v1.33.1 | 31 Aug 24 15:04 PDT |                     |

	|         | -p download-only-445000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| delete  | -p download-only-445000              | download-only-445000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| start   | -o=json --download-only              | download-only-326000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT |                     |

	|         | -p download-only-326000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| delete  | -p download-only-326000              | download-only-326000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| delete  | -p download-only-445000              | download-only-445000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| delete  | -p download-only-326000              | download-only-326000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| start   | --download-only -p                   | binary-mirror-803000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT |                     |

	|         | binary-mirror-803000                 |                      |         |         |                     |                     |

	|         | --alsologtostderr                    |                      |         |         |                     |                     |

	|         | --binary-mirror                      |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49311               |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-803000              | binary-mirror-803000 | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:05 PDT |

	| addons  | disable dashboard -p                 | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT |                     |

	|         | addons-492000                        |                      |         |         |                     |                     |

	| addons  | enable dashboard -p                  | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT |                     |

	|         | addons-492000                        |                      |         |         |                     |                     |

	| start   | -p addons-492000 --wait=true         | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:05 PDT | 31 Aug 24 15:07 PDT |

	|         | --memory=4000 --alsologtostderr      |                      |         |         |                     |                     |

	|         | --addons=registry                    |                      |         |         |                     |                     |

	|         | --addons=metrics-server              |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots             |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver         |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                    |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner               |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget            |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher |                      |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin        |                      |         |         |                     |                     |

	|         | --addons=yakd --addons=volcano       |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress     |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                 |                      |         |         |                     |                     |

	| addons  | addons-492000 addons disable         | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:08 PDT | 31 Aug 24 15:08 PDT |

	|         | volcano --alsologtostderr -v=1       |                      |         |         |                     |                     |

	| addons  | addons-492000 addons                 | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:16 PDT | 31 Aug 24 15:16 PDT |

	|         | disable csi-hostpath-driver          |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-492000 addons                 | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:16 PDT | 31 Aug 24 15:16 PDT |

	|         | disable volumesnapshots              |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-492000 addons                 | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:17 PDT | 31 Aug 24 15:17 PDT |

	|         | disable metrics-server               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | disable inspektor-gadget -p          | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:17 PDT | 31 Aug 24 15:17 PDT |

	|         | addons-492000                        |                      |         |         |                     |                     |

	| ip      | addons-492000 ip                     | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:17 PDT | 31 Aug 24 15:17 PDT |

	| addons  | addons-492000 addons disable         | addons-492000        | jenkins | v1.33.1 | 31 Aug 24 15:17 PDT | 31 Aug 24 15:17 PDT |

	|         | registry --alsologtostderr           |                      |         |         |                     |                     |

	|         | -v=1                                 |                      |         |         |                     |                     |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/31 15:05:14

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0831 15:05:14.363464    1510 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:05:14.363654    1510 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:05:14.363658    1510 out.go:358] Setting ErrFile to fd 2...

	I0831 15:05:14.363663    1510 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:05:14.363772    1510 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:05:14.364877    1510 out.go:352] Setting JSON to false

	I0831 15:05:14.380794    1510 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":278,"bootTime":1725141636,"procs":455,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:05:14.380873    1510 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:05:14.385935    1510 out.go:177] * [addons-492000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:05:14.392976    1510 notify.go:220] Checking for updates...

	I0831 15:05:14.396926    1510 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:05:14.399907    1510 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:05:14.402901    1510 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:05:14.405929    1510 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:05:14.408922    1510 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:05:14.411918    1510 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:05:14.413444    1510 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:05:14.417863    1510 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:05:14.424743    1510 start.go:297] selected driver: qemu2

	I0831 15:05:14.424749    1510 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:05:14.424755    1510 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:05:14.426846    1510 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:05:14.430926    1510 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:05:14.434024    1510 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:05:14.434047    1510 cni.go:84] Creating CNI manager for ""

	I0831 15:05:14.434055    1510 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:05:14.434059    1510 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0831 15:05:14.434093    1510 start.go:340] cluster config:

	{Name:addons-492000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-492000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c

lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:05:14.437817    1510 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:05:14.446888    1510 out.go:177] * Starting "addons-492000" primary control-plane node in "addons-492000" cluster

	I0831 15:05:14.450907    1510 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:05:14.450924    1510 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:05:14.450934    1510 cache.go:56] Caching tarball of preloaded images

	I0831 15:05:14.450984    1510 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:05:14.450990    1510 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:05:14.451183    1510 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/config.json ...

	I0831 15:05:14.451194    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/config.json: {Name:mk15bfa00bce97b02dc86ad189826a20d2482deb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:14.451645    1510 start.go:360] acquireMachinesLock for addons-492000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:05:14.451712    1510 start.go:364] duration metric: took 61.666µs to acquireMachinesLock for "addons-492000"

	I0831 15:05:14.451722    1510 start.go:93] Provisioning new machine with config: &{Name:addons-492000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.0 ClusterName:addons-492000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:05:14.451753    1510 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:05:14.459909    1510 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0831 15:05:14.680628    1510 start.go:159] libmachine.API.Create for "addons-492000" (driver="qemu2")

	I0831 15:05:14.680681    1510 client.go:168] LocalClient.Create starting

	I0831 15:05:14.680852    1510 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:05:14.785312    1510 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:05:14.830932    1510 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:05:15.095009    1510 main.go:141] libmachine: Creating SSH key...

	I0831 15:05:15.234957    1510 main.go:141] libmachine: Creating Disk image...

	I0831 15:05:15.234963    1510 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:05:15.235235    1510 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2

	I0831 15:05:15.254136    1510 main.go:141] libmachine: STDOUT: 

	I0831 15:05:15.254165    1510 main.go:141] libmachine: STDERR: 

	I0831 15:05:15.254211    1510 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2 +20000M

	I0831 15:05:15.262157    1510 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:05:15.262172    1510 main.go:141] libmachine: STDERR: 

	I0831 15:05:15.262185    1510 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2

	I0831 15:05:15.262189    1510 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:05:15.262228    1510 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:05:15.262259    1510 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3a:54:99:61:a2:61 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/disk.qcow2

	I0831 15:05:15.318702    1510 main.go:141] libmachine: STDOUT: 

	I0831 15:05:15.318732    1510 main.go:141] libmachine: STDERR: 

	I0831 15:05:15.318735    1510 main.go:141] libmachine: Attempt 0

	I0831 15:05:15.318749    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:15.318803    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:15.318819    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:17.319943    1510 main.go:141] libmachine: Attempt 1

	I0831 15:05:17.320021    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:17.320478    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:17.320530    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:19.321711    1510 main.go:141] libmachine: Attempt 2

	I0831 15:05:19.321791    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:19.322154    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:19.322206    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:21.323356    1510 main.go:141] libmachine: Attempt 3

	I0831 15:05:21.323398    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:21.323498    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:21.323519    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:23.324524    1510 main.go:141] libmachine: Attempt 4

	I0831 15:05:23.324535    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:23.324565    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:23.324573    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:25.325583    1510 main.go:141] libmachine: Attempt 5

	I0831 15:05:25.325589    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:25.325618    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:25.325625    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:27.326632    1510 main.go:141] libmachine: Attempt 6

	I0831 15:05:27.326645    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:27.326709    1510 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0831 15:05:27.326717    1510 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66d4e411}

	I0831 15:05:29.327836    1510 main.go:141] libmachine: Attempt 7

	I0831 15:05:29.327925    1510 main.go:141] libmachine: Searching for 3a:54:99:61:a2:61 in /var/db/dhcpd_leases ...

	I0831 15:05:29.328388    1510 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I0831 15:05:29.328443    1510 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:3a:54:99:61:a2:61 ID:1,3a:54:99:61:a2:61 Lease:0x66d4e527}

	I0831 15:05:29.328457    1510 main.go:141] libmachine: Found match: 3a:54:99:61:a2:61

	I0831 15:05:29.328488    1510 main.go:141] libmachine: IP: 192.168.105.2

	I0831 15:05:29.328511    1510 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0831 15:05:32.348410    1510 machine.go:93] provisionDockerMachine start ...

	I0831 15:05:32.349898    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.350406    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.350421    1510 main.go:141] libmachine: About to run SSH command:

	hostname

	I0831 15:05:32.424756    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0831 15:05:32.424790    1510 buildroot.go:166] provisioning hostname "addons-492000"

	I0831 15:05:32.424899    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.425186    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.425198    1510 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-492000 && echo "addons-492000" | sudo tee /etc/hostname

	I0831 15:05:32.495362    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-492000

	I0831 15:05:32.495447    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.495609    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.495620    1510 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-492000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-492000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-492000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0831 15:05:32.554795    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0831 15:05:32.554811    1510 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/18943-972/.minikube CaCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/18943-972/.minikube}

	I0831 15:05:32.554830    1510 buildroot.go:174] setting up certificates

	I0831 15:05:32.554835    1510 provision.go:84] configureAuth start

	I0831 15:05:32.554838    1510 provision.go:143] copyHostCerts

	I0831 15:05:32.554950    1510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/key.pem (1679 bytes)

	I0831 15:05:32.555185    1510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/ca.pem (1082 bytes)

	I0831 15:05:32.555303    1510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/cert.pem (1123 bytes)

	I0831 15:05:32.555400    1510 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem org=jenkins.addons-492000 san=[127.0.0.1 192.168.105.2 addons-492000 localhost minikube]

	I0831 15:05:32.632950    1510 provision.go:177] copyRemoteCerts

	I0831 15:05:32.633018    1510 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0831 15:05:32.633026    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:32.660099    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0831 15:05:32.668116    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0831 15:05:32.675964    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0831 15:05:32.683937    1510 provision.go:87] duration metric: took 129.100459ms to configureAuth

	I0831 15:05:32.683949    1510 buildroot.go:189] setting minikube options for container-runtime

	I0831 15:05:32.684080    1510 config.go:182] Loaded profile config "addons-492000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:05:32.684131    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.684226    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.684231    1510 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0831 15:05:32.734699    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0831 15:05:32.734708    1510 buildroot.go:70] root file system type: tmpfs

	I0831 15:05:32.734759    1510 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0831 15:05:32.734803    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.734913    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.734948    1510 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0831 15:05:32.787309    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0831 15:05:32.787352    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:32.787457    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:32.787466    1510 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0831 15:05:34.159064    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0831 15:05:34.159076    1510 machine.go:96] duration metric: took 1.810682209s to provisionDockerMachine

	I0831 15:05:34.159083    1510 client.go:171] duration metric: took 19.478855792s to LocalClient.Create

	I0831 15:05:34.159092    1510 start.go:167] duration metric: took 19.478930166s to libmachine.API.Create "addons-492000"

	I0831 15:05:34.159099    1510 start.go:293] postStartSetup for "addons-492000" (driver="qemu2")

	I0831 15:05:34.159105    1510 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0831 15:05:34.159168    1510 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0831 15:05:34.159177    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:34.187052    1510 ssh_runner.go:195] Run: cat /etc/os-release

	I0831 15:05:34.189216    1510 info.go:137] Remote host: Buildroot 2023.02.9

	I0831 15:05:34.189226    1510 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18943-972/.minikube/addons for local assets ...

	I0831 15:05:34.189325    1510 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18943-972/.minikube/files for local assets ...

	I0831 15:05:34.189358    1510 start.go:296] duration metric: took 30.257125ms for postStartSetup

	I0831 15:05:34.189732    1510 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/config.json ...

	I0831 15:05:34.189912    1510 start.go:128] duration metric: took 19.738620167s to createHost

	I0831 15:05:34.189935    1510 main.go:141] libmachine: Using SSH client type: native

	I0831 15:05:34.190021    1510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100dac5a0] 0x100daee00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0831 15:05:34.190026    1510 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0831 15:05:34.238237    1510 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725141934.004676961

	I0831 15:05:34.238245    1510 fix.go:216] guest clock: 1725141934.004676961

	I0831 15:05:34.238250    1510 fix.go:229] Guest: 2024-08-31 15:05:34.004676961 -0700 PDT Remote: 2024-08-31 15:05:34.189915 -0700 PDT m=+19.844429001 (delta=-185.238039ms)

	I0831 15:05:34.238259    1510 fix.go:200] guest clock delta is within tolerance: -185.238039ms

	I0831 15:05:34.238262    1510 start.go:83] releasing machines lock for "addons-492000", held for 19.787010667s

	I0831 15:05:34.238533    1510 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0831 15:05:34.238576    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:34.238533    1510 ssh_runner.go:195] Run: cat /version.json

	I0831 15:05:34.238592    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:34.310080    1510 ssh_runner.go:195] Run: systemctl --version

	I0831 15:05:34.312391    1510 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0831 15:05:34.314472    1510 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0831 15:05:34.314496    1510 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0831 15:05:34.320649    1510 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0831 15:05:34.320656    1510 start.go:495] detecting cgroup driver to use...

	I0831 15:05:34.320753    1510 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0831 15:05:34.326851    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0831 15:05:34.330541    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0831 15:05:34.334277    1510 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0831 15:05:34.334306    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0831 15:05:34.338046    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0831 15:05:34.342005    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0831 15:05:34.345889    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0831 15:05:34.349672    1510 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0831 15:05:34.353653    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0831 15:05:34.357448    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0831 15:05:34.361252    1510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0831 15:05:34.365351    1510 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0831 15:05:34.368582    1510 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0831 15:05:34.371785    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:34.443624    1510 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0831 15:05:34.453979    1510 start.go:495] detecting cgroup driver to use...

	I0831 15:05:34.454055    1510 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0831 15:05:34.460305    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0831 15:05:34.465857    1510 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0831 15:05:34.473127    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0831 15:05:34.479071    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0831 15:05:34.484435    1510 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0831 15:05:34.509198    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0831 15:05:34.514779    1510 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0831 15:05:34.521023    1510 ssh_runner.go:195] Run: which cri-dockerd

	I0831 15:05:34.522342    1510 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0831 15:05:34.525890    1510 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0831 15:05:34.531568    1510 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0831 15:05:34.591232    1510 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0831 15:05:34.654884    1510 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0831 15:05:34.654946    1510 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0831 15:05:34.661314    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:34.725970    1510 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0831 15:05:36.907020    1510 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.181085291s)

	I0831 15:05:36.907080    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0831 15:05:36.912743    1510 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0831 15:05:36.919463    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0831 15:05:36.925024    1510 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0831 15:05:36.990560    1510 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0831 15:05:37.062150    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:37.120165    1510 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0831 15:05:37.126609    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0831 15:05:37.132043    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:37.190246    1510 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0831 15:05:37.215257    1510 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0831 15:05:37.215347    1510 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0831 15:05:37.218059    1510 start.go:563] Will wait 60s for crictl version

	I0831 15:05:37.218107    1510 ssh_runner.go:195] Run: which crictl

	I0831 15:05:37.219646    1510 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0831 15:05:37.234653    1510 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.2.0

	RuntimeApiVersion:  v1

	I0831 15:05:37.234720    1510 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0831 15:05:37.244183    1510 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0831 15:05:37.264761    1510 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.2.0 ...

	I0831 15:05:37.264847    1510 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0831 15:05:37.266364    1510 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0831 15:05:37.270688    1510 kubeadm.go:883] updating cluster {Name:addons-492000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.0 ClusterName:addons-492000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort

:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0831 15:05:37.270733    1510 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:05:37.270774    1510 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0831 15:05:37.280058    1510 docker.go:685] Got preloaded images: 

	I0831 15:05:37.280067    1510 docker.go:691] registry.k8s.io/kube-apiserver:v1.31.0 wasn't preloaded

	I0831 15:05:37.280107    1510 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0831 15:05:37.283429    1510 ssh_runner.go:195] Run: which lz4

	I0831 15:05:37.284861    1510 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0831 15:05:37.286155    1510 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0831 15:05:37.286165    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (322549298 bytes)

	I0831 15:05:38.562367    1510 docker.go:649] duration metric: took 1.277557s to copy over tarball

	I0831 15:05:38.562428    1510 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0831 15:05:39.536959    1510 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0831 15:05:39.552050    1510 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0831 15:05:39.555483    1510 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)

	I0831 15:05:39.561199    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:39.627120    1510 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0831 15:05:41.821049    1510 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.193962666s)

	I0831 15:05:41.821157    1510 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0831 15:05:41.836826    1510 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0831 15:05:41.836836    1510 cache_images.go:84] Images are preloaded, skipping loading

	I0831 15:05:41.836841    1510 kubeadm.go:934] updating node { 192.168.105.2 8443 v1.31.0 docker true true} ...

	I0831 15:05:41.836923    1510 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-492000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:addons-492000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0831 15:05:41.837006    1510 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0831 15:05:41.858140    1510 cni.go:84] Creating CNI manager for ""

	I0831 15:05:41.858151    1510 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:05:41.858156    1510 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0831 15:05:41.858167    1510 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-492000 NodeName:addons-492000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0831 15:05:41.858227    1510 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-492000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0831 15:05:41.858285    1510 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0831 15:05:41.862329    1510 binaries.go:44] Found k8s binaries, skipping transfer

	I0831 15:05:41.862362    1510 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0831 15:05:41.866050    1510 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0831 15:05:41.872138    1510 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0831 15:05:41.878000    1510 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0831 15:05:41.884191    1510 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0831 15:05:41.885601    1510 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0831 15:05:41.889920    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:41.973694    1510 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0831 15:05:41.980511    1510 certs.go:68] Setting up /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000 for IP: 192.168.105.2

	I0831 15:05:41.980518    1510 certs.go:194] generating shared ca certs ...

	I0831 15:05:41.980528    1510 certs.go:226] acquiring lock for ca certs: {Name:mk9afb7f1a72cfb2bc15164a899be0d76a69591d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:41.980724    1510 certs.go:240] generating "minikubeCA" ca cert: /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key

	I0831 15:05:42.045261    1510 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt ...

	I0831 15:05:42.045272    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt: {Name:mkcd599d95ec6d55602355f7ac4ce0c25f289279 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.045578    1510 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key ...

	I0831 15:05:42.045582    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key: {Name:mkcf030a6b3d0104cd94aa9e9d38b38d59319495 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.045698    1510 certs.go:240] generating "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key

	I0831 15:05:42.117331    1510 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.crt ...

	I0831 15:05:42.117334    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.crt: {Name:mkbc4ca390a5c24602cddfc225bb05156290ef83 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.117473    1510 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key ...

	I0831 15:05:42.117476    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key: {Name:mkf1622f5d926dd9cf6f9b3767b764bdd13a7c1e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.117595    1510 certs.go:256] generating profile certs ...

	I0831 15:05:42.117626    1510 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.key

	I0831 15:05:42.117634    1510 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt with IP's: []

	I0831 15:05:42.277297    1510 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt ...

	I0831 15:05:42.277302    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: {Name:mk0008bccaf87ff06e3ab77abe48f09479624c5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.277482    1510 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.key ...

	I0831 15:05:42.277485    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.key: {Name:mk6cf95a320299e1ab431a41d5b2c2ab707a6224 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.277616    1510 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key.d8ad3cf3

	I0831 15:05:42.277627    1510 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt.d8ad3cf3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.105.2]

	I0831 15:05:42.319112    1510 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt.d8ad3cf3 ...

	I0831 15:05:42.319119    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt.d8ad3cf3: {Name:mkad24e791ad50fba55d1830321a283ade4dc10a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.319266    1510 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key.d8ad3cf3 ...

	I0831 15:05:42.319270    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key.d8ad3cf3: {Name:mk9851a19931e8f726a9ce696d4fcb16378943b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.319389    1510 certs.go:381] copying /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt.d8ad3cf3 -> /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt

	I0831 15:05:42.319520    1510 certs.go:385] copying /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key.d8ad3cf3 -> /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key

	I0831 15:05:42.319613    1510 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.key

	I0831 15:05:42.319623    1510 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.crt with IP's: []

	I0831 15:05:42.368986    1510 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.crt ...

	I0831 15:05:42.368992    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.crt: {Name:mkcf267b34fe51404a5719ed87ce0c929fda9d04 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.369179    1510 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.key ...

	I0831 15:05:42.369183    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.key: {Name:mkaa78be695ec7ecadfc51fa2d99d911b3745adf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:42.369490    1510 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem (1679 bytes)

	I0831 15:05:42.369518    1510 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem (1082 bytes)

	I0831 15:05:42.369542    1510 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem (1123 bytes)

	I0831 15:05:42.369565    1510 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem (1679 bytes)

	I0831 15:05:42.371197    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0831 15:05:42.379837    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0831 15:05:42.387709    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0831 15:05:42.395388    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0831 15:05:42.403475    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0831 15:05:42.411354    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0831 15:05:42.419117    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0831 15:05:42.427052    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0831 15:05:42.435092    1510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0831 15:05:42.443028    1510 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0831 15:05:42.450053    1510 ssh_runner.go:195] Run: openssl version

	I0831 15:05:42.452369    1510 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0831 15:05:42.455786    1510 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:05:42.457170    1510 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 31 22:05 /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:05:42.457188    1510 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:05:42.459131    1510 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0831 15:05:42.462843    1510 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0831 15:05:42.464231    1510 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0831 15:05:42.464276    1510 kubeadm.go:392] StartCluster: {Name:addons-492000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0

ClusterName:addons-492000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:05:42.464341    1510 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0831 15:05:42.469921    1510 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0831 15:05:42.473795    1510 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0831 15:05:42.477624    1510 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0831 15:05:42.481202    1510 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0831 15:05:42.481208    1510 kubeadm.go:157] found existing configuration files:

	I0831 15:05:42.481231    1510 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0831 15:05:42.484418    1510 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0831 15:05:42.484443    1510 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0831 15:05:42.487481    1510 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0831 15:05:42.490528    1510 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0831 15:05:42.490552    1510 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0831 15:05:42.494131    1510 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0831 15:05:42.497658    1510 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0831 15:05:42.497683    1510 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0831 15:05:42.501396    1510 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0831 15:05:42.504735    1510 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0831 15:05:42.504754    1510 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0831 15:05:42.508145    1510 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0831 15:05:42.530499    1510 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0

	I0831 15:05:42.530597    1510 kubeadm.go:310] [preflight] Running pre-flight checks

	I0831 15:05:42.572798    1510 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0831 15:05:42.572847    1510 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0831 15:05:42.572910    1510 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0831 15:05:42.583564    1510 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0831 15:05:42.598731    1510 out.go:235]   - Generating certificates and keys ...

	I0831 15:05:42.598762    1510 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0831 15:05:42.598795    1510 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0831 15:05:42.721667    1510 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0831 15:05:42.770709    1510 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0831 15:05:42.922373    1510 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0831 15:05:43.043185    1510 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0831 15:05:43.110604    1510 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0831 15:05:43.110668    1510 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-492000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0831 15:05:43.191956    1510 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0831 15:05:43.192020    1510 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-492000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0831 15:05:43.335927    1510 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0831 15:05:43.459362    1510 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0831 15:05:43.544048    1510 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0831 15:05:43.544079    1510 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0831 15:05:43.678403    1510 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0831 15:05:43.765961    1510 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0831 15:05:43.977620    1510 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0831 15:05:44.140483    1510 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0831 15:05:44.404469    1510 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0831 15:05:44.404975    1510 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0831 15:05:44.406684    1510 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0831 15:05:44.411168    1510 out.go:235]   - Booting up control plane ...

	I0831 15:05:44.411225    1510 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0831 15:05:44.411258    1510 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0831 15:05:44.411286    1510 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0831 15:05:44.417683    1510 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0831 15:05:44.420392    1510 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0831 15:05:44.420414    1510 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0831 15:05:44.501004    1510 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0831 15:05:44.501101    1510 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0831 15:05:45.003402    1510 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.77175ms

	I0831 15:05:45.003633    1510 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0831 15:05:48.005252    1510 kubeadm.go:310] [api-check] The API server is healthy after 3.002387668s

	I0831 15:05:48.010862    1510 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0831 15:05:48.016585    1510 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0831 15:05:48.023996    1510 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0831 15:05:48.024087    1510 kubeadm.go:310] [mark-control-plane] Marking the node addons-492000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0831 15:05:48.027326    1510 kubeadm.go:310] [bootstrap-token] Using token: d16fxo.9wsqs4xe55vfs911

	I0831 15:05:48.030820    1510 out.go:235]   - Configuring RBAC rules ...

	I0831 15:05:48.030877    1510 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0831 15:05:48.031677    1510 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0831 15:05:48.038328    1510 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0831 15:05:48.039360    1510 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0831 15:05:48.040389    1510 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0831 15:05:48.042327    1510 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0831 15:05:48.421936    1510 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0831 15:05:48.820275    1510 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0831 15:05:49.416183    1510 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0831 15:05:49.417064    1510 kubeadm.go:310] 

	I0831 15:05:49.417163    1510 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0831 15:05:49.417173    1510 kubeadm.go:310] 

	I0831 15:05:49.417303    1510 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0831 15:05:49.417316    1510 kubeadm.go:310] 

	I0831 15:05:49.417349    1510 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0831 15:05:49.417931    1510 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0831 15:05:49.418064    1510 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0831 15:05:49.418081    1510 kubeadm.go:310] 

	I0831 15:05:49.418167    1510 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0831 15:05:49.418178    1510 kubeadm.go:310] 

	I0831 15:05:49.418249    1510 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0831 15:05:49.418255    1510 kubeadm.go:310] 

	I0831 15:05:49.418332    1510 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0831 15:05:49.418462    1510 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0831 15:05:49.418579    1510 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0831 15:05:49.418593    1510 kubeadm.go:310] 

	I0831 15:05:49.418737    1510 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0831 15:05:49.418885    1510 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0831 15:05:49.418901    1510 kubeadm.go:310] 

	I0831 15:05:49.419056    1510 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token d16fxo.9wsqs4xe55vfs911 \

	I0831 15:05:49.419237    1510 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2c48eb01c7e14ccabacb40733af33f412e082e4a439e581a52136a5c4cb8c784 \

	I0831 15:05:49.419276    1510 kubeadm.go:310] 	--control-plane 

	I0831 15:05:49.419288    1510 kubeadm.go:310] 

	I0831 15:05:49.419433    1510 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0831 15:05:49.419447    1510 kubeadm.go:310] 

	I0831 15:05:49.419556    1510 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token d16fxo.9wsqs4xe55vfs911 \

	I0831 15:05:49.419685    1510 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2c48eb01c7e14ccabacb40733af33f412e082e4a439e581a52136a5c4cb8c784 

	I0831 15:05:49.420526    1510 kubeadm.go:310] W0831 22:05:42.295308    1588 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0831 15:05:49.421228    1510 kubeadm.go:310] W0831 22:05:42.295882    1588 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0831 15:05:49.421441    1510 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0831 15:05:49.421471    1510 cni.go:84] Creating CNI manager for ""

	I0831 15:05:49.421500    1510 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:05:49.426028    1510 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0831 15:05:49.433254    1510 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0831 15:05:49.446288    1510 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0831 15:05:49.463451    1510 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0831 15:05:49.463572    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:49.463604    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-492000 minikube.k8s.io/updated_at=2024_08_31T15_05_49_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8ab9a20c866aaad18bea6fac47c5d146303457d2 minikube.k8s.io/name=addons-492000 minikube.k8s.io/primary=true

	I0831 15:05:49.470898    1510 ops.go:34] apiserver oom_adj: -16

	I0831 15:05:49.534355    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:50.036490    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:50.536479    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:51.036482    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:51.535208    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:52.036429    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:52.536449    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:53.036646    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:53.536291    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:54.036397    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:54.536375    1510 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0831 15:05:54.580265    1510 kubeadm.go:1113] duration metric: took 5.116918s to wait for elevateKubeSystemPrivileges

	I0831 15:05:54.580284    1510 kubeadm.go:394] duration metric: took 12.116292292s to StartCluster

	I0831 15:05:54.580294    1510 settings.go:142] acquiring lock: {Name:mk1f68c46dbdc908eb5f421f0b3b97ef9fe18a8f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:54.580453    1510 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:05:54.580638    1510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/kubeconfig: {Name:mk5b293422cb73c677cf2dff78569dba34983db1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:05:54.580866    1510 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0831 15:05:54.580895    1510 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0831 15:05:54.580878    1510 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:05:54.580954    1510 addons.go:69] Setting yakd=true in profile "addons-492000"

	I0831 15:05:54.580976    1510 addons.go:69] Setting registry=true in profile "addons-492000"

	I0831 15:05:54.580987    1510 addons.go:234] Setting addon registry=true in "addons-492000"

	I0831 15:05:54.580992    1510 addons.go:69] Setting ingress=true in profile "addons-492000"

	I0831 15:05:54.581000    1510 addons.go:234] Setting addon ingress=true in "addons-492000"

	I0831 15:05:54.581001    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581015    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581016    1510 addons.go:69] Setting default-storageclass=true in profile "addons-492000"

	I0831 15:05:54.581041    1510 addons.go:69] Setting ingress-dns=true in profile "addons-492000"

	I0831 15:05:54.581051    1510 addons.go:234] Setting addon ingress-dns=true in "addons-492000"

	I0831 15:05:54.581052    1510 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-492000"

	I0831 15:05:54.581062    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581061    1510 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-492000"

	I0831 15:05:54.581038    1510 addons.go:69] Setting volumesnapshots=true in profile "addons-492000"

	I0831 15:05:54.581082    1510 addons.go:234] Setting addon volumesnapshots=true in "addons-492000"

	I0831 15:05:54.581091    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581035    1510 config.go:182] Loaded profile config "addons-492000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:05:54.581054    1510 addons.go:69] Setting gcp-auth=true in profile "addons-492000"

	I0831 15:05:54.581199    1510 mustload.go:65] Loading cluster: addons-492000

	I0831 15:05:54.580966    1510 addons.go:234] Setting addon yakd=true in "addons-492000"

	I0831 15:05:54.581300    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581357    1510 config.go:182] Loaded profile config "addons-492000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:05:54.580969    1510 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-492000"

	I0831 15:05:54.581376    1510 retry.go:31] will retry after 619.294676ms: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581392    1510 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-492000"

	I0831 15:05:54.581393    1510 retry.go:31] will retry after 1.48712586s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.580967    1510 addons.go:69] Setting metrics-server=true in profile "addons-492000"

	I0831 15:05:54.581403    1510 addons.go:234] Setting addon metrics-server=true in "addons-492000"

	I0831 15:05:54.581411    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581565    1510 retry.go:31] will retry after 1.028772327s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581565    1510 retry.go:31] will retry after 1.053200631s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.580971    1510 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-492000"

	I0831 15:05:54.581576    1510 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-492000"

	I0831 15:05:54.581582    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581094    1510 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-492000"

	I0831 15:05:54.581645    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581700    1510 retry.go:31] will retry after 637.403013ms: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.580972    1510 addons.go:69] Setting volcano=true in profile "addons-492000"

	I0831 15:05:54.581708    1510 addons.go:234] Setting addon volcano=true in "addons-492000"

	I0831 15:05:54.581710    1510 retry.go:31] will retry after 1.273777706s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581715    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581016    1510 addons.go:69] Setting inspektor-gadget=true in profile "addons-492000"

	I0831 15:05:54.581783    1510 addons.go:234] Setting addon inspektor-gadget=true in "addons-492000"

	I0831 15:05:54.581042    1510 addons.go:69] Setting cloud-spanner=true in profile "addons-492000"

	I0831 15:05:54.581808    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.581827    1510 addons.go:234] Setting addon cloud-spanner=true in "addons-492000"

	I0831 15:05:54.581835    1510 retry.go:31] will retry after 1.486356486s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581856    1510 retry.go:31] will retry after 1.474260019s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581862    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.580963    1510 addons.go:69] Setting storage-provisioner=true in profile "addons-492000"

	I0831 15:05:54.581899    1510 addons.go:234] Setting addon storage-provisioner=true in "addons-492000"

	I0831 15:05:54.581919    1510 retry.go:31] will retry after 554.925255ms: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581925    1510 retry.go:31] will retry after 1.138382192s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.581939    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:54.582065    1510 retry.go:31] will retry after 1.435727377s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.582153    1510 retry.go:31] will retry after 1.400543327s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.582154    1510 retry.go:31] will retry after 1.004216521s: connect: dial unix /Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/monitor: connect: connection refused

	I0831 15:05:54.587073    1510 out.go:177] * Verifying Kubernetes components...

	I0831 15:05:54.592987    1510 out.go:177]   - Using image docker.io/registry:2.8.3

	I0831 15:05:54.596018    1510 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0831 15:05:54.596053    1510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:05:54.604031    1510 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0831 15:05:54.604040    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0831 15:05:54.604049    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:54.607078    1510 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0831 15:05:54.610056    1510 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0831 15:05:54.610063    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0831 15:05:54.610070    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:54.645280    1510 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0831 15:05:54.693748    1510 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0831 15:05:54.720011    1510 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0831 15:05:54.720023    1510 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0831 15:05:54.726302    1510 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0831 15:05:54.726311    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0831 15:05:54.733610    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0831 15:05:54.770610    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0831 15:05:54.889593    1510 start.go:971] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0831 15:05:54.890172    1510 node_ready.go:35] waiting up to 6m0s for node "addons-492000" to be "Ready" ...

	I0831 15:05:54.900144    1510 node_ready.go:49] node "addons-492000" has status "Ready":"True"

	I0831 15:05:54.900153    1510 node_ready.go:38] duration metric: took 9.970583ms for node "addons-492000" to be "Ready" ...

	I0831 15:05:54.900157    1510 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:05:54.912064    1510 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace to be "Ready" ...

	I0831 15:05:55.142290    1510 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0

	I0831 15:05:55.147261    1510 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0

	I0831 15:05:55.157318    1510 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0

	I0831 15:05:55.160712    1510 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml

	I0831 15:05:55.160720    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)

	I0831 15:05:55.160730    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.204271    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0831 15:05:55.208239    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0831 15:05:55.208252    1510 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0831 15:05:55.208264    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.222270    1510 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0831 15:05:55.225289    1510 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0831 15:05:55.225303    1510 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0831 15:05:55.225315    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.231350    1510 addons.go:475] Verifying addon registry=true in "addons-492000"

	I0831 15:05:55.235255    1510 out.go:177] * Verifying registry addon...

	I0831 15:05:55.237275    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml

	I0831 15:05:55.242700    1510 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0831 15:05:55.246212    1510 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0831 15:05:55.246222    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:55.315673    1510 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0831 15:05:55.315686    1510 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0831 15:05:55.343805    1510 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0831 15:05:55.343819    1510 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0831 15:05:55.360399    1510 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0831 15:05:55.360412    1510 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0831 15:05:55.380925    1510 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0831 15:05:55.380941    1510 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0831 15:05:55.393702    1510 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-492000" context rescaled to 1 replicas

	I0831 15:05:55.413048    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0831 15:05:55.413062    1510 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0831 15:05:55.422944    1510 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0831 15:05:55.422955    1510 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0831 15:05:55.432956    1510 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0831 15:05:55.432968    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0831 15:05:55.438650    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0831 15:05:55.446245    1510 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0831 15:05:55.446262    1510 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0831 15:05:55.467757    1510 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0831 15:05:55.467768    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0831 15:05:55.498757    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0831 15:05:55.594972    1510 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0

	I0831 15:05:55.599296    1510 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0831 15:05:55.599306    1510 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0831 15:05:55.599318    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.612830    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:55.637715    1510 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-492000"

	I0831 15:05:55.637739    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:55.641293    1510 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0831 15:05:55.645653    1510 out.go:177]   - Using image docker.io/busybox:stable

	I0831 15:05:55.649356    1510 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0831 15:05:55.649367    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0831 15:05:55.649377    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.725278    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0831 15:05:55.729279    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0831 15:05:55.733243    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0831 15:05:55.737298    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0831 15:05:55.746329    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0831 15:05:55.756260    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0831 15:05:55.765283    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0831 15:05:55.775316    1510 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0831 15:05:55.779233    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0831 15:05:55.779247    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0831 15:05:55.779258    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.783553    1510 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0831 15:05:55.783565    1510 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0831 15:05:55.795048    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:55.840829    1510 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0831 15:05:55.840839    1510 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0831 15:05:55.851472    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0831 15:05:55.861298    1510 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0831 15:05:55.868277    1510 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0831 15:05:55.871304    1510 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0831 15:05:55.871460    1510 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0831 15:05:55.871468    1510 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0831 15:05:55.874364    1510 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0831 15:05:55.874369    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0831 15:05:55.874376    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:55.943092    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0831 15:05:55.943102    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0831 15:05:55.950239    1510 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0831 15:05:55.950249    1510 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0831 15:05:55.989075    1510 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0831 15:05:55.994908    1510 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0831 15:05:55.994919    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0831 15:05:55.994928    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:56.021285    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0831 15:05:56.021298    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0831 15:05:56.021332    1510 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23

	I0831 15:05:56.025282    1510 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0831 15:05:56.025294    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0831 15:05:56.025304    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:56.034712    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0831 15:05:56.060320    1510 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0831 15:05:56.064302    1510 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0831 15:05:56.064312    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0831 15:05:56.064324    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:56.064590    1510 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0831 15:05:56.064595    1510 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0831 15:05:56.073219    1510 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I0831 15:05:56.077236    1510 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0831 15:05:56.077245    1510 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0831 15:05:56.077256    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:56.078248    1510 addons.go:234] Setting addon default-storageclass=true in "addons-492000"

	I0831 15:05:56.078264    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:05:56.078805    1510 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0831 15:05:56.078810    1510 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0831 15:05:56.078814    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:05:56.117407    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0831 15:05:56.117418    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0831 15:05:56.141673    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0831 15:05:56.175199    1510 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0831 15:05:56.175211    1510 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0831 15:05:56.185798    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0831 15:05:56.185808    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0831 15:05:56.234590    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0831 15:05:56.237397    1510 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0831 15:05:56.237404    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0831 15:05:56.239508    1510 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0831 15:05:56.239514    1510 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0831 15:05:56.245756    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:56.259121    1510 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0831 15:05:56.259131    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0831 15:05:56.264764    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0831 15:05:56.281594    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0831 15:05:56.304209    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0831 15:05:56.304297    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0831 15:05:56.304303    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0831 15:05:56.315794    1510 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0831 15:05:56.315808    1510 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0831 15:05:56.402413    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0831 15:05:56.402426    1510 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0831 15:05:56.404591    1510 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0831 15:05:56.404599    1510 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0831 15:05:56.509220    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0831 15:05:56.512225    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0831 15:05:56.512233    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0831 15:05:56.598019    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0831 15:05:56.598029    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0831 15:05:56.647566    1510 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0831 15:05:56.647581    1510 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0831 15:05:56.737698    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0831 15:05:56.746184    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:56.971644    1510 pod_ready.go:103] pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace has status "Ready":"False"

	I0831 15:05:57.264702    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:57.854963    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:58.287527    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:58.705556    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (3.468347875s)

	I0831 15:05:58.705598    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.267012s)

	W0831 15:05:58.705610    1510 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0831 15:05:58.705625    1510 retry.go:31] will retry after 185.842253ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0831 15:05:58.705650    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (3.206951708s)

	I0831 15:05:58.705682    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (2.854261667s)

	I0831 15:05:58.711190    1510 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-492000 service yakd-dashboard -n yakd-dashboard

	I0831 15:05:58.787488    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:58.893622    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0831 15:05:59.191466    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.049845625s)

	I0831 15:05:59.191511    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.956977666s)

	I0831 15:05:59.191525    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (3.156873625s)

	I0831 15:05:59.191534    1510 addons.go:475] Verifying addon ingress=true in "addons-492000"

	I0831 15:05:59.191612    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (2.910075334s)

	I0831 15:05:59.191638    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.92689575s)

	I0831 15:05:59.191720    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (2.88756475s)

	I0831 15:05:59.191754    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (2.682578291s)

	I0831 15:05:59.191760    1510 addons.go:475] Verifying addon metrics-server=true in "addons-492000"

	I0831 15:05:59.198261    1510 out.go:177] * Verifying ingress addon...

	I0831 15:05:59.207645    1510 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0831 15:05:59.218627    1510 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0831 15:05:59.316001    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:05:59.425501    1510 pod_ready.go:103] pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace has status "Ready":"False"

	I0831 15:05:59.504045    1510 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (2.766390417s)

	I0831 15:05:59.504068    1510 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-492000"

	I0831 15:05:59.508191    1510 out.go:177] * Verifying csi-hostpath-driver addon...

	I0831 15:05:59.514659    1510 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0831 15:05:59.520871    1510 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0831 15:05:59.520885    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:05:59.750003    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:00.018050    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:00.310420    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:00.519282    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:00.745573    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:01.018757    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:01.308961    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:01.415251    1510 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-598tf" not found

	I0831 15:06:01.415262    1510 pod_ready.go:82] duration metric: took 6.503337584s for pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace to be "Ready" ...

	E0831 15:06:01.415268    1510 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-598tf" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-598tf" not found

	I0831 15:06:01.415272    1510 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-dcgdp" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:01.519158    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:01.747905    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:02.019806    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:02.301653    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:02.518876    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:02.745541    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:02.818769    1510 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0831 15:06:02.818786    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:06:02.849601    1510 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0831 15:06:02.856592    1510 addons.go:234] Setting addon gcp-auth=true in "addons-492000"

	I0831 15:06:02.856613    1510 host.go:66] Checking if "addons-492000" exists ...

	I0831 15:06:02.857354    1510 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0831 15:06:02.857362    1510 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/addons-492000/id_rsa Username:docker}

	I0831 15:06:02.887844    1510 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0831 15:06:02.891682    1510 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0831 15:06:02.897806    1510 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0831 15:06:02.897813    1510 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0831 15:06:02.903832    1510 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0831 15:06:02.903839    1510 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0831 15:06:02.909880    1510 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0831 15:06:02.909886    1510 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0831 15:06:02.917388    1510 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0831 15:06:02.919273    1510 pod_ready.go:93] pod "coredns-6f6b679f8f-dcgdp" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:02.919280    1510 pod_ready.go:82] duration metric: took 1.504039959s for pod "coredns-6f6b679f8f-dcgdp" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.919284    1510 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.921265    1510 pod_ready.go:93] pod "etcd-addons-492000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:02.921270    1510 pod_ready.go:82] duration metric: took 1.983042ms for pod "etcd-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.921274    1510 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.924201    1510 pod_ready.go:93] pod "kube-apiserver-addons-492000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:02.924207    1510 pod_ready.go:82] duration metric: took 2.930209ms for pod "kube-apiserver-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.924211    1510 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.926447    1510 pod_ready.go:93] pod "kube-controller-manager-addons-492000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:02.926456    1510 pod_ready.go:82] duration metric: took 2.24225ms for pod "kube-controller-manager-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.926460    1510 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-c9pfm" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.928606    1510 pod_ready.go:93] pod "kube-proxy-c9pfm" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:02.928613    1510 pod_ready.go:82] duration metric: took 2.149792ms for pod "kube-proxy-c9pfm" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:02.928617    1510 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:03.019005    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:03.241184    1510 addons.go:475] Verifying addon gcp-auth=true in "addons-492000"

	I0831 15:06:03.246154    1510 out.go:177] * Verifying gcp-auth addon...

	I0831 15:06:03.256563    1510 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0831 15:06:03.312535    1510 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0831 15:06:03.312819    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:03.318567    1510 pod_ready.go:93] pod "kube-scheduler-addons-492000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:06:03.318577    1510 pod_ready.go:82] duration metric: took 389.966291ms for pod "kube-scheduler-addons-492000" in "kube-system" namespace to be "Ready" ...

	I0831 15:06:03.318580    1510 pod_ready.go:39] duration metric: took 8.418616s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:06:03.318589    1510 api_server.go:52] waiting for apiserver process to appear ...

	I0831 15:06:03.318644    1510 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0831 15:06:03.324840    1510 api_server.go:72] duration metric: took 8.744087042s to wait for apiserver process to appear ...

	I0831 15:06:03.324847    1510 api_server.go:88] waiting for apiserver healthz status ...

	I0831 15:06:03.324856    1510 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0831 15:06:03.327863    1510 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0831 15:06:03.328432    1510 api_server.go:141] control plane version: v1.31.0

	I0831 15:06:03.328441    1510 api_server.go:131] duration metric: took 3.591625ms to wait for apiserver health ...

	I0831 15:06:03.328444    1510 system_pods.go:43] waiting for kube-system pods to appear ...

	I0831 15:06:03.519084    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:03.521650    1510 system_pods.go:59] 17 kube-system pods found

	I0831 15:06:03.521656    1510 system_pods.go:61] "coredns-6f6b679f8f-dcgdp" [56ba471a-a1bd-4d31-ab79-ff6b71deae1d] Running

	I0831 15:06:03.521660    1510 system_pods.go:61] "csi-hostpath-attacher-0" [eaa16d4a-ee3c-48fa-9f62-0a782f5151f1] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0831 15:06:03.521663    1510 system_pods.go:61] "csi-hostpath-resizer-0" [3627d990-7957-42ea-a642-f3f5fbd9a56f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0831 15:06:03.521666    1510 system_pods.go:61] "csi-hostpathplugin-cp7lz" [0cc88a88-660a-472b-9f9a-cf2f55fdd5e6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0831 15:06:03.521669    1510 system_pods.go:61] "etcd-addons-492000" [28080b3e-127a-4dd3-9c2a-f9bfdae164c1] Running

	I0831 15:06:03.521671    1510 system_pods.go:61] "kube-apiserver-addons-492000" [b4f55987-b4a2-47dd-b470-613ee3d3950f] Running

	I0831 15:06:03.521673    1510 system_pods.go:61] "kube-controller-manager-addons-492000" [bf425e59-cb5a-4c0f-8cd0-6c70ac91ef34] Running

	I0831 15:06:03.521677    1510 system_pods.go:61] "kube-ingress-dns-minikube" [58edb9c3-1e48-47b4-98e2-19827c514533] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0831 15:06:03.521679    1510 system_pods.go:61] "kube-proxy-c9pfm" [e4dea774-7ae5-4950-a557-b103730150de] Running

	I0831 15:06:03.521682    1510 system_pods.go:61] "kube-scheduler-addons-492000" [01f5db5d-2c73-4ac5-ac2d-f160ee2ebbd2] Running

	I0831 15:06:03.521685    1510 system_pods.go:61] "metrics-server-84c5f94fbc-p6wqw" [61c9f92c-d1e6-4024-9b33-3c247eca65f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0831 15:06:03.521688    1510 system_pods.go:61] "nvidia-device-plugin-daemonset-xbb9h" [5401db3a-6b96-4340-9c15-bc04f6727ea6] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0831 15:06:03.521692    1510 system_pods.go:61] "registry-6fb4cdfc84-dbh5s" [f256bb8d-d37d-4371-a5a9-38e94d41cce2] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0831 15:06:03.521694    1510 system_pods.go:61] "registry-proxy-7mcwz" [bb84f056-88e3-4c3d-845b-eb2704863b95] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0831 15:06:03.521696    1510 system_pods.go:61] "snapshot-controller-56fcc65765-2hmhl" [dd2a1d6c-f1dd-4f94-9f43-74240d211026] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0831 15:06:03.521699    1510 system_pods.go:61] "snapshot-controller-56fcc65765-zpf6n" [67f30329-e856-405c-9bc1-d2170a5ff69a] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0831 15:06:03.521701    1510 system_pods.go:61] "storage-provisioner" [197744a5-f425-4cf8-b155-dc152d9d9a2e] Running

	I0831 15:06:03.521704    1510 system_pods.go:74] duration metric: took 193.261833ms to wait for pod list to return data ...

	I0831 15:06:03.521708    1510 default_sa.go:34] waiting for default service account to be created ...

	I0831 15:06:03.718645    1510 default_sa.go:45] found service account: "default"

	I0831 15:06:03.718666    1510 default_sa.go:55] duration metric: took 196.95575ms for default service account to be created ...

	I0831 15:06:03.718674    1510 system_pods.go:116] waiting for k8s-apps to be running ...

	I0831 15:06:03.746588    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:03.925848    1510 system_pods.go:86] 17 kube-system pods found

	I0831 15:06:03.925866    1510 system_pods.go:89] "coredns-6f6b679f8f-dcgdp" [56ba471a-a1bd-4d31-ab79-ff6b71deae1d] Running

	I0831 15:06:03.925873    1510 system_pods.go:89] "csi-hostpath-attacher-0" [eaa16d4a-ee3c-48fa-9f62-0a782f5151f1] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0831 15:06:03.925880    1510 system_pods.go:89] "csi-hostpath-resizer-0" [3627d990-7957-42ea-a642-f3f5fbd9a56f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0831 15:06:03.925885    1510 system_pods.go:89] "csi-hostpathplugin-cp7lz" [0cc88a88-660a-472b-9f9a-cf2f55fdd5e6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0831 15:06:03.925890    1510 system_pods.go:89] "etcd-addons-492000" [28080b3e-127a-4dd3-9c2a-f9bfdae164c1] Running

	I0831 15:06:03.925893    1510 system_pods.go:89] "kube-apiserver-addons-492000" [b4f55987-b4a2-47dd-b470-613ee3d3950f] Running

	I0831 15:06:03.925896    1510 system_pods.go:89] "kube-controller-manager-addons-492000" [bf425e59-cb5a-4c0f-8cd0-6c70ac91ef34] Running

	I0831 15:06:03.925900    1510 system_pods.go:89] "kube-ingress-dns-minikube" [58edb9c3-1e48-47b4-98e2-19827c514533] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0831 15:06:03.925903    1510 system_pods.go:89] "kube-proxy-c9pfm" [e4dea774-7ae5-4950-a557-b103730150de] Running

	I0831 15:06:03.925906    1510 system_pods.go:89] "kube-scheduler-addons-492000" [01f5db5d-2c73-4ac5-ac2d-f160ee2ebbd2] Running

	I0831 15:06:03.925911    1510 system_pods.go:89] "metrics-server-84c5f94fbc-p6wqw" [61c9f92c-d1e6-4024-9b33-3c247eca65f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0831 15:06:03.925917    1510 system_pods.go:89] "nvidia-device-plugin-daemonset-xbb9h" [5401db3a-6b96-4340-9c15-bc04f6727ea6] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0831 15:06:03.925921    1510 system_pods.go:89] "registry-6fb4cdfc84-dbh5s" [f256bb8d-d37d-4371-a5a9-38e94d41cce2] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0831 15:06:03.925924    1510 system_pods.go:89] "registry-proxy-7mcwz" [bb84f056-88e3-4c3d-845b-eb2704863b95] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0831 15:06:03.925938    1510 system_pods.go:89] "snapshot-controller-56fcc65765-2hmhl" [dd2a1d6c-f1dd-4f94-9f43-74240d211026] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0831 15:06:03.925945    1510 system_pods.go:89] "snapshot-controller-56fcc65765-zpf6n" [67f30329-e856-405c-9bc1-d2170a5ff69a] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0831 15:06:03.925949    1510 system_pods.go:89] "storage-provisioner" [197744a5-f425-4cf8-b155-dc152d9d9a2e] Running

	I0831 15:06:03.925955    1510 system_pods.go:126] duration metric: took 207.280041ms to wait for k8s-apps to be running ...

	I0831 15:06:03.925962    1510 system_svc.go:44] waiting for kubelet service to be running ....

	I0831 15:06:03.926060    1510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0831 15:06:03.934569    1510 system_svc.go:56] duration metric: took 8.603041ms WaitForService to wait for kubelet

	I0831 15:06:03.934584    1510 kubeadm.go:582] duration metric: took 9.3538455s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:06:03.934601    1510 node_conditions.go:102] verifying NodePressure condition ...

	I0831 15:06:04.017583    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:04.120275    1510 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0831 15:06:04.120287    1510 node_conditions.go:123] node cpu capacity is 2

	I0831 15:06:04.120293    1510 node_conditions.go:105] duration metric: took 185.689125ms to run NodePressure ...

	I0831 15:06:04.120299    1510 start.go:241] waiting for startup goroutines ...

	I0831 15:06:04.313180    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:04.519708    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:04.746021    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:05.018844    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:05.245003    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:05.520289    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:05.747261    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:06.021458    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:06.313184    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:06.519711    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:06.745989    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:07.018964    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:07.246056    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:07.518874    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:07.746251    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:08.018780    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:08.245959    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:08.519059    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:08.745896    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0831 15:06:09.018636    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:09.245772    1510 kapi.go:107] duration metric: took 14.003420666s to wait for kubernetes.io/minikube-addons=registry ...

	I0831 15:06:09.519767    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:10.021802    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:10.518779    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:11.018889    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:11.518611    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:12.018735    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:12.518919    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:13.019053    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:13.519287    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:14.018681    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:14.518580    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:15.035732    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:15.518645    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:16.018557    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:16.518606    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:17.018600    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:17.518614    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:18.018683    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:18.518665    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:19.018582    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:19.518870    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:20.021151    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:20.519618    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:21.018727    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:21.520180    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:22.019466    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:22.518477    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:23.018320    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:23.518436    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:24.018150    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:24.521088    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:25.018185    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:25.518491    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:26.021047    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:26.517389    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:27.020112    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:27.518697    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:28.018559    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:28.518420    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:29.019519    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:29.518229    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:30.018384    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:30.518166    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:31.018069    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:31.518597    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:32.019061    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:32.519494    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:33.019115    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:33.518245    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:34.018773    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:34.518252    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:35.019048    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:35.519660    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:36.019319    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:36.518018    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:37.018198    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:37.518766    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:38.023996    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:38.518883    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:39.018218    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:39.518399    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:40.020818    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:40.518975    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:41.018118    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:41.518073    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:42.018708    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:42.518210    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:43.017965    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:43.518022    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:44.018414    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:44.518313    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:45.017925    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:45.518104    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:46.018599    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:46.518357    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:47.017873    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:47.518406    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:48.018297    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:48.516342    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:49.016820    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:49.517665    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:50.018061    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:50.517875    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:51.018865    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:51.517925    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:52.018440    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:52.517840    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:53.020616    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:53.517868    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:54.019731    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:54.515792    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:55.016053    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:55.517598    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0831 15:06:56.018477    1510 kapi.go:107] duration metric: took 56.505144292s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0831 15:07:02.211028    1510 kapi.go:86] Found 2 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0831 15:07:02.211040    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:02.710196    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:03.210242    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:03.713824    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:04.210302    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:04.710335    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:05.212391    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:05.715290    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:06.210105    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:06.710402    1510 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0831 15:07:07.211196    1510 kapi.go:107] duration metric: took 1m8.005149s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0831 15:07:25.257644    1510 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0831 15:07:25.257654    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:25.758671    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:26.258521    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:26.758274    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:27.258344    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:27.758259    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:28.258619    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:28.758003    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:29.258538    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:29.758342    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:30.258196    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:30.758210    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:31.258346    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:31.757937    1510 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0831 15:07:32.258360    1510 kapi.go:107] duration metric: took 1m29.003890208s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0831 15:07:32.262141    1510 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-492000 cluster.

	I0831 15:07:32.269019    1510 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0831 15:07:32.273474    1510 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0831 15:07:32.278062    1510 out.go:177] * Enabled addons: ingress-dns, volcano, yakd, storage-provisioner-rancher, cloud-spanner, nvidia-device-plugin, storage-provisioner, inspektor-gadget, metrics-server, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0831 15:07:32.281067    1510 addons.go:510] duration metric: took 1m37.702478959s for enable addons: enabled=[ingress-dns volcano yakd storage-provisioner-rancher cloud-spanner nvidia-device-plugin storage-provisioner inspektor-gadget metrics-server default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

	I0831 15:07:32.281080    1510 start.go:246] waiting for cluster config update ...

	I0831 15:07:32.281090    1510 start.go:255] writing updated cluster config ...

	I0831 15:07:32.282723    1510 ssh_runner.go:195] Run: rm -f paused

	I0831 15:07:32.441308    1510 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0831 15:07:32.445997    1510 out.go:201] 

	W0831 15:07:32.450802    1510 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0831 15:07:32.455289    1510 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0831 15:07:32.462054    1510 out.go:177] * Done! kubectl is now configured to use "addons-492000" cluster and "default" namespace by default

	==> Docker <==

	Aug 31 22:17:18 addons-492000 cri-dockerd[1179]: time="2024-08-31T22:17:18Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"

	Aug 31 22:17:18 addons-492000 dockerd[1285]: time="2024-08-31T22:17:18.900434441Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 31 22:17:18 addons-492000 dockerd[1285]: time="2024-08-31T22:17:18.900460428Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 31 22:17:18 addons-492000 dockerd[1285]: time="2024-08-31T22:17:18.900474338Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:17:18 addons-492000 dockerd[1285]: time="2024-08-31T22:17:18.900502199Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:17:22 addons-492000 dockerd[1279]: time="2024-08-31T22:17:22.235651743Z" level=info msg="ignoring event" container=0fbbb94840f7296508a903841a6fccf6234c1585b3d43a090292d99543ee7191 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.235764938Z" level=info msg="shim disconnected" id=0fbbb94840f7296508a903841a6fccf6234c1585b3d43a090292d99543ee7191 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.235813122Z" level=warning msg="cleaning up after shim disconnected" id=0fbbb94840f7296508a903841a6fccf6234c1585b3d43a090292d99543ee7191 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.235817287Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.392578004Z" level=info msg="shim disconnected" id=ec6857b91f36de15e5d499399219ba3da5e33281c565f936c4ae0bb4c99ea35b namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.392613236Z" level=warning msg="cleaning up after shim disconnected" id=ec6857b91f36de15e5d499399219ba3da5e33281c565f936c4ae0bb4c99ea35b namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.392921460Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1279]: time="2024-08-31T22:17:22.392852286Z" level=info msg="ignoring event" container=ec6857b91f36de15e5d499399219ba3da5e33281c565f936c4ae0bb4c99ea35b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.423206443Z" level=info msg="shim disconnected" id=1a69a70f467790f40583cf4b6583c83dcd07d25ff5a212f5e643c49c0f04e9e9 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.423238928Z" level=warning msg="cleaning up after shim disconnected" id=1a69a70f467790f40583cf4b6583c83dcd07d25ff5a212f5e643c49c0f04e9e9 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1279]: time="2024-08-31T22:17:22.424068854Z" level=info msg="ignoring event" container=1a69a70f467790f40583cf4b6583c83dcd07d25ff5a212f5e643c49c0f04e9e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.423243675Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1279]: time="2024-08-31T22:17:22.481801837Z" level=info msg="ignoring event" container=8a7d6a80f4449ab46676f0be37859d9428ae780c5fc983d02751cd254dc49096 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.482268316Z" level=info msg="shim disconnected" id=8a7d6a80f4449ab46676f0be37859d9428ae780c5fc983d02751cd254dc49096 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.482302299Z" level=warning msg="cleaning up after shim disconnected" id=8a7d6a80f4449ab46676f0be37859d9428ae780c5fc983d02751cd254dc49096 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.482309046Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1279]: time="2024-08-31T22:17:22.548439286Z" level=info msg="ignoring event" container=96214ee629c2f4a103a7aaa2abda96090aaca28371802458064c018e27f8bec5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.548513916Z" level=info msg="shim disconnected" id=96214ee629c2f4a103a7aaa2abda96090aaca28371802458064c018e27f8bec5 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.548546442Z" level=warning msg="cleaning up after shim disconnected" id=96214ee629c2f4a103a7aaa2abda96090aaca28371802458064c018e27f8bec5 namespace=moby

	Aug 31 22:17:22 addons-492000 dockerd[1285]: time="2024-08-31T22:17:22.548550857Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                       ATTEMPT             POD ID              POD

	777c191b55027       nginx@sha256:c04c18adc2a407740a397c8407c011fc6c90026a9b65cceddef7ae5484360158                                                4 seconds ago       Running             nginx                      0                   4a9aa1f695c64       nginx

	6a867708909cc       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb                 9 minutes ago       Running             gcp-auth                   0                   00c7f5a621c76       gcp-auth-89d5ffd79-wdfjr

	db794dd61138d       registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce             9 minutes ago       Running             controller                 0                   216858a39f344       ingress-nginx-controller-bc57996ff-cqr6m

	e788d1229813b       420193b27261a                                                                                                                10 minutes ago      Exited              patch                      1                   6aa69fce92a4d       ingress-nginx-admission-patch-vh6m6

	afdb2e4f3bc37       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   10 minutes ago      Exited              create                     0                   4674cd526709e       ingress-nginx-admission-create-969c8

	6829996610dab       gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc               10 minutes ago      Running             cloud-spanner-emulator     0                   355e0ad8d6efd       cloud-spanner-emulator-769b77f747-gsrh2

	840d59d2cc069       rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246                       11 minutes ago      Running             local-path-provisioner     0                   a050a48526389       local-path-provisioner-86d989889c-n52tb

	a8b2ed44e9901       nvcr.io/nvidia/k8s-device-plugin@sha256:ed39e22c8b71343fb996737741a99da88ce6c75dd83b5c520e0b3d8e8a884c47                     11 minutes ago      Running             nvidia-device-plugin-ctr   0                   d6d73563d3a4c       nvidia-device-plugin-daemonset-xbb9h

	43c357203b6fc       marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624                                        11 minutes ago      Running             yakd                       0                   ed7a3224d17a6       yakd-dashboard-67d98fc6b-wn4h6

	1a69a70f46779       gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367              11 minutes ago      Exited              registry-proxy             0                   96214ee629c2f       registry-proxy-7mcwz

	ec6857b91f36d       registry@sha256:12120425f07de11a1b899e418d4b0ea174c8d4d572d45bdb640f93bc7ca06a3d                                             11 minutes ago      Exited              registry                   0                   8a7d6a80f4449       registry-6fb4cdfc84-dbh5s

	5d7dcfe608918       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             11 minutes ago      Running             minikube-ingress-dns       0                   acd077e0df333       kube-ingress-dns-minikube

	bc93fdabde220       ba04bb24b9575                                                                                                                11 minutes ago      Running             storage-provisioner        0                   b1eadf4a3cca4       storage-provisioner

	2d7e2572c7cab       2437cf7621777                                                                                                                11 minutes ago      Running             coredns                    0                   aac0af45edca8       coredns-6f6b679f8f-dcgdp

	b350457b47f5f       71d55d66fd4ee                                                                                                                11 minutes ago      Running             kube-proxy                 0                   6f52eed1adc98       kube-proxy-c9pfm

	e05eb9bbd5a03       fbbbd428abb4d                                                                                                                11 minutes ago      Running             kube-scheduler             0                   b413b5f39df80       kube-scheduler-addons-492000

	30c5b2e67a2f9       27e3830e14027                                                                                                                11 minutes ago      Running             etcd                       0                   e059c93f39e18       etcd-addons-492000

	01e29b6f418ce       fcb0683e6bdbd                                                                                                                11 minutes ago      Running             kube-controller-manager    0                   d2f420981ec1c       kube-controller-manager-addons-492000

	a5f317a16d699       cd0f0ae0ec9e0                                                                                                                11 minutes ago      Running             kube-apiserver             0                   c2740ea2220dc       kube-apiserver-addons-492000

	==> controller_ingress [db794dd61138] <==

	I0831 22:07:28.288254       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"2d31b580-a798-4b51-9222-103e5b8dbfc8", APIVersion:"v1", ResourceVersion:"761", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services

	I0831 22:07:28.288262       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"56379ba5-acca-4a54-ba1d-8c66a4604f85", APIVersion:"v1", ResourceVersion:"764", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services

	I0831 22:07:29.482630       7 nginx.go:317] "Starting NGINX process"

	I0831 22:07:29.482714       7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...

	I0831 22:07:29.482821       7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"

	I0831 22:07:29.482892       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0831 22:07:29.490704       7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader

	I0831 22:07:29.490908       7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-cqr6m"

	I0831 22:07:29.505877       7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-cqr6m" node="addons-492000"

	I0831 22:07:29.518902       7 controller.go:213] "Backend successfully reloaded"

	I0831 22:07:29.518952       7 controller.go:224] "Initial sync, sleeping for 1 second"

	I0831 22:07:29.519199       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-cqr6m", UID:"bf42cf20-33e6-44ef-8dd0-63dea4f21fce", APIVersion:"v1", ResourceVersion:"1335", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	W0831 22:17:15.413677       7 controller.go:1110] Error obtaining Endpoints for Service "default/nginx": no object matching key "default/nginx" in local store

	I0831 22:17:15.422925       7 admission.go:149] processed ingress via admission controller {testedIngressLength:1 testedIngressTime:0.009s renderingIngressLength:1 renderingIngressTime:0s admissionTime:0.009s testedConfigurationSize:18.1kB}

	I0831 22:17:15.422942       7 main.go:107] "successfully validated configuration, accepting" ingress="default/nginx-ingress"

	I0831 22:17:15.426106       7 store.go:440] "Found valid IngressClass" ingress="default/nginx-ingress" ingressclass="nginx"

	W0831 22:17:15.426407       7 controller.go:1110] Error obtaining Endpoints for Service "default/nginx": no object matching key "default/nginx" in local store

	I0831 22:17:15.426453       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0831 22:17:15.427861       7 event.go:377] Event(v1.ObjectReference{Kind:"Ingress", Namespace:"default", Name:"nginx-ingress", UID:"20441af2-91de-495b-9e51-7f608cadf6d2", APIVersion:"networking.k8s.io/v1", ResourceVersion:"2661", FieldPath:""}): type: 'Normal' reason: 'Sync' Scheduled for sync

	I0831 22:17:15.447706       7 controller.go:213] "Backend successfully reloaded"

	I0831 22:17:15.448018       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-cqr6m", UID:"bf42cf20-33e6-44ef-8dd0-63dea4f21fce", APIVersion:"v1", ResourceVersion:"1335", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	W0831 22:17:18.760089       7 controller.go:1216] Service "default/nginx" does not have any active Endpoint.

	I0831 22:17:18.760152       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0831 22:17:18.868599       7 controller.go:213] "Backend successfully reloaded"

	I0831 22:17:18.868886       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-cqr6m", UID:"bf42cf20-33e6-44ef-8dd0-63dea4f21fce", APIVersion:"v1", ResourceVersion:"1335", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	==> coredns [2d7e2572c7ca] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 591cf328cccc12bc490481273e738df59329c62c0b729d94e8b61db9961c2fa5f046dd37f1cf888b953814040d180f52594972691cd6ff41be96639138a43908

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] Reloading

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	[INFO] Reloading complete

	[INFO] 127.0.0.1:58535 - 46229 "HINFO IN 5418551689093171039.8736883536661458860. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.011533172s

	[INFO] 10.244.0.25:45743 - 26571 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000129719s

	[INFO] 10.244.0.25:38278 - 47261 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000270566s

	[INFO] 10.244.0.25:45526 - 22936 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000051354s

	[INFO] 10.244.0.25:51532 - 53290 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000034056s

	[INFO] 10.244.0.25:41993 - 27148 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031513s

	[INFO] 10.244.0.25:49484 - 60655 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000029887s

	[INFO] 10.244.0.25:52801 - 27133 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 496 0.001274467s

	[INFO] 10.244.0.25:53100 - 45434 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002422842s

	==> describe nodes <==

	Name:               addons-492000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-492000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=8ab9a20c866aaad18bea6fac47c5d146303457d2

	                    minikube.k8s.io/name=addons-492000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_31T15_05_49_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-492000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 31 Aug 2024 22:05:46 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-492000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 31 Aug 2024 22:17:22 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 31 Aug 2024 22:13:26 +0000   Sat, 31 Aug 2024 22:05:45 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 31 Aug 2024 22:13:26 +0000   Sat, 31 Aug 2024 22:05:45 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 31 Aug 2024 22:13:26 +0000   Sat, 31 Aug 2024 22:05:45 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 31 Aug 2024 22:13:26 +0000   Sat, 31 Aug 2024 22:05:52 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-492000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 f35de5166cbb4de3a2df9106c4dee883

	  System UUID:                f35de5166cbb4de3a2df9106c4dee883

	  Boot ID:                    cd1d7565-3d48-4719-b0b4-f7975d7fd69f

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (16 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m11s

	  default                     cloud-spanner-emulator-769b77f747-gsrh2     0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  default                     nginx                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         7s

	  gcp-auth                    gcp-auth-89d5ffd79-wdfjr                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m57s

	  ingress-nginx               ingress-nginx-controller-bc57996ff-cqr6m    100m (5%)     0 (0%)      90Mi (2%)        0 (0%)         10m

	  kube-system                 coredns-6f6b679f8f-dcgdp                    100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     11m

	  kube-system                 etcd-addons-492000                          100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         11m

	  kube-system                 kube-apiserver-addons-492000                250m (12%)    0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 kube-controller-manager-addons-492000       200m (10%)    0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 kube-proxy-c9pfm                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 kube-scheduler-addons-492000                100m (5%)     0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 nvidia-device-plugin-daemonset-xbb9h        0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  local-path-storage          local-path-provisioner-86d989889c-n52tb     0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  yakd-dashboard              yakd-dashboard-67d98fc6b-wn4h6              0 (0%)        0 (0%)      128Mi (3%)       256Mi (6%)     11m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                850m (42%)   0 (0%)

	  memory             388Mi (10%)  426Mi (11%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-1Gi      0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	  hugepages-32Mi     0 (0%)       0 (0%)

	  hugepages-64Ki     0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 11m                kube-proxy       

	  Normal  NodeHasSufficientMemory  11m (x8 over 11m)  kubelet          Node addons-492000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    11m (x8 over 11m)  kubelet          Node addons-492000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     11m (x7 over 11m)  kubelet          Node addons-492000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  11m                kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 11m                kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  11m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  11m                kubelet          Node addons-492000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    11m                kubelet          Node addons-492000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     11m                kubelet          Node addons-492000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                11m                kubelet          Node addons-492000 status is now: NodeReady

	  Normal  RegisteredNode           11m                node-controller  Node addons-492000 event: Registered Node addons-492000 in Controller

	==> dmesg <==

	[  +7.630901] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.916901] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.675696] kauditd_printk_skb: 5 callbacks suppressed

	[  +5.092380] kauditd_printk_skb: 29 callbacks suppressed

	[  +5.753178] kauditd_printk_skb: 6 callbacks suppressed

	[  +6.371112] kauditd_printk_skb: 7 callbacks suppressed

	[  +6.136482] kauditd_printk_skb: 24 callbacks suppressed

	[  +5.821823] kauditd_printk_skb: 7 callbacks suppressed

	[Aug31 22:07] kauditd_printk_skb: 87 callbacks suppressed

	[ +13.549093] kauditd_printk_skb: 11 callbacks suppressed

	[  +6.802090] kauditd_printk_skb: 22 callbacks suppressed

	[  +9.628459] kauditd_printk_skb: 6 callbacks suppressed

	[ +12.582347] kauditd_printk_skb: 6 callbacks suppressed

	[ +10.610509] kauditd_printk_skb: 7 callbacks suppressed

	[Aug31 22:08] kauditd_printk_skb: 20 callbacks suppressed

	[  +9.367136] kauditd_printk_skb: 2 callbacks suppressed

	[ +10.504633] kauditd_printk_skb: 2 callbacks suppressed

	[Aug31 22:12] kauditd_printk_skb: 2 callbacks suppressed

	[Aug31 22:16] kauditd_printk_skb: 2 callbacks suppressed

	[ +11.924351] kauditd_printk_skb: 19 callbacks suppressed

	[ +17.339959] kauditd_printk_skb: 7 callbacks suppressed

	[  +7.621030] kauditd_printk_skb: 33 callbacks suppressed

	[Aug31 22:17] kauditd_printk_skb: 6 callbacks suppressed

	[  +5.252100] kauditd_printk_skb: 2 callbacks suppressed

	[ +12.053379] kauditd_printk_skb: 13 callbacks suppressed

	==> etcd [30c5b2e67a2f] <==

	{"level":"info","ts":"2024-08-31T22:05:45.917588Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2024-08-31T22:05:45.917717Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2024-08-31T22:05:45.917750Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2024-08-31T22:05:45.917786Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2024-08-31T22:05:45.917804Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-08-31T22:05:45.917830Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2024-08-31T22:05:45.917860Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2024-08-31T22:05:45.918589Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-492000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-31T22:05:45.918634Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:05:45.918665Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-31T22:05:45.919573Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:05:45.920129Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2024-08-31T22:05:45.918702Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:05:45.918792Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-31T22:05:45.920371Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-31T22:05:45.920676Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:05:45.921151Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-08-31T22:05:45.922229Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-31T22:05:45.922259Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-31T22:05:45.922269Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"warn","ts":"2024-08-31T22:07:28.093013Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"111.622327ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csistoragecapacities/\" range_end:\"/registry/csistoragecapacities0\" count_only:true ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-08-31T22:07:28.093169Z","caller":"traceutil/trace.go:171","msg":"trace[1317611377] range","detail":"{range_begin:/registry/csistoragecapacities/; range_end:/registry/csistoragecapacities0; response_count:0; response_revision:1356; }","duration":"111.776721ms","start":"2024-08-31T22:07:27.981363Z","end":"2024-08-31T22:07:28.093140Z","steps":["trace[1317611377] 'count revisions from in-memory index tree'  (duration: 111.593524ms)"],"step_count":1}

	{"level":"info","ts":"2024-08-31T22:15:45.953621Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1880}

	{"level":"info","ts":"2024-08-31T22:15:46.058658Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1880,"took":"102.243277ms","hash":825096190,"current-db-size-bytes":9048064,"current-db-size":"9.0 MB","current-db-size-in-use-bytes":4952064,"current-db-size-in-use":"5.0 MB"}

	{"level":"info","ts":"2024-08-31T22:15:46.059116Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":825096190,"revision":1880,"compact-revision":-1}

	==> gcp-auth [6a867708909c] <==

	2024/08/31 22:07:31 GCP Auth Webhook started!

	2024/08/31 22:07:48 Ready to marshal response ...

	2024/08/31 22:07:48 Ready to write response ...

	2024/08/31 22:07:49 Ready to marshal response ...

	2024/08/31 22:07:49 Ready to write response ...

	2024/08/31 22:08:10 Ready to marshal response ...

	2024/08/31 22:08:10 Ready to write response ...

	2024/08/31 22:08:11 Ready to marshal response ...

	2024/08/31 22:08:11 Ready to write response ...

	2024/08/31 22:08:11 Ready to marshal response ...

	2024/08/31 22:08:11 Ready to write response ...

	2024/08/31 22:16:22 Ready to marshal response ...

	2024/08/31 22:16:22 Ready to write response ...

	2024/08/31 22:16:25 Ready to marshal response ...

	2024/08/31 22:16:25 Ready to write response ...

	2024/08/31 22:16:44 Ready to marshal response ...

	2024/08/31 22:16:44 Ready to write response ...

	2024/08/31 22:17:15 Ready to marshal response ...

	2024/08/31 22:17:15 Ready to write response ...

	==> kernel <==

	 22:17:22 up 11 min,  0 users,  load average: 0.30, 0.60, 0.46

	Linux addons-492000 5.10.207 #1 SMP PREEMPT Wed Aug 28 18:03:56 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [a5f317a16d69] <==

	W0831 22:08:02.132675       1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh

	W0831 22:08:02.333233       1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh

	W0831 22:08:02.378085       1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh

	W0831 22:08:02.384873       1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh

	W0831 22:08:02.477080       1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh

	W0831 22:08:02.541722       1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh

	W0831 22:08:02.608407       1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh

	I0831 22:16:33.357740       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I0831 22:16:59.349713       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0831 22:16:59.349741       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0831 22:16:59.357612       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0831 22:16:59.357630       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0831 22:16:59.373306       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0831 22:16:59.373452       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0831 22:16:59.378499       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0831 22:16:59.378527       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0831 22:16:59.388363       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0831 22:16:59.388383       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W0831 22:17:00.374839       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W0831 22:17:00.388968       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	W0831 22:17:00.483635       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	I0831 22:17:10.093630       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	W0831 22:17:11.203873       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io

	I0831 22:17:15.423361       1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io

	I0831 22:17:15.523250       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.110.56.97"}

	==> kube-controller-manager [01e29b6f418c] <==

	W0831 22:17:08.163358       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:08.163423       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:09.407184       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:09.407217       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:09.644324       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:09.644444       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:09.691600       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:09.691661       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	E0831 22:17:11.205178       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:12.696989       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:12.697108       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:14.728828       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:14.728949       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:17.551210       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:17.551235       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:17.861577       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:17.861597       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:19.425485       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:19.425513       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0831 22:17:20.178382       1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="gadget"

	W0831 22:17:20.217246       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:20.217352       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0831 22:17:21.907247       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0831 22:17:21.907361       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0831 22:17:22.367866       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-6fb4cdfc84" duration="3.748µs"

	==> kube-proxy [b350457b47f5] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0831 22:05:54.863632       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0831 22:05:54.868982       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.2"]

	E0831 22:05:54.869215       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0831 22:05:54.888058       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0831 22:05:54.888086       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0831 22:05:54.888100       1 server_linux.go:169] "Using iptables Proxier"

	I0831 22:05:54.889436       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0831 22:05:54.889548       1 server.go:483] "Version info" version="v1.31.0"

	I0831 22:05:54.889554       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0831 22:05:54.890541       1 config.go:197] "Starting service config controller"

	I0831 22:05:54.890549       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0831 22:05:54.890558       1 config.go:104] "Starting endpoint slice config controller"

	I0831 22:05:54.890560       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0831 22:05:54.890733       1 config.go:326] "Starting node config controller"

	I0831 22:05:54.890735       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0831 22:05:54.991230       1 shared_informer.go:320] Caches are synced for node config

	I0831 22:05:54.991251       1 shared_informer.go:320] Caches are synced for service config

	I0831 22:05:54.991267       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [e05eb9bbd5a0] <==

	W0831 22:05:46.488314       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0831 22:05:46.488346       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488380       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0831 22:05:46.488388       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488402       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0831 22:05:46.488444       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488465       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0831 22:05:46.488499       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488527       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0831 22:05:46.488536       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488604       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0831 22:05:46.488613       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:46.488900       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0831 22:05:46.488923       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:47.304137       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0831 22:05:47.304242       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:47.361836       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0831 22:05:47.361888       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:47.499699       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0831 22:05:47.499746       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:47.513070       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0831 22:05:47.513103       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0831 22:05:47.571807       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0831 22:05:47.571880       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"

	I0831 22:05:47.886859       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497615    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="67f30329-e856-405c-9bc1-d2170a5ff69a" containerName="volume-snapshot-controller"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497618    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cc88a88-660a-472b-9f9a-cf2f55fdd5e6" containerName="node-driver-registrar"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497621    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cc88a88-660a-472b-9f9a-cf2f55fdd5e6" containerName="csi-provisioner"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497623    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b7e73c3-2273-4a99-8671-c4f995870bdf" containerName="gadget"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497626    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b7e73c3-2273-4a99-8671-c4f995870bdf" containerName="gadget"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497629    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cc88a88-660a-472b-9f9a-cf2f55fdd5e6" containerName="hostpath"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497631    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="dd2a1d6c-f1dd-4f94-9f43-74240d211026" containerName="volume-snapshot-controller"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497634    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cc88a88-660a-472b-9f9a-cf2f55fdd5e6" containerName="csi-external-health-monitor-controller"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.497637    2041 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cc88a88-660a-472b-9f9a-cf2f55fdd5e6" containerName="liveness-probe"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.668481    2041 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxdb\" (UniqueName: \"kubernetes.io/projected/e303b475-85d7-47f1-ba2e-8f3cd8610c93-kube-api-access-krxdb\") pod \"nginx\" (UID: \"e303b475-85d7-47f1-ba2e-8f3cd8610c93\") " pod="default/nginx"

	Aug 31 22:17:15 addons-492000 kubelet[2041]: I0831 22:17:15.668527    2041 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/e303b475-85d7-47f1-ba2e-8f3cd8610c93-gcp-creds\") pod \"nginx\" (UID: \"e303b475-85d7-47f1-ba2e-8f3cd8610c93\") " pod="default/nginx"

	Aug 31 22:17:17 addons-492000 kubelet[2041]: E0831 22:17:17.456387    2041 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-test\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox\\\"\"" pod="default/registry-test" podUID="17d287e6-ce43-4610-aa99-6ee466611390"

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.169891    2041 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/nginx" podStartSLOduration=4.3371064839999995 podStartE2EDuration="7.169874914s" podCreationTimestamp="2024-08-31 22:17:15 +0000 UTC" firstStartedPulling="2024-08-31 22:17:15.90557952 +0000 UTC m=+687.495048095" lastFinishedPulling="2024-08-31 22:17:18.73834795 +0000 UTC m=+690.327816525" observedRunningTime="2024-08-31 22:17:19.356932331 +0000 UTC m=+690.946400905" watchObservedRunningTime="2024-08-31 22:17:22.169874914 +0000 UTC m=+693.759343488"

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.442637    2041 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/17d287e6-ce43-4610-aa99-6ee466611390-gcp-creds\") pod \"17d287e6-ce43-4610-aa99-6ee466611390\" (UID: \"17d287e6-ce43-4610-aa99-6ee466611390\") "

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.442663    2041 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htdhx\" (UniqueName: \"kubernetes.io/projected/17d287e6-ce43-4610-aa99-6ee466611390-kube-api-access-htdhx\") pod \"17d287e6-ce43-4610-aa99-6ee466611390\" (UID: \"17d287e6-ce43-4610-aa99-6ee466611390\") "

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.442684    2041 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/17d287e6-ce43-4610-aa99-6ee466611390-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "17d287e6-ce43-4610-aa99-6ee466611390" (UID: "17d287e6-ce43-4610-aa99-6ee466611390"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.446408    2041 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d287e6-ce43-4610-aa99-6ee466611390-kube-api-access-htdhx" (OuterVolumeSpecName: "kube-api-access-htdhx") pod "17d287e6-ce43-4610-aa99-6ee466611390" (UID: "17d287e6-ce43-4610-aa99-6ee466611390"). InnerVolumeSpecName "kube-api-access-htdhx". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.542820    2041 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tp7g\" (UniqueName: \"kubernetes.io/projected/f256bb8d-d37d-4371-a5a9-38e94d41cce2-kube-api-access-6tp7g\") pod \"f256bb8d-d37d-4371-a5a9-38e94d41cce2\" (UID: \"f256bb8d-d37d-4371-a5a9-38e94d41cce2\") "

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.542932    2041 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/17d287e6-ce43-4610-aa99-6ee466611390-gcp-creds\") on node \"addons-492000\" DevicePath \"\""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.542953    2041 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-htdhx\" (UniqueName: \"kubernetes.io/projected/17d287e6-ce43-4610-aa99-6ee466611390-kube-api-access-htdhx\") on node \"addons-492000\" DevicePath \"\""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.543796    2041 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f256bb8d-d37d-4371-a5a9-38e94d41cce2-kube-api-access-6tp7g" (OuterVolumeSpecName: "kube-api-access-6tp7g") pod "f256bb8d-d37d-4371-a5a9-38e94d41cce2" (UID: "f256bb8d-d37d-4371-a5a9-38e94d41cce2"). InnerVolumeSpecName "kube-api-access-6tp7g". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.643147    2041 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-6tp7g\" (UniqueName: \"kubernetes.io/projected/f256bb8d-d37d-4371-a5a9-38e94d41cce2-kube-api-access-6tp7g\") on node \"addons-492000\" DevicePath \"\""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.744228    2041 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkqt5\" (UniqueName: \"kubernetes.io/projected/bb84f056-88e3-4c3d-845b-eb2704863b95-kube-api-access-hkqt5\") pod \"bb84f056-88e3-4c3d-845b-eb2704863b95\" (UID: \"bb84f056-88e3-4c3d-845b-eb2704863b95\") "

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.744633    2041 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb84f056-88e3-4c3d-845b-eb2704863b95-kube-api-access-hkqt5" (OuterVolumeSpecName: "kube-api-access-hkqt5") pod "bb84f056-88e3-4c3d-845b-eb2704863b95" (UID: "bb84f056-88e3-4c3d-845b-eb2704863b95"). InnerVolumeSpecName "kube-api-access-hkqt5". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 31 22:17:22 addons-492000 kubelet[2041]: I0831 22:17:22.844906    2041 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-hkqt5\" (UniqueName: \"kubernetes.io/projected/bb84f056-88e3-4c3d-845b-eb2704863b95-kube-api-access-hkqt5\") on node \"addons-492000\" DevicePath \"\""

	==> storage-provisioner [bc93fdabde22] <==

	I0831 22:05:58.674428       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0831 22:05:58.864039       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0831 22:05:58.864064       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0831 22:05:58.885251       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0831 22:05:58.885623       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-492000_ac436aff-ee8f-4e8f-b578-23552e0a25f1!

	I0831 22:05:58.888963       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b5250d07-200d-466f-a5f2-12db8be7b0d4", APIVersion:"v1", ResourceVersion:"771", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-492000_ac436aff-ee8f-4e8f-b578-23552e0a25f1 became leader

	I0831 22:05:59.039752       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-492000_ac436aff-ee8f-4e8f-b578-23552e0a25f1!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-492000 -n addons-492000

helpers_test.go:262: (dbg) Run:  kubectl --context addons-492000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:273: non-running pods: busybox ingress-nginx-admission-create-969c8 ingress-nginx-admission-patch-vh6m6 registry-6fb4cdfc84-dbh5s registry-proxy-7mcwz

helpers_test.go:275: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======

helpers_test.go:278: (dbg) Run:  kubectl --context addons-492000 describe pod busybox ingress-nginx-admission-create-969c8 ingress-nginx-admission-patch-vh6m6 registry-6fb4cdfc84-dbh5s registry-proxy-7mcwz

helpers_test.go:278: (dbg) Non-zero exit: kubectl --context addons-492000 describe pod busybox ingress-nginx-admission-create-969c8 ingress-nginx-admission-patch-vh6m6 registry-6fb4cdfc84-dbh5s registry-proxy-7mcwz: exit status 1 (42.816542ms)

-- stdout --

	Name:             busybox

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-492000/192.168.105.2

	Start Time:       Sat, 31 Aug 2024 15:08:11 -0700

	Labels:           integration-test=busybox

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.27

	IPs:

	  IP:  10.244.0.27

	Containers:

	  busybox:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      sleep

	      3600

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qh5gq (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   True 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  kube-api-access-qh5gq:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  9m12s                  default-scheduler  Successfully assigned default/busybox to addons-492000

	  Normal   Pulling    7m41s (x4 over 9m12s)  kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Warning  Failed     7m41s (x4 over 9m12s)  kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed

	  Warning  Failed     7m41s (x4 over 9m12s)  kubelet            Error: ErrImagePull

	  Warning  Failed     7m27s (x6 over 9m12s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m3s (x21 over 9m12s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-969c8" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-vh6m6" not found

	Error from server (NotFound): pods "registry-6fb4cdfc84-dbh5s" not found

	Error from server (NotFound): pods "registry-proxy-7mcwz" not found

** /stderr **

helpers_test.go:280: kubectl --context addons-492000 describe pod busybox ingress-nginx-admission-create-969c8 ingress-nginx-admission-patch-vh6m6 registry-6fb4cdfc84-dbh5s registry-proxy-7mcwz: exit status 1

--- FAIL: TestAddons/parallel/Registry (71.26s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-731000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-731000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (10.026200375s)

-- stdout --

	* [cert-options-731000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-731000" primary control-plane node in "cert-options-731000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-731000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-731000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-731000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-731000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-731000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (80.410458ms)

-- stdout --

	* The control-plane node cert-options-731000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-731000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-731000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-731000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-731000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-731000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (41.978417ms)

-- stdout --

	* The control-plane node cert-options-731000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-731000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-731000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-731000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-731000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-08-31 15:51:17.650036 -0700 PDT m=+2784.592483418

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-731000 -n cert-options-731000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-731000 -n cert-options-731000: exit status 7 (30.925ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "cert-options-731000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "cert-options-731000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-731000

--- FAIL: TestCertOptions (10.29s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (10.128001125s)

-- stdout --

	* [cert-expiration-889000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-889000" primary control-plane node in "cert-expiration-889000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-889000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-889000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.230961625s)

-- stdout --

	* [cert-expiration-889000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-889000" primary control-plane node in "cert-expiration-889000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-889000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-889000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-889000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-889000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-889000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-889000" primary control-plane node in "cert-expiration-889000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-889000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-889000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-889000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-08-31 15:54:17.541111 -0700 PDT m=+2964.505421960

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-889000 -n cert-expiration-889000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-889000 -n cert-expiration-889000: exit status 7 (58.496542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "cert-expiration-889000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "cert-expiration-889000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-889000

--- FAIL: TestCertExpiration (195.50s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-502000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-502000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.313694083s)

-- stdout --

	* [docker-flags-502000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-502000" primary control-plane node in "docker-flags-502000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-502000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:50:56.952923    4221 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:50:56.953146    4221 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:56.953149    4221 out.go:358] Setting ErrFile to fd 2...

	I0831 15:50:56.953152    4221 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:56.953280    4221 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:50:56.954322    4221 out.go:352] Setting JSON to false

	I0831 15:50:56.970271    4221 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3020,"bootTime":1725141636,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:50:56.970375    4221 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:50:56.975543    4221 out.go:177] * [docker-flags-502000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:50:56.983569    4221 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:50:56.983645    4221 notify.go:220] Checking for updates...

	I0831 15:50:56.990441    4221 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:50:56.993475    4221 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:50:56.996575    4221 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:50:56.999428    4221 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:50:57.002456    4221 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:50:57.005752    4221 config.go:182] Loaded profile config "force-systemd-flag-751000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:57.005822    4221 config.go:182] Loaded profile config "multinode-334000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:57.005867    4221 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:50:57.009363    4221 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:50:57.016508    4221 start.go:297] selected driver: qemu2

	I0831 15:50:57.016515    4221 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:50:57.016522    4221 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:50:57.018730    4221 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:50:57.022418    4221 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:50:57.025639    4221 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0831 15:50:57.025667    4221 cni.go:84] Creating CNI manager for ""

	I0831 15:50:57.025676    4221 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:50:57.025680    4221 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0831 15:50:57.025715    4221 start.go:340] cluster config:

	{Name:docker-flags-502000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-502000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn

etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:50:57.029445    4221 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:50:57.038473    4221 out.go:177] * Starting "docker-flags-502000" primary control-plane node in "docker-flags-502000" cluster

	I0831 15:50:57.042526    4221 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:50:57.042541    4221 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:50:57.042555    4221 cache.go:56] Caching tarball of preloaded images

	I0831 15:50:57.042643    4221 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:50:57.042656    4221 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:50:57.042721    4221 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/docker-flags-502000/config.json ...

	I0831 15:50:57.042736    4221 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/docker-flags-502000/config.json: {Name:mk561ee8a2dff2cfb471a0512fedef8267a723a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:50:57.042973    4221 start.go:360] acquireMachinesLock for docker-flags-502000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:57.043010    4221 start.go:364] duration metric: took 30.708µs to acquireMachinesLock for "docker-flags-502000"

	I0831 15:50:57.043022    4221 start.go:93] Provisioning new machine with config: &{Name:docker-flags-502000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-502000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:57.043080    4221 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:57.051495    4221 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:57.069802    4221 start.go:159] libmachine.API.Create for "docker-flags-502000" (driver="qemu2")

	I0831 15:50:57.069837    4221 client.go:168] LocalClient.Create starting

	I0831 15:50:57.069902    4221 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:57.069931    4221 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:57.069943    4221 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:57.069995    4221 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:57.070021    4221 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:57.070029    4221 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:57.070406    4221 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:57.232272    4221 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:57.287303    4221 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:57.287308    4221 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:57.287496    4221 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:50:57.296641    4221 main.go:141] libmachine: STDOUT: 

	I0831 15:50:57.296662    4221 main.go:141] libmachine: STDERR: 

	I0831 15:50:57.296709    4221 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2 +20000M

	I0831 15:50:57.304542    4221 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:57.304557    4221 main.go:141] libmachine: STDERR: 

	I0831 15:50:57.304568    4221 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:50:57.304573    4221 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:57.304588    4221 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:57.304617    4221 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/qemu.pid -device virtio-net-pci,netdev=net0,mac=26:f7:7e:51:80:0f -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:50:57.306184    4221 main.go:141] libmachine: STDOUT: 

	I0831 15:50:57.306199    4221 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:57.306226    4221 client.go:171] duration metric: took 236.383417ms to LocalClient.Create

	I0831 15:50:59.308365    4221 start.go:128] duration metric: took 2.265315208s to createHost

	I0831 15:50:59.308437    4221 start.go:83] releasing machines lock for "docker-flags-502000", held for 2.2654735s

	W0831 15:50:59.308483    4221 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:59.325863    4221 out.go:177] * Deleting "docker-flags-502000" in qemu2 ...

	W0831 15:50:59.355824    4221 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:59.355845    4221 start.go:729] Will try again in 5 seconds ...

	I0831 15:51:04.357925    4221 start.go:360] acquireMachinesLock for docker-flags-502000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:51:04.701852    4221 start.go:364] duration metric: took 343.798708ms to acquireMachinesLock for "docker-flags-502000"

	I0831 15:51:04.701977    4221 start.go:93] Provisioning new machine with config: &{Name:docker-flags-502000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-502000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:51:04.702311    4221 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:51:04.713000    4221 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:51:04.761759    4221 start.go:159] libmachine.API.Create for "docker-flags-502000" (driver="qemu2")

	I0831 15:51:04.761802    4221 client.go:168] LocalClient.Create starting

	I0831 15:51:04.761936    4221 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:51:04.762007    4221 main.go:141] libmachine: Decoding PEM data...

	I0831 15:51:04.762023    4221 main.go:141] libmachine: Parsing certificate...

	I0831 15:51:04.762085    4221 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:51:04.762129    4221 main.go:141] libmachine: Decoding PEM data...

	I0831 15:51:04.762141    4221 main.go:141] libmachine: Parsing certificate...

	I0831 15:51:04.762709    4221 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:51:04.936742    4221 main.go:141] libmachine: Creating SSH key...

	I0831 15:51:05.159790    4221 main.go:141] libmachine: Creating Disk image...

	I0831 15:51:05.159802    4221 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:51:05.160063    4221 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:51:05.170041    4221 main.go:141] libmachine: STDOUT: 

	I0831 15:51:05.170060    4221 main.go:141] libmachine: STDERR: 

	I0831 15:51:05.170106    4221 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2 +20000M

	I0831 15:51:05.177966    4221 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:51:05.177981    4221 main.go:141] libmachine: STDERR: 

	I0831 15:51:05.177995    4221 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:51:05.178000    4221 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:51:05.178015    4221 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:51:05.178047    4221 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/qemu.pid -device virtio-net-pci,netdev=net0,mac=52:9e:c1:03:b6:be -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/docker-flags-502000/disk.qcow2

	I0831 15:51:05.179636    4221 main.go:141] libmachine: STDOUT: 

	I0831 15:51:05.179654    4221 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:51:05.179668    4221 client.go:171] duration metric: took 417.872084ms to LocalClient.Create

	I0831 15:51:07.181809    4221 start.go:128] duration metric: took 2.479530833s to createHost

	I0831 15:51:07.181888    4221 start.go:83] releasing machines lock for "docker-flags-502000", held for 2.480027666s

	W0831 15:51:07.182342    4221 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-502000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-502000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:51:07.205896    4221 out.go:201] 

	W0831 15:51:07.210993    4221 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:51:07.211020    4221 out.go:270] * 

	* 

	W0831 15:51:07.214052    4221 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:51:07.223874    4221 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-502000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-502000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-502000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (78.656666ms)

-- stdout --

	* The control-plane node docker-flags-502000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-502000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-502000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-502000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-502000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-502000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-502000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-502000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-502000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (43.710166ms)

-- stdout --

	* The control-plane node docker-flags-502000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-502000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-502000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-502000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-502000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-502000\"\n"

panic.go:626: *** TestDockerFlags FAILED at 2024-08-31 15:51:07.36376 -0700 PDT m=+2774.305950668

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-502000 -n docker-flags-502000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-502000 -n docker-flags-502000: exit status 7 (29.134583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "docker-flags-502000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "docker-flags-502000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-502000

--- FAIL: TestDockerFlags (10.54s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-751000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-751000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.100037583s)

-- stdout --

	* [force-systemd-flag-751000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-751000" primary control-plane node in "force-systemd-flag-751000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-751000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:50:51.928701    4200 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:50:51.928833    4200 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:51.928837    4200 out.go:358] Setting ErrFile to fd 2...

	I0831 15:50:51.928839    4200 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:51.928971    4200 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:50:51.930023    4200 out.go:352] Setting JSON to false

	I0831 15:50:51.946088    4200 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3015,"bootTime":1725141636,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:50:51.946160    4200 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:50:51.952739    4200 out.go:177] * [force-systemd-flag-751000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:50:51.960690    4200 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:50:51.960774    4200 notify.go:220] Checking for updates...

	I0831 15:50:51.968636    4200 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:50:51.972677    4200 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:50:51.976670    4200 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:50:51.979639    4200 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:50:51.982674    4200 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:50:51.985994    4200 config.go:182] Loaded profile config "force-systemd-env-325000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:51.986071    4200 config.go:182] Loaded profile config "multinode-334000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:51.986117    4200 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:50:51.990669    4200 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:50:51.997698    4200 start.go:297] selected driver: qemu2

	I0831 15:50:51.997703    4200 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:50:51.997709    4200 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:50:52.000168    4200 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:50:52.003639    4200 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:50:52.006731    4200 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0831 15:50:52.006745    4200 cni.go:84] Creating CNI manager for ""

	I0831 15:50:52.006752    4200 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:50:52.006759    4200 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0831 15:50:52.006782    4200 start.go:340] cluster config:

	{Name:force-systemd-flag-751000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-751000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static

IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:50:52.010472    4200 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:50:52.018618    4200 out.go:177] * Starting "force-systemd-flag-751000" primary control-plane node in "force-systemd-flag-751000" cluster

	I0831 15:50:52.022649    4200 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:50:52.022662    4200 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:50:52.022695    4200 cache.go:56] Caching tarball of preloaded images

	I0831 15:50:52.022753    4200 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:50:52.022759    4200 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:50:52.022819    4200 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/force-systemd-flag-751000/config.json ...

	I0831 15:50:52.022830    4200 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/force-systemd-flag-751000/config.json: {Name:mkc38b5753b1c33b704a4d9c3ebdfed9f9339d57 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:50:52.023058    4200 start.go:360] acquireMachinesLock for force-systemd-flag-751000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:52.023098    4200 start.go:364] duration metric: took 29.875µs to acquireMachinesLock for "force-systemd-flag-751000"

	I0831 15:50:52.023110    4200 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-751000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-751000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:52.023149    4200 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:52.031725    4200 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:52.049811    4200 start.go:159] libmachine.API.Create for "force-systemd-flag-751000" (driver="qemu2")

	I0831 15:50:52.049838    4200 client.go:168] LocalClient.Create starting

	I0831 15:50:52.049903    4200 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:52.049938    4200 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:52.049947    4200 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:52.049985    4200 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:52.050008    4200 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:52.050019    4200 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:52.050392    4200 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:52.213035    4200 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:52.333632    4200 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:52.333638    4200 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:52.333836    4200 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:52.343111    4200 main.go:141] libmachine: STDOUT: 

	I0831 15:50:52.343134    4200 main.go:141] libmachine: STDERR: 

	I0831 15:50:52.343188    4200 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2 +20000M

	I0831 15:50:52.351016    4200 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:52.351029    4200 main.go:141] libmachine: STDERR: 

	I0831 15:50:52.351044    4200 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:52.351048    4200 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:52.351059    4200 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:52.351087    4200 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:c9:23:be:40:ff -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:52.352659    4200 main.go:141] libmachine: STDOUT: 

	I0831 15:50:52.352672    4200 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:52.352691    4200 client.go:171] duration metric: took 302.855792ms to LocalClient.Create

	I0831 15:50:54.354816    4200 start.go:128] duration metric: took 2.331704042s to createHost

	I0831 15:50:54.354874    4200 start.go:83] releasing machines lock for "force-systemd-flag-751000", held for 2.331825042s

	W0831 15:50:54.354983    4200 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:54.384162    4200 out.go:177] * Deleting "force-systemd-flag-751000" in qemu2 ...

	W0831 15:50:54.409721    4200 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:54.409739    4200 start.go:729] Will try again in 5 seconds ...

	I0831 15:50:59.411820    4200 start.go:360] acquireMachinesLock for force-systemd-flag-751000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:59.412320    4200 start.go:364] duration metric: took 362.125µs to acquireMachinesLock for "force-systemd-flag-751000"

	I0831 15:50:59.412486    4200 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-751000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-751000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:59.412766    4200 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:59.420777    4200 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:59.472734    4200 start.go:159] libmachine.API.Create for "force-systemd-flag-751000" (driver="qemu2")

	I0831 15:50:59.472775    4200 client.go:168] LocalClient.Create starting

	I0831 15:50:59.472899    4200 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:59.472976    4200 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:59.472994    4200 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:59.473047    4200 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:59.473096    4200 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:59.473107    4200 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:59.473669    4200 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:59.658311    4200 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:59.929855    4200 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:59.929867    4200 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:59.930077    4200 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:59.939837    4200 main.go:141] libmachine: STDOUT: 

	I0831 15:50:59.939865    4200 main.go:141] libmachine: STDERR: 

	I0831 15:50:59.939919    4200 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2 +20000M

	I0831 15:50:59.947792    4200 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:59.947807    4200 main.go:141] libmachine: STDERR: 

	I0831 15:50:59.947819    4200 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:59.947824    4200 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:59.947836    4200 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:59.947870    4200 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/qemu.pid -device virtio-net-pci,netdev=net0,mac=22:ee:63:81:16:aa -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-flag-751000/disk.qcow2

	I0831 15:50:59.949488    4200 main.go:141] libmachine: STDOUT: 

	I0831 15:50:59.949503    4200 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:59.949517    4200 client.go:171] duration metric: took 476.74925ms to LocalClient.Create

	I0831 15:51:01.951686    4200 start.go:128] duration metric: took 2.538931458s to createHost

	I0831 15:51:01.951757    4200 start.go:83] releasing machines lock for "force-systemd-flag-751000", held for 2.539445625s

	W0831 15:51:01.951971    4200 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-751000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-751000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:51:01.965389    4200 out.go:201] 

	W0831 15:51:01.976457    4200 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:51:01.976497    4200 out.go:270] * 

	* 

	W0831 15:51:01.977784    4200 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:51:01.989309    4200 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-751000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-751000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-751000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (79.781208ms)

-- stdout --

	* The control-plane node force-systemd-flag-751000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-751000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-751000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-08-31 15:51:02.083135 -0700 PDT m=+2769.025193126

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-751000 -n force-systemd-flag-751000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-751000 -n force-systemd-flag-751000: exit status 7 (37.0835ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "force-systemd-flag-751000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "force-systemd-flag-751000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-751000

--- FAIL: TestForceSystemdFlag (10.30s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-325000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-325000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (11.58806325s)

-- stdout --

	* [force-systemd-env-325000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-325000" primary control-plane node in "force-systemd-env-325000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-325000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:50:45.174051    4162 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:50:45.174187    4162 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:45.174190    4162 out.go:358] Setting ErrFile to fd 2...

	I0831 15:50:45.174193    4162 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:50:45.174309    4162 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:50:45.175341    4162 out.go:352] Setting JSON to false

	I0831 15:50:45.191383    4162 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3009,"bootTime":1725141636,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:50:45.191450    4162 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:50:45.198585    4162 out.go:177] * [force-systemd-env-325000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:50:45.207418    4162 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:50:45.207466    4162 notify.go:220] Checking for updates...

	I0831 15:50:45.214297    4162 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:50:45.217370    4162 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:50:45.220388    4162 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:50:45.221824    4162 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:50:45.225376    4162 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0831 15:50:45.228793    4162 config.go:182] Loaded profile config "multinode-334000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:50:45.228846    4162 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:50:45.233251    4162 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:50:45.240386    4162 start.go:297] selected driver: qemu2

	I0831 15:50:45.240394    4162 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:50:45.240401    4162 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:50:45.242857    4162 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:50:45.246409    4162 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:50:45.249486    4162 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0831 15:50:45.249501    4162 cni.go:84] Creating CNI manager for ""

	I0831 15:50:45.249508    4162 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:50:45.249516    4162 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0831 15:50:45.249548    4162 start.go:340] cluster config:

	{Name:force-systemd-env-325000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-325000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l

ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:50:45.253326    4162 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:50:45.262321    4162 out.go:177] * Starting "force-systemd-env-325000" primary control-plane node in "force-systemd-env-325000" cluster

	I0831 15:50:45.266386    4162 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:50:45.266405    4162 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:50:45.266423    4162 cache.go:56] Caching tarball of preloaded images

	I0831 15:50:45.266491    4162 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:50:45.266504    4162 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:50:45.266567    4162 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/force-systemd-env-325000/config.json ...

	I0831 15:50:45.266579    4162 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/force-systemd-env-325000/config.json: {Name:mk94ab1365598c18b46fde6898d650853f335a6e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:50:45.266818    4162 start.go:360] acquireMachinesLock for force-systemd-env-325000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:45.266857    4162 start.go:364] duration metric: took 29.542µs to acquireMachinesLock for "force-systemd-env-325000"

	I0831 15:50:45.266868    4162 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-325000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-325000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:45.266898    4162 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:45.274385    4162 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:45.292322    4162 start.go:159] libmachine.API.Create for "force-systemd-env-325000" (driver="qemu2")

	I0831 15:50:45.292350    4162 client.go:168] LocalClient.Create starting

	I0831 15:50:45.292410    4162 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:45.292447    4162 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:45.292457    4162 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:45.292495    4162 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:45.292518    4162 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:45.292528    4162 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:45.292883    4162 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:45.456155    4162 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:45.532520    4162 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:45.532526    4162 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:45.532725    4162 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:45.541745    4162 main.go:141] libmachine: STDOUT: 

	I0831 15:50:45.541763    4162 main.go:141] libmachine: STDERR: 

	I0831 15:50:45.541807    4162 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2 +20000M

	I0831 15:50:45.549700    4162 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:45.549713    4162 main.go:141] libmachine: STDERR: 

	I0831 15:50:45.549733    4162 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:45.549737    4162 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:45.549751    4162 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:45.549779    4162 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f6:e9:22:5a:fc:e4 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:45.551405    4162 main.go:141] libmachine: STDOUT: 

	I0831 15:50:45.551419    4162 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:45.551437    4162 client.go:171] duration metric: took 259.089208ms to LocalClient.Create

	I0831 15:50:47.553453    4162 start.go:128] duration metric: took 2.286605875s to createHost

	I0831 15:50:47.553495    4162 start.go:83] releasing machines lock for "force-systemd-env-325000", held for 2.286689542s

	W0831 15:50:47.553516    4162 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:47.563067    4162 out.go:177] * Deleting "force-systemd-env-325000" in qemu2 ...

	W0831 15:50:47.573624    4162 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:47.573635    4162 start.go:729] Will try again in 5 seconds ...

	I0831 15:50:52.575731    4162 start.go:360] acquireMachinesLock for force-systemd-env-325000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:50:54.355053    4162 start.go:364] duration metric: took 1.779258792s to acquireMachinesLock for "force-systemd-env-325000"

	I0831 15:50:54.355179    4162 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-325000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-325000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:50:54.355437    4162 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:50:54.372097    4162 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0831 15:50:54.420183    4162 start.go:159] libmachine.API.Create for "force-systemd-env-325000" (driver="qemu2")

	I0831 15:50:54.420242    4162 client.go:168] LocalClient.Create starting

	I0831 15:50:54.420359    4162 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:50:54.420417    4162 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:54.420434    4162 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:54.420502    4162 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:50:54.420550    4162 main.go:141] libmachine: Decoding PEM data...

	I0831 15:50:54.420565    4162 main.go:141] libmachine: Parsing certificate...

	I0831 15:50:54.421090    4162 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:50:54.597753    4162 main.go:141] libmachine: Creating SSH key...

	I0831 15:50:54.664369    4162 main.go:141] libmachine: Creating Disk image...

	I0831 15:50:54.664378    4162 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:50:54.664545    4162 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:54.673968    4162 main.go:141] libmachine: STDOUT: 

	I0831 15:50:54.673987    4162 main.go:141] libmachine: STDERR: 

	I0831 15:50:54.674036    4162 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2 +20000M

	I0831 15:50:54.681994    4162 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:50:54.682009    4162 main.go:141] libmachine: STDERR: 

	I0831 15:50:54.682024    4162 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:54.682028    4162 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:50:54.682040    4162 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:50:54.682064    4162 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:b7:75:73:20:ed -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/force-systemd-env-325000/disk.qcow2

	I0831 15:50:54.683691    4162 main.go:141] libmachine: STDOUT: 

	I0831 15:50:54.683706    4162 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:50:54.683718    4162 client.go:171] duration metric: took 263.476042ms to LocalClient.Create

	I0831 15:50:56.685947    4162 start.go:128] duration metric: took 2.330513333s to createHost

	I0831 15:50:56.686020    4162 start.go:83] releasing machines lock for "force-systemd-env-325000", held for 2.330986083s

	W0831 15:50:56.686448    4162 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-325000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-325000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:50:56.699981    4162 out.go:201] 

	W0831 15:50:56.705162    4162 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:50:56.705214    4162 out.go:270] * 

	* 

	W0831 15:50:56.707494    4162 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:50:56.717018    4162 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-325000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-325000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-325000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (77.094333ms)

-- stdout --

	* The control-plane node force-systemd-env-325000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-325000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-325000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-08-31 15:50:56.811602 -0700 PDT m=+2763.753528793

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-325000 -n force-systemd-env-325000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-325000 -n force-systemd-env-325000: exit status 7 (35.034917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "force-systemd-env-325000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "force-systemd-env-325000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-325000

--- FAIL: TestForceSystemdEnv (11.78s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-221000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-221000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:345: "hello-node-connect-65d86f57f4-v99wv" [7b164e4b-4dc7-4c3e-9604-070e8d2cf984] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:345: "hello-node-connect-65d86f57f4-v99wv" [7b164e4b-4dc7-4c3e-9604-070e8d2cf984] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 8.010402083s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-221000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:30828

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

E0831 15:22:32.462125    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.472096    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.485193    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.507824    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.551298    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.632748    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:32.796119    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:33.119516    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

E0831 15:22:33.761383    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:22:35.042989    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

E0831 15:22:42.729645    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:30828: Get "http://192.168.105.4:30828": dial tcp 192.168.105.4:30828: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-221000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-v99wv

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-221000/192.168.105.4

Start Time:       Sat, 31 Aug 2024 15:22:22 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.8

IPs:

IP:           10.244.0.8

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://40ade4d986c9365751cfc873885d3efc044bfb1df0757ab5abd4bee0a531797e

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       CrashLoopBackOff

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Sat, 31 Aug 2024 15:22:36 -0700

Finished:     Sat, 31 Aug 2024 15:22:36 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nm72v (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-nm72v:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  28s                default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-v99wv to functional-221000

Normal   Pulled     15s (x3 over 28s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Normal   Created    15s (x3 over 28s)  kubelet            Created container echoserver-arm

Normal   Started    15s (x3 over 28s)  kubelet            Started container echoserver-arm

Warning  BackOff    3s (x3 over 26s)   kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-v99wv_default(7b164e4b-4dc7-4c3e-9604-070e8d2cf984)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-221000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-221000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.98.151.127

IPs:                      10.98.151.127

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  30828/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-221000 -n functional-221000

helpers_test.go:245: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p functional-221000 logs -n 25

helpers_test.go:253: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                                                         Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| image   | functional-221000 image ls                                                                                           | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	| image   | functional-221000 image save --daemon                                                                                | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | kicbase/echo-server:functional-221000                                                                                |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                                    |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh echo                                                                                           | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | hello                                                                                                                |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh cat                                                                                            | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | /etc/hostname                                                                                                        |                   |         |         |                     |                     |

	| tunnel  | functional-221000 tunnel                                                                                             | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | --alsologtostderr                                                                                                    |                   |         |         |                     |                     |

	| tunnel  | functional-221000 tunnel                                                                                             | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | --alsologtostderr                                                                                                    |                   |         |         |                     |                     |

	| tunnel  | functional-221000 tunnel                                                                                             | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | --alsologtostderr                                                                                                    |                   |         |         |                     |                     |

	| service | functional-221000 service list                                                                                       | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	| service | functional-221000 service list                                                                                       | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | -o json                                                                                                              |                   |         |         |                     |                     |

	| service | functional-221000 service                                                                                            | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | --namespace=default --https                                                                                          |                   |         |         |                     |                     |

	|         | --url hello-node                                                                                                     |                   |         |         |                     |                     |

	| service | functional-221000                                                                                                    | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | service hello-node --url                                                                                             |                   |         |         |                     |                     |

	|         | --format={{.IP}}                                                                                                     |                   |         |         |                     |                     |

	| service | functional-221000 service                                                                                            | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | hello-node --url                                                                                                     |                   |         |         |                     |                     |

	| addons  | functional-221000 addons list                                                                                        | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	| addons  | functional-221000 addons list                                                                                        | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | -o json                                                                                                              |                   |         |         |                     |                     |

	| service | functional-221000 service                                                                                            | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | hello-node-connect --url                                                                                             |                   |         |         |                     |                     |

	| mount   | -p functional-221000                                                                                                 | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port687838321/001:/mount-9p       |                   |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh findmnt                                                                                        | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh -- ls                                                                                          | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh cat                                                                                            | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | /mount-9p/test-1725142965018430000                                                                                   |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh stat                                                                                           | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | /mount-9p/created-by-test                                                                                            |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh stat                                                                                           | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | /mount-9p/created-by-pod                                                                                             |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh sudo                                                                                           | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh findmnt                                                                                        | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| mount   | -p functional-221000                                                                                                 | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT |                     |

	|         | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port1321680966/001:/mount-9p |                   |         |         |                     |                     |

	|         | --alsologtostderr -v=1 --port 46464                                                                                  |                   |         |         |                     |                     |

	| ssh     | functional-221000 ssh findmnt                                                                                        | functional-221000 | jenkins | v1.33.1 | 31 Aug 24 15:22 PDT | 31 Aug 24 15:22 PDT |

	|         | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/08/31 15:21:27

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0831 15:21:27.128046    2067 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:21:27.128182    2067 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:21:27.128184    2067 out.go:358] Setting ErrFile to fd 2...

	I0831 15:21:27.128186    2067 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:21:27.128321    2067 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:21:27.129451    2067 out.go:352] Setting JSON to false

	I0831 15:21:27.145842    2067 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1251,"bootTime":1725141636,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:21:27.145935    2067 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:21:27.150981    2067 out.go:177] * [functional-221000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:21:27.160118    2067 notify.go:220] Checking for updates...

	I0831 15:21:27.163922    2067 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:21:27.167937    2067 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:21:27.172063    2067 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:21:27.174985    2067 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:21:27.177948    2067 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:21:27.181021    2067 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:21:27.184234    2067 config.go:182] Loaded profile config "functional-221000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:21:27.184281    2067 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:21:27.188939    2067 out.go:177] * Using the qemu2 driver based on existing profile

	I0831 15:21:27.195062    2067 start.go:297] selected driver: qemu2

	I0831 15:21:27.195067    2067 start.go:901] validating driver "qemu2" against &{Name:functional-221000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub

ernetesVersion:v1.31.0 ClusterName:functional-221000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:21:27.195137    2067 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:21:27.197380    2067 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:21:27.197421    2067 cni.go:84] Creating CNI manager for ""

	I0831 15:21:27.197428    2067 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:21:27.197472    2067 start.go:340] cluster config:

	{Name:functional-221000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-221000 Namespace:default APIServe

rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:21:27.200683    2067 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:21:27.208961    2067 out.go:177] * Starting "functional-221000" primary control-plane node in "functional-221000" cluster

	I0831 15:21:27.212945    2067 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:21:27.212957    2067 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:21:27.212969    2067 cache.go:56] Caching tarball of preloaded images

	I0831 15:21:27.213025    2067 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:21:27.213029    2067 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:21:27.213091    2067 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/config.json ...

	I0831 15:21:27.213585    2067 start.go:360] acquireMachinesLock for functional-221000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:21:27.213613    2067 start.go:364] duration metric: took 24.708µs to acquireMachinesLock for "functional-221000"

	I0831 15:21:27.213619    2067 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:21:27.213624    2067 fix.go:54] fixHost starting: 

	I0831 15:21:27.214176    2067 fix.go:112] recreateIfNeeded on functional-221000: state=Running err=<nil>

	W0831 15:21:27.214181    2067 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:21:27.218843    2067 out.go:177] * Updating the running qemu2 "functional-221000" VM ...

	I0831 15:21:27.226968    2067 machine.go:93] provisionDockerMachine start ...

	I0831 15:21:27.226998    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.227109    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.227111    2067 main.go:141] libmachine: About to run SSH command:

	hostname

	I0831 15:21:27.282840    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-221000

	I0831 15:21:27.282848    2067 buildroot.go:166] provisioning hostname "functional-221000"

	I0831 15:21:27.282880    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.282997    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.283001    2067 main.go:141] libmachine: About to run SSH command:

	sudo hostname functional-221000 && echo "functional-221000" | sudo tee /etc/hostname

	I0831 15:21:27.341878    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-221000

	I0831 15:21:27.341918    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.342024    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.342030    2067 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-221000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-221000/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-221000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0831 15:21:27.393306    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0831 15:21:27.393316    2067 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/18943-972/.minikube CaCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/18943-972/.minikube}

	I0831 15:21:27.393324    2067 buildroot.go:174] setting up certificates

	I0831 15:21:27.393327    2067 provision.go:84] configureAuth start

	I0831 15:21:27.393330    2067 provision.go:143] copyHostCerts

	I0831 15:21:27.393391    2067 exec_runner.go:144] found /Users/jenkins/minikube-integration/18943-972/.minikube/ca.pem, removing ...

	I0831 15:21:27.393394    2067 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18943-972/.minikube/ca.pem

	I0831 15:21:27.393524    2067 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/ca.pem (1082 bytes)

	I0831 15:21:27.393704    2067 exec_runner.go:144] found /Users/jenkins/minikube-integration/18943-972/.minikube/cert.pem, removing ...

	I0831 15:21:27.393706    2067 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18943-972/.minikube/cert.pem

	I0831 15:21:27.393903    2067 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/cert.pem (1123 bytes)

	I0831 15:21:27.394026    2067 exec_runner.go:144] found /Users/jenkins/minikube-integration/18943-972/.minikube/key.pem, removing ...

	I0831 15:21:27.394028    2067 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18943-972/.minikube/key.pem

	I0831 15:21:27.394088    2067 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/18943-972/.minikube/key.pem (1679 bytes)

	I0831 15:21:27.394180    2067 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem org=jenkins.functional-221000 san=[127.0.0.1 192.168.105.4 functional-221000 localhost minikube]

	I0831 15:21:27.556750    2067 provision.go:177] copyRemoteCerts

	I0831 15:21:27.556786    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0831 15:21:27.556793    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:27.586369    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0831 15:21:27.595348    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)

	I0831 15:21:27.603813    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0831 15:21:27.611647    2067 provision.go:87] duration metric: took 218.321166ms to configureAuth

	I0831 15:21:27.611653    2067 buildroot.go:189] setting minikube options for container-runtime

	I0831 15:21:27.611750    2067 config.go:182] Loaded profile config "functional-221000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:21:27.611781    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.611870    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.611873    2067 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0831 15:21:27.667275    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0831 15:21:27.667281    2067 buildroot.go:70] root file system type: tmpfs

	I0831 15:21:27.667331    2067 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0831 15:21:27.667394    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.667523    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.667554    2067 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0831 15:21:27.734146    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0831 15:21:27.734211    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.734335    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.734341    2067 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0831 15:21:27.789541    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0831 15:21:27.789548    2067 machine.go:96] duration metric: took 562.589958ms to provisionDockerMachine

	I0831 15:21:27.789552    2067 start.go:293] postStartSetup for "functional-221000" (driver="qemu2")

	I0831 15:21:27.789557    2067 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0831 15:21:27.789605    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0831 15:21:27.789612    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:27.818795    2067 ssh_runner.go:195] Run: cat /etc/os-release

	I0831 15:21:27.820230    2067 info.go:137] Remote host: Buildroot 2023.02.9

	I0831 15:21:27.820235    2067 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18943-972/.minikube/addons for local assets ...

	I0831 15:21:27.820318    2067 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18943-972/.minikube/files for local assets ...

	I0831 15:21:27.820424    2067 filesync.go:149] local asset: /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/ssl/certs/14322.pem -> 14322.pem in /etc/ssl/certs

	I0831 15:21:27.820535    2067 filesync.go:149] local asset: /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/test/nested/copy/1432/hosts -> hosts in /etc/test/nested/copy/1432

	I0831 15:21:27.820565    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/1432

	I0831 15:21:27.823750    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/ssl/certs/14322.pem --> /etc/ssl/certs/14322.pem (1708 bytes)

	I0831 15:21:27.831797    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/test/nested/copy/1432/hosts --> /etc/test/nested/copy/1432/hosts (40 bytes)

	I0831 15:21:27.840057    2067 start.go:296] duration metric: took 50.501833ms for postStartSetup

	I0831 15:21:27.840069    2067 fix.go:56] duration metric: took 626.461416ms for fixHost

	I0831 15:21:27.840104    2067 main.go:141] libmachine: Using SSH client type: native

	I0831 15:21:27.840211    2067 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102f545a0] 0x102f56e00 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I0831 15:21:27.840214    2067 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0831 15:21:27.892918    2067 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725142887.893551669

	I0831 15:21:27.892923    2067 fix.go:216] guest clock: 1725142887.893551669

	I0831 15:21:27.892926    2067 fix.go:229] Guest: 2024-08-31 15:21:27.893551669 -0700 PDT Remote: 2024-08-31 15:21:27.84007 -0700 PDT m=+0.731142001 (delta=53.481669ms)

	I0831 15:21:27.892936    2067 fix.go:200] guest clock delta is within tolerance: 53.481669ms

	I0831 15:21:27.892938    2067 start.go:83] releasing machines lock for "functional-221000", held for 679.338041ms

	I0831 15:21:27.893234    2067 ssh_runner.go:195] Run: cat /version.json

	I0831 15:21:27.893234    2067 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0831 15:21:27.893240    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:27.893251    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:27.966020    2067 ssh_runner.go:195] Run: systemctl --version

	I0831 15:21:27.968216    2067 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0831 15:21:27.970089    2067 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0831 15:21:27.970112    2067 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0831 15:21:27.973883    2067 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I0831 15:21:27.973888    2067 start.go:495] detecting cgroup driver to use...

	I0831 15:21:27.973951    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0831 15:21:27.980201    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0831 15:21:27.983795    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0831 15:21:27.987434    2067 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0831 15:21:27.987456    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0831 15:21:27.991264    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0831 15:21:27.995217    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0831 15:21:27.999333    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0831 15:21:28.003402    2067 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0831 15:21:28.007293    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0831 15:21:28.011060    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0831 15:21:28.015071    2067 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0831 15:21:28.018949    2067 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0831 15:21:28.022822    2067 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0831 15:21:28.026148    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:28.130009    2067 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0831 15:21:28.142450    2067 start.go:495] detecting cgroup driver to use...

	I0831 15:21:28.142495    2067 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0831 15:21:28.149602    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0831 15:21:28.161340    2067 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0831 15:21:28.186775    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0831 15:21:28.193453    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0831 15:21:28.199546    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0831 15:21:28.206232    2067 ssh_runner.go:195] Run: which cri-dockerd

	I0831 15:21:28.207637    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0831 15:21:28.211035    2067 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0831 15:21:28.217000    2067 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0831 15:21:28.326905    2067 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0831 15:21:28.444294    2067 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0831 15:21:28.444348    2067 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0831 15:21:28.450592    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:28.590280    2067 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0831 15:21:40.897662    2067 ssh_runner.go:235] Completed: sudo systemctl restart docker: (12.307659458s)

	I0831 15:21:40.897725    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0831 15:21:40.905034    2067 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0831 15:21:40.913518    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0831 15:21:40.920982    2067 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0831 15:21:41.015062    2067 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0831 15:21:41.110019    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:41.192765    2067 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0831 15:21:41.200393    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0831 15:21:41.206665    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:41.276372    2067 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0831 15:21:41.304512    2067 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0831 15:21:41.304579    2067 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0831 15:21:41.307070    2067 start.go:563] Will wait 60s for crictl version

	I0831 15:21:41.307106    2067 ssh_runner.go:195] Run: which crictl

	I0831 15:21:41.308609    2067 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0831 15:21:41.320765    2067 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.2.0

	RuntimeApiVersion:  v1

	I0831 15:21:41.320839    2067 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0831 15:21:41.334776    2067 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0831 15:21:41.345104    2067 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.2.0 ...

	I0831 15:21:41.345249    2067 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0831 15:21:41.353882    2067 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0831 15:21:41.356944    2067 kubeadm.go:883] updating cluster {Name:functional-221000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.31.0 ClusterName:functional-221000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M

ount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0831 15:21:41.357022    2067 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:21:41.357083    2067 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0831 15:21:41.362733    2067 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-221000

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I0831 15:21:41.362737    2067 docker.go:615] Images already preloaded, skipping extraction

	I0831 15:21:41.362782    2067 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0831 15:21:41.368044    2067 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-221000

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I0831 15:21:41.368057    2067 cache_images.go:84] Images are preloaded, skipping loading

	I0831 15:21:41.368061    2067 kubeadm.go:934] updating node { 192.168.105.4 8441 v1.31.0 docker true true} ...

	I0831 15:21:41.368132    2067 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=functional-221000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.4

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:functional-221000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0831 15:21:41.368176    2067 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0831 15:21:41.384000    2067 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0831 15:21:41.384073    2067 cni.go:84] Creating CNI manager for ""

	I0831 15:21:41.384079    2067 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:21:41.384083    2067 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0831 15:21:41.384092    2067 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.4 APIServerPort:8441 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-221000 NodeName:functional-221000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.4"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.4 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOp

ts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0831 15:21:41.384175    2067 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.4

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "functional-221000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.4

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0831 15:21:41.384235    2067 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0831 15:21:41.387738    2067 binaries.go:44] Found k8s binaries, skipping transfer

	I0831 15:21:41.387771    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0831 15:21:41.391149    2067 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)

	I0831 15:21:41.397315    2067 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0831 15:21:41.403195    2067 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2012 bytes)

	I0831 15:21:41.409479    2067 ssh_runner.go:195] Run: grep 192.168.105.4	control-plane.minikube.internal$ /etc/hosts

	I0831 15:21:41.410985    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:41.483946    2067 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0831 15:21:41.490477    2067 certs.go:68] Setting up /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000 for IP: 192.168.105.4

	I0831 15:21:41.490479    2067 certs.go:194] generating shared ca certs ...

	I0831 15:21:41.490486    2067 certs.go:226] acquiring lock for ca certs: {Name:mk9afb7f1a72cfb2bc15164a899be0d76a69591d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:21:41.490625    2067 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key

	I0831 15:21:41.490676    2067 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key

	I0831 15:21:41.490681    2067 certs.go:256] generating profile certs ...

	I0831 15:21:41.490734    2067 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.key

	I0831 15:21:41.490788    2067 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/apiserver.key.831d7816

	I0831 15:21:41.490830    2067 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/proxy-client.key

	I0831 15:21:41.490994    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/1432.pem (1338 bytes)

	W0831 15:21:41.491023    2067 certs.go:480] ignoring /Users/jenkins/minikube-integration/18943-972/.minikube/certs/1432_empty.pem, impossibly tiny 0 bytes

	I0831 15:21:41.491027    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca-key.pem (1679 bytes)

	I0831 15:21:41.491048    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem (1082 bytes)

	I0831 15:21:41.491066    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem (1123 bytes)

	I0831 15:21:41.491090    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/certs/key.pem (1679 bytes)

	I0831 15:21:41.491125    2067 certs.go:484] found cert: /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/ssl/certs/14322.pem (1708 bytes)

	I0831 15:21:41.491466    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0831 15:21:41.500165    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0831 15:21:41.508315    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0831 15:21:41.516463    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0831 15:21:41.524940    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0831 15:21:41.533499    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0831 15:21:41.541873    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0831 15:21:41.550217    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0831 15:21:41.558803    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/files/etc/ssl/certs/14322.pem --> /usr/share/ca-certificates/14322.pem (1708 bytes)

	I0831 15:21:41.567074    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0831 15:21:41.575082    2067 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18943-972/.minikube/certs/1432.pem --> /usr/share/ca-certificates/1432.pem (1338 bytes)

	I0831 15:21:41.583045    2067 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0831 15:21:41.589224    2067 ssh_runner.go:195] Run: openssl version

	I0831 15:21:41.591191    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14322.pem && ln -fs /usr/share/ca-certificates/14322.pem /etc/ssl/certs/14322.pem"

	I0831 15:21:41.595220    2067 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14322.pem

	I0831 15:21:41.596851    2067 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 31 22:20 /usr/share/ca-certificates/14322.pem

	I0831 15:21:41.596876    2067 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14322.pem

	I0831 15:21:41.598854    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14322.pem /etc/ssl/certs/3ec20f2e.0"

	I0831 15:21:41.602450    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0831 15:21:41.606226    2067 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:21:41.607742    2067 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 31 22:05 /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:21:41.607758    2067 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0831 15:21:41.609771    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0831 15:21:41.613383    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1432.pem && ln -fs /usr/share/ca-certificates/1432.pem /etc/ssl/certs/1432.pem"

	I0831 15:21:41.617967    2067 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1432.pem

	I0831 15:21:41.619674    2067 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 31 22:20 /usr/share/ca-certificates/1432.pem

	I0831 15:21:41.619694    2067 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1432.pem

	I0831 15:21:41.621696    2067 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1432.pem /etc/ssl/certs/51391683.0"

	I0831 15:21:41.625462    2067 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0831 15:21:41.627089    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0831 15:21:41.629188    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0831 15:21:41.631166    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0831 15:21:41.633469    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0831 15:21:41.635645    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0831 15:21:41.637712    2067 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0831 15:21:41.639736    2067 kubeadm.go:392] StartCluster: {Name:functional-221000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.3

1.0 ClusterName:functional-221000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Moun

t:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:21:41.639809    2067 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0831 15:21:41.648633    2067 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0831 15:21:41.652071    2067 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I0831 15:21:41.652074    2067 kubeadm.go:593] restartPrimaryControlPlane start ...

	I0831 15:21:41.652098    2067 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0831 15:21:41.655412    2067 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0831 15:21:41.655701    2067 kubeconfig.go:125] found "functional-221000" server: "https://192.168.105.4:8441"

	I0831 15:21:41.656320    2067 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0831 15:21:41.659567    2067 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml

	+++ /var/tmp/minikube/kubeadm.yaml.new

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0831 15:21:41.659572    2067 kubeadm.go:1160] stopping kube-system containers ...

	I0831 15:21:41.659618    2067 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0831 15:21:41.666622    2067 docker.go:483] Stopping containers: [45948d30c347 4ba37f35ef49 b8822ec23867 79c805b1288f 1fbcb2c82bbe 1e03326bc823 f5619c13909c 04b7ad0da85f 06cb2ffdfa93 89ce027c7209 7ad3fb94cbaf 2b5055df6692 c966bd867d83 b6f718680b56 200d51e7ed34 71688eada235 94e10bfb997f 08279b425d5a 252096e62304 39e861ed52db 748e45e95cce 358fcdc61161 756f3b496599 cedb2c6d48da 4e4848f5c441 58fbee1875ec 3c4ceeac907c 39105b5cb903 375dd89ed883]

	I0831 15:21:41.666680    2067 ssh_runner.go:195] Run: docker stop 45948d30c347 4ba37f35ef49 b8822ec23867 79c805b1288f 1fbcb2c82bbe 1e03326bc823 f5619c13909c 04b7ad0da85f 06cb2ffdfa93 89ce027c7209 7ad3fb94cbaf 2b5055df6692 c966bd867d83 b6f718680b56 200d51e7ed34 71688eada235 94e10bfb997f 08279b425d5a 252096e62304 39e861ed52db 748e45e95cce 358fcdc61161 756f3b496599 cedb2c6d48da 4e4848f5c441 58fbee1875ec 3c4ceeac907c 39105b5cb903 375dd89ed883

	I0831 15:21:41.673510    2067 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I0831 15:21:41.786126    2067 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0831 15:21:41.792394    2067 kubeadm.go:157] found existing configuration files:

	-rw------- 1 root root 5647 Aug 31 22:20 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5657 Aug 31 22:20 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2007 Aug 31 22:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5601 Aug 31 22:20 /etc/kubernetes/scheduler.conf

	I0831 15:21:41.792434    2067 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0831 15:21:41.797406    2067 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0831 15:21:41.801969    2067 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0831 15:21:41.806495    2067 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0831 15:21:41.806523    2067 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0831 15:21:41.810767    2067 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0831 15:21:41.814795    2067 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0831 15:21:41.814815    2067 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0831 15:21:41.818843    2067 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0831 15:21:41.822784    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:41.841626    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:42.302491    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:42.430039    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:42.452708    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:42.471308    2067 api_server.go:52] waiting for apiserver process to appear ...

	I0831 15:21:42.471380    2067 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0831 15:21:42.973453    2067 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0831 15:21:43.473456    2067 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0831 15:21:43.479101    2067 api_server.go:72] duration metric: took 1.007816583s to wait for apiserver process to appear ...

	I0831 15:21:43.479107    2067 api_server.go:88] waiting for apiserver healthz status ...

	I0831 15:21:43.479116    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:45.495406    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0831 15:21:45.495421    2067 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0831 15:21:45.495426    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:45.534995    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W0831 15:21:45.535007    2067 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I0831 15:21:45.979673    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:45.992164    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W0831 15:21:45.992190    2067 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I0831 15:21:46.479617    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:46.493474    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W0831 15:21:46.493503    2067 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I0831 15:21:46.979943    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:46.982774    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I0831 15:21:46.986845    2067 api_server.go:141] control plane version: v1.31.0

	I0831 15:21:46.986854    2067 api_server.go:131] duration metric: took 3.507826334s to wait for apiserver health ...

	I0831 15:21:46.986858    2067 cni.go:84] Creating CNI manager for ""

	I0831 15:21:46.986864    2067 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0831 15:21:47.061891    2067 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0831 15:21:47.066064    2067 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0831 15:21:47.070787    2067 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0831 15:21:47.083689    2067 system_pods.go:43] waiting for kube-system pods to appear ...

	I0831 15:21:47.090165    2067 system_pods.go:59] 7 kube-system pods found

	I0831 15:21:47.090179    2067 system_pods.go:61] "coredns-6f6b679f8f-7rkzs" [f60a3743-2587-4cd1-9661-eca50c958c35] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0831 15:21:47.090182    2067 system_pods.go:61] "etcd-functional-221000" [064f89a2-48f4-4169-96ec-3309e746e984] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0831 15:21:47.090186    2067 system_pods.go:61] "kube-apiserver-functional-221000" [624f046e-4453-415b-837d-03ab8b4c39ba] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0831 15:21:47.090188    2067 system_pods.go:61] "kube-controller-manager-functional-221000" [522cc570-9ca1-4c50-9da4-729b475b46b6] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0831 15:21:47.090190    2067 system_pods.go:61] "kube-proxy-24lmn" [26fab0f0-0f6e-4c7c-87e8-4de2c0d94d5b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0831 15:21:47.090192    2067 system_pods.go:61] "kube-scheduler-functional-221000" [340bb34e-321b-44be-a075-540b8cde5827] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0831 15:21:47.090193    2067 system_pods.go:61] "storage-provisioner" [ae0ec11c-af2f-4c29-8beb-e7d90e24ed30] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0831 15:21:47.090199    2067 system_pods.go:74] duration metric: took 6.500541ms to wait for pod list to return data ...

	I0831 15:21:47.090202    2067 node_conditions.go:102] verifying NodePressure condition ...

	I0831 15:21:47.094435    2067 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0831 15:21:47.094447    2067 node_conditions.go:123] node cpu capacity is 2

	I0831 15:21:47.094453    2067 node_conditions.go:105] duration metric: took 4.249209ms to run NodePressure ...

	I0831 15:21:47.094465    2067 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0831 15:21:47.316914    2067 kubeadm.go:724] waiting for restarted kubelet to initialise ...

	I0831 15:21:47.319600    2067 kubeadm.go:739] kubelet initialised

	I0831 15:21:47.319605    2067 kubeadm.go:740] duration metric: took 2.681875ms waiting for restarted kubelet to initialise ...

	I0831 15:21:47.319609    2067 pod_ready.go:36] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:21:47.322746    2067 pod_ready.go:79] waiting up to 4m0s for pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:49.328518    2067 pod_ready.go:103] pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace has status "Ready":"False"

	I0831 15:21:49.836590    2067 pod_ready.go:93] pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:49.836607    2067 pod_ready.go:82] duration metric: took 2.513912208s for pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:49.836618    2067 pod_ready.go:79] waiting up to 4m0s for pod "etcd-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:51.850211    2067 pod_ready.go:103] pod "etcd-functional-221000" in "kube-system" namespace has status "Ready":"False"

	I0831 15:21:53.852322    2067 pod_ready.go:103] pod "etcd-functional-221000" in "kube-system" namespace has status "Ready":"False"

	I0831 15:21:56.346717    2067 pod_ready.go:93] pod "etcd-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:56.346732    2067 pod_ready.go:82] duration metric: took 6.510259375s for pod "etcd-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.346743    2067 pod_ready.go:79] waiting up to 4m0s for pod "kube-apiserver-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.351927    2067 pod_ready.go:93] pod "kube-apiserver-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:56.351933    2067 pod_ready.go:82] duration metric: took 5.183292ms for pod "kube-apiserver-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.351944    2067 pod_ready.go:79] waiting up to 4m0s for pod "kube-controller-manager-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.356942    2067 pod_ready.go:93] pod "kube-controller-manager-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:56.356947    2067 pod_ready.go:82] duration metric: took 4.998333ms for pod "kube-controller-manager-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.356953    2067 pod_ready.go:79] waiting up to 4m0s for pod "kube-proxy-24lmn" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.361036    2067 pod_ready.go:93] pod "kube-proxy-24lmn" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:56.361041    2067 pod_ready.go:82] duration metric: took 4.083875ms for pod "kube-proxy-24lmn" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.361047    2067 pod_ready.go:79] waiting up to 4m0s for pod "kube-scheduler-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.365132    2067 pod_ready.go:93] pod "kube-scheduler-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:56.365135    2067 pod_ready.go:82] duration metric: took 4.08525ms for pod "kube-scheduler-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.365141    2067 pod_ready.go:39] duration metric: took 9.045740333s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:21:56.365155    2067 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0831 15:21:56.373216    2067 ops.go:34] apiserver oom_adj: -16

	I0831 15:21:56.373223    2067 kubeadm.go:597] duration metric: took 14.721491083s to restartPrimaryControlPlane

	I0831 15:21:56.373228    2067 kubeadm.go:394] duration metric: took 14.733847292s to StartCluster

	I0831 15:21:56.373244    2067 settings.go:142] acquiring lock: {Name:mk1f68c46dbdc908eb5f421f0b3b97ef9fe18a8f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:21:56.373427    2067 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:21:56.374035    2067 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/kubeconfig: {Name:mk5b293422cb73c677cf2dff78569dba34983db1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:21:56.374463    2067 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:21:56.374488    2067 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0831 15:21:56.374559    2067 addons.go:69] Setting storage-provisioner=true in profile "functional-221000"

	I0831 15:21:56.374579    2067 addons.go:234] Setting addon storage-provisioner=true in "functional-221000"

	W0831 15:21:56.374584    2067 addons.go:243] addon storage-provisioner should already be in state true

	I0831 15:21:56.374597    2067 config.go:182] Loaded profile config "functional-221000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:21:56.374607    2067 host.go:66] Checking if "functional-221000" exists ...

	I0831 15:21:56.374608    2067 addons.go:69] Setting default-storageclass=true in profile "functional-221000"

	I0831 15:21:56.374630    2067 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-221000"

	I0831 15:21:56.376079    2067 addons.go:234] Setting addon default-storageclass=true in "functional-221000"

	W0831 15:21:56.376084    2067 addons.go:243] addon default-storageclass should already be in state true

	I0831 15:21:56.376097    2067 host.go:66] Checking if "functional-221000" exists ...

	I0831 15:21:56.379061    2067 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0831 15:21:56.379066    2067 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0831 15:21:56.379076    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:56.382394    2067 out.go:177] * Verifying Kubernetes components...

	I0831 15:21:56.386477    2067 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0831 15:21:56.390516    2067 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0831 15:21:56.393500    2067 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0831 15:21:56.393504    2067 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0831 15:21:56.393512    2067 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/functional-221000/id_rsa Username:docker}

	I0831 15:21:56.496790    2067 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0831 15:21:56.508207    2067 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0831 15:21:56.512212    2067 node_ready.go:35] waiting up to 6m0s for node "functional-221000" to be "Ready" ...

	I0831 15:21:56.541064    2067 node_ready.go:49] node "functional-221000" has status "Ready":"True"

	I0831 15:21:56.541069    2067 node_ready.go:38] duration metric: took 28.848041ms for node "functional-221000" to be "Ready" ...

	I0831 15:21:56.541073    2067 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:21:56.571339    2067 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0831 15:21:56.742642    2067 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:56.848826    2067 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0831 15:21:56.852754    2067 addons.go:510] duration metric: took 478.290791ms for enable addons: enabled=[default-storageclass storage-provisioner]

	I0831 15:21:57.142190    2067 pod_ready.go:93] pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:57.142200    2067 pod_ready.go:82] duration metric: took 399.558ms for pod "coredns-6f6b679f8f-7rkzs" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:57.142208    2067 pod_ready.go:79] waiting up to 6m0s for pod "etcd-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:57.541092    2067 pod_ready.go:93] pod "etcd-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:57.541099    2067 pod_ready.go:82] duration metric: took 398.895792ms for pod "etcd-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:57.541109    2067 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:57.946007    2067 pod_ready.go:93] pod "kube-apiserver-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:57.946045    2067 pod_ready.go:82] duration metric: took 404.934459ms for pod "kube-apiserver-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:57.946071    2067 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:58.346533    2067 pod_ready.go:93] pod "kube-controller-manager-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:58.346566    2067 pod_ready.go:82] duration metric: took 400.488584ms for pod "kube-controller-manager-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:58.346589    2067 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-24lmn" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:58.746824    2067 pod_ready.go:93] pod "kube-proxy-24lmn" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:58.746861    2067 pod_ready.go:82] duration metric: took 400.26525ms for pod "kube-proxy-24lmn" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:58.746887    2067 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:59.143350    2067 pod_ready.go:93] pod "kube-scheduler-functional-221000" in "kube-system" namespace has status "Ready":"True"

	I0831 15:21:59.143366    2067 pod_ready.go:82] duration metric: took 396.475584ms for pod "kube-scheduler-functional-221000" in "kube-system" namespace to be "Ready" ...

	I0831 15:21:59.143379    2067 pod_ready.go:39] duration metric: took 2.602360584s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0831 15:21:59.143406    2067 api_server.go:52] waiting for apiserver process to appear ...

	I0831 15:21:59.143582    2067 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0831 15:21:59.157745    2067 api_server.go:72] duration metric: took 2.783330042s to wait for apiserver process to appear ...

	I0831 15:21:59.157755    2067 api_server.go:88] waiting for apiserver healthz status ...

	I0831 15:21:59.157769    2067 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I0831 15:21:59.162885    2067 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I0831 15:21:59.163730    2067 api_server.go:141] control plane version: v1.31.0

	I0831 15:21:59.163738    2067 api_server.go:131] duration metric: took 5.979666ms to wait for apiserver health ...

	I0831 15:21:59.163750    2067 system_pods.go:43] waiting for kube-system pods to appear ...

	I0831 15:21:59.352833    2067 system_pods.go:59] 7 kube-system pods found

	I0831 15:21:59.352865    2067 system_pods.go:61] "coredns-6f6b679f8f-7rkzs" [f60a3743-2587-4cd1-9661-eca50c958c35] Running

	I0831 15:21:59.352872    2067 system_pods.go:61] "etcd-functional-221000" [064f89a2-48f4-4169-96ec-3309e746e984] Running

	I0831 15:21:59.352878    2067 system_pods.go:61] "kube-apiserver-functional-221000" [624f046e-4453-415b-837d-03ab8b4c39ba] Running

	I0831 15:21:59.352888    2067 system_pods.go:61] "kube-controller-manager-functional-221000" [522cc570-9ca1-4c50-9da4-729b475b46b6] Running

	I0831 15:21:59.352893    2067 system_pods.go:61] "kube-proxy-24lmn" [26fab0f0-0f6e-4c7c-87e8-4de2c0d94d5b] Running

	I0831 15:21:59.352901    2067 system_pods.go:61] "kube-scheduler-functional-221000" [340bb34e-321b-44be-a075-540b8cde5827] Running

	I0831 15:21:59.352911    2067 system_pods.go:61] "storage-provisioner" [ae0ec11c-af2f-4c29-8beb-e7d90e24ed30] Running

	I0831 15:21:59.352920    2067 system_pods.go:74] duration metric: took 189.168083ms to wait for pod list to return data ...

	I0831 15:21:59.352931    2067 default_sa.go:34] waiting for default service account to be created ...

	I0831 15:21:59.544734    2067 default_sa.go:45] found service account: "default"

	I0831 15:21:59.544749    2067 default_sa.go:55] duration metric: took 191.817667ms for default service account to be created ...

	I0831 15:21:59.544762    2067 system_pods.go:116] waiting for k8s-apps to be running ...

	I0831 15:21:59.750504    2067 system_pods.go:86] 7 kube-system pods found

	I0831 15:21:59.750534    2067 system_pods.go:89] "coredns-6f6b679f8f-7rkzs" [f60a3743-2587-4cd1-9661-eca50c958c35] Running

	I0831 15:21:59.750541    2067 system_pods.go:89] "etcd-functional-221000" [064f89a2-48f4-4169-96ec-3309e746e984] Running

	I0831 15:21:59.750546    2067 system_pods.go:89] "kube-apiserver-functional-221000" [624f046e-4453-415b-837d-03ab8b4c39ba] Running

	I0831 15:21:59.750551    2067 system_pods.go:89] "kube-controller-manager-functional-221000" [522cc570-9ca1-4c50-9da4-729b475b46b6] Running

	I0831 15:21:59.750555    2067 system_pods.go:89] "kube-proxy-24lmn" [26fab0f0-0f6e-4c7c-87e8-4de2c0d94d5b] Running

	I0831 15:21:59.750558    2067 system_pods.go:89] "kube-scheduler-functional-221000" [340bb34e-321b-44be-a075-540b8cde5827] Running

	I0831 15:21:59.750562    2067 system_pods.go:89] "storage-provisioner" [ae0ec11c-af2f-4c29-8beb-e7d90e24ed30] Running

	I0831 15:21:59.750575    2067 system_pods.go:126] duration metric: took 205.811541ms to wait for k8s-apps to be running ...

	I0831 15:21:59.750584    2067 system_svc.go:44] waiting for kubelet service to be running ....

	I0831 15:21:59.750758    2067 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0831 15:21:59.771853    2067 system_svc.go:56] duration metric: took 21.26825ms WaitForService to wait for kubelet

	I0831 15:21:59.771866    2067 kubeadm.go:582] duration metric: took 3.397465333s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:21:59.771884    2067 node_conditions.go:102] verifying NodePressure condition ...

	I0831 15:21:59.948077    2067 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0831 15:21:59.948103    2067 node_conditions.go:123] node cpu capacity is 2

	I0831 15:21:59.948125    2067 node_conditions.go:105] duration metric: took 176.239666ms to run NodePressure ...

	I0831 15:21:59.948149    2067 start.go:241] waiting for startup goroutines ...

	I0831 15:21:59.948162    2067 start.go:246] waiting for cluster config update ...

	I0831 15:21:59.948182    2067 start.go:255] writing updated cluster config ...

	I0831 15:21:59.949472    2067 ssh_runner.go:195] Run: rm -f paused

	I0831 15:22:00.014750    2067 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0831 15:22:00.017955    2067 out.go:201] 

	W0831 15:22:00.021951    2067 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0831 15:22:00.024902    2067 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0831 15:22:00.030261    2067 out.go:177] * Done! kubectl is now configured to use "functional-221000" cluster and "default" namespace by default

	==> Docker <==

	Aug 31 22:22:37 functional-221000 dockerd[5661]: time="2024-08-31T22:22:37.644141453Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:37 functional-221000 cri-dockerd[5916]: time="2024-08-31T22:22:37Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/e4ab33e8d0a9de55e95a2d00819978d54b6420134ad14b95b6b7e430880a9c37/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Aug 31 22:22:38 functional-221000 cri-dockerd[5916]: time="2024-08-31T22:22:38Z" level=info msg="Stop pulling image docker.io/nginx:latest: Status: Image is up to date for nginx:latest"

	Aug 31 22:22:38 functional-221000 dockerd[5661]: time="2024-08-31T22:22:38.480656594Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 31 22:22:38 functional-221000 dockerd[5661]: time="2024-08-31T22:22:38.480697968Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 31 22:22:38 functional-221000 dockerd[5661]: time="2024-08-31T22:22:38.480710218Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:38 functional-221000 dockerd[5661]: time="2024-08-31T22:22:38.480751302Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:46 functional-221000 dockerd[5661]: time="2024-08-31T22:22:46.589590161Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 31 22:22:46 functional-221000 dockerd[5661]: time="2024-08-31T22:22:46.589643369Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 31 22:22:46 functional-221000 dockerd[5661]: time="2024-08-31T22:22:46.589658161Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:46 functional-221000 dockerd[5661]: time="2024-08-31T22:22:46.589692036Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:46 functional-221000 cri-dockerd[5916]: time="2024-08-31T22:22:46Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f6db1063482efd4642c539550fbaa581d758703d51a976bbbe60f48d2043f5d3/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Aug 31 22:22:48 functional-221000 cri-dockerd[5916]: time="2024-08-31T22:22:48Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/busybox:1.28.4-glibc: Status: Downloaded newer image for gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.084219790Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.084273456Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.084282498Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.084312206Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Aug 31 22:22:48 functional-221000 dockerd[5655]: time="2024-08-31T22:22:48.117138186Z" level=info msg="ignoring event" container=7dce4e3095d87843366bdb638383319174514893be217ab6f734e539939d5aed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.117353518Z" level=info msg="shim disconnected" id=7dce4e3095d87843366bdb638383319174514893be217ab6f734e539939d5aed namespace=moby

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.117411559Z" level=warning msg="cleaning up after shim disconnected" id=7dce4e3095d87843366bdb638383319174514893be217ab6f734e539939d5aed namespace=moby

	Aug 31 22:22:48 functional-221000 dockerd[5661]: time="2024-08-31T22:22:48.117420768Z" level=info msg="cleaning up dead shim" namespace=moby

	Aug 31 22:22:49 functional-221000 dockerd[5661]: time="2024-08-31T22:22:49.516527228Z" level=info msg="shim disconnected" id=f6db1063482efd4642c539550fbaa581d758703d51a976bbbe60f48d2043f5d3 namespace=moby

	Aug 31 22:22:49 functional-221000 dockerd[5655]: time="2024-08-31T22:22:49.516747269Z" level=info msg="ignoring event" container=f6db1063482efd4642c539550fbaa581d758703d51a976bbbe60f48d2043f5d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 31 22:22:49 functional-221000 dockerd[5661]: time="2024-08-31T22:22:49.517051684Z" level=warning msg="cleaning up after shim disconnected" id=f6db1063482efd4642c539550fbaa581d758703d51a976bbbe60f48d2043f5d3 namespace=moby

	Aug 31 22:22:49 functional-221000 dockerd[5661]: time="2024-08-31T22:22:49.517061601Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	7dce4e3095d87       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   3 seconds ago        Exited              mount-munger              0                   f6db1063482ef       busybox-mount

	b9be0ebade385       nginx@sha256:447a8665cc1dab95b1ca778e162215839ccbb9189104c79d7ec3a81e14577add                         13 seconds ago       Running             myfrontend                0                   e4ab33e8d0a9d       sp-pod

	40ade4d986c93       72565bf5bbedf                                                                                         15 seconds ago       Exited              echoserver-arm            2                   a19fe87a734af       hello-node-connect-65d86f57f4-v99wv

	bcb4ea034533b       72565bf5bbedf                                                                                         25 seconds ago       Exited              echoserver-arm            2                   08aefa885cafb       hello-node-64b4f8f9ff-rmffc

	83f829a61b8ff       nginx@sha256:c04c18adc2a407740a397c8407c011fc6c90026a9b65cceddef7ae5484360158                         36 seconds ago       Running             nginx                     0                   a1a84f432e38c       nginx-svc

	9b13719354320       2437cf7621777                                                                                         About a minute ago   Running             coredns                   2                   17eb595141d83       coredns-6f6b679f8f-7rkzs

	c9c4970098a70       71d55d66fd4ee                                                                                         About a minute ago   Running             kube-proxy                2                   156140f975f6a       kube-proxy-24lmn

	d8b4a7df5661b       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       2                   6d8f5c210618a       storage-provisioner

	697c74fffc2e4       fbbbd428abb4d                                                                                         About a minute ago   Running             kube-scheduler            2                   adb32550a968c       kube-scheduler-functional-221000

	9d8f2158731e3       27e3830e14027                                                                                         About a minute ago   Running             etcd                      2                   a58a407af250e       etcd-functional-221000

	11d628f3793dd       fcb0683e6bdbd                                                                                         About a minute ago   Running             kube-controller-manager   2                   ebeaa9d496a68       kube-controller-manager-functional-221000

	74edd28a348e6       cd0f0ae0ec9e0                                                                                         About a minute ago   Running             kube-apiserver            0                   71c6dd8268636       kube-apiserver-functional-221000

	45948d30c3478       2437cf7621777                                                                                         About a minute ago   Exited              coredns                   1                   79c805b1288fd       coredns-6f6b679f8f-7rkzs

	4ba37f35ef49c       ba04bb24b9575                                                                                         About a minute ago   Exited              storage-provisioner       1                   1fbcb2c82bbe7       storage-provisioner

	b8822ec238679       71d55d66fd4ee                                                                                         About a minute ago   Exited              kube-proxy                1                   1e03326bc823a       kube-proxy-24lmn

	f5619c13909cd       fcb0683e6bdbd                                                                                         About a minute ago   Exited              kube-controller-manager   1                   c966bd867d839       kube-controller-manager-functional-221000

	06cb2ffdfa93e       27e3830e14027                                                                                         About a minute ago   Exited              etcd                      1                   2b5055df66920       etcd-functional-221000

	89ce027c72096       fbbbd428abb4d                                                                                         About a minute ago   Exited              kube-scheduler            1                   b6f718680b56f       kube-scheduler-functional-221000

	==> coredns [45948d30c347] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:36799 - 606 "HINFO IN 3921610683408791810.8743435914112216122. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.008707446s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [9b1371935432] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:41237 - 30869 "HINFO IN 5870888341075441041.2866895591537115127. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009629723s

	[INFO] 10.244.0.1:10016 - 64822 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000092708s

	[INFO] 10.244.0.1:26616 - 63330 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000089291s

	[INFO] 10.244.0.1:47101 - 1971 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000033041s

	[INFO] 10.244.0.1:34638 - 12336 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001870368s

	[INFO] 10.244.0.1:49033 - 36858 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000069208s

	[INFO] 10.244.0.1:23510 - 17759 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000128583s

	==> describe nodes <==

	Name:               functional-221000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-221000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=8ab9a20c866aaad18bea6fac47c5d146303457d2

	                    minikube.k8s.io/name=functional-221000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_08_31T15_20_32_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 31 Aug 2024 22:20:29 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-221000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 31 Aug 2024 22:22:46 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 31 Aug 2024 22:22:46 +0000   Sat, 31 Aug 2024 22:20:29 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 31 Aug 2024 22:22:46 +0000   Sat, 31 Aug 2024 22:20:29 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 31 Aug 2024 22:22:46 +0000   Sat, 31 Aug 2024 22:20:29 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 31 Aug 2024 22:22:46 +0000   Sat, 31 Aug 2024 22:20:35 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-221000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 7bc835ca40fd495fa2de4499349801cc

	  System UUID:                7bc835ca40fd495fa2de4499349801cc

	  Boot ID:                    8d619282-24ec-45d0-bca2-63bbdc1cb8a9

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-64b4f8f9ff-rmffc                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         44s

	  default                     hello-node-connect-65d86f57f4-v99wv          0 (0%)        0 (0%)      0 (0%)           0 (0%)         29s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         39s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         14s

	  kube-system                 coredns-6f6b679f8f-7rkzs                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m14s

	  kube-system                 etcd-functional-221000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         2m21s

	  kube-system                 kube-apiserver-functional-221000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         65s

	  kube-system                 kube-controller-manager-functional-221000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         2m20s

	  kube-system                 kube-proxy-24lmn                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m15s

	  kube-system                 kube-scheduler-functional-221000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         2m20s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m15s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m14s                kube-proxy       

	  Normal  Starting                 64s                  kube-proxy       

	  Normal  Starting                 109s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  2m20s                kubelet          Node functional-221000 status is now: NodeHasSufficientMemory

	  Normal  NodeAllocatableEnforced  2m20s                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    2m20s                kubelet          Node functional-221000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m20s                kubelet          Node functional-221000 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m20s                kubelet          Starting kubelet.

	  Normal  NodeReady                2m16s                kubelet          Node functional-221000 status is now: NodeReady

	  Normal  RegisteredNode           2m15s                node-controller  Node functional-221000 event: Registered Node functional-221000 in Controller

	  Normal  NodeHasNoDiskPressure    114s (x8 over 114s)  kubelet          Node functional-221000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  114s (x8 over 114s)  kubelet          Node functional-221000 status is now: NodeHasSufficientMemory

	  Normal  Starting                 114s                 kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     114s (x7 over 114s)  kubelet          Node functional-221000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  114s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           107s                 node-controller  Node functional-221000 event: Registered Node functional-221000 in Controller

	  Normal  Starting                 69s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  69s (x8 over 69s)    kubelet          Node functional-221000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    69s (x8 over 69s)    kubelet          Node functional-221000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     69s (x7 over 69s)    kubelet          Node functional-221000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  69s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           63s                  node-controller  Node functional-221000 event: Registered Node functional-221000 in Controller

	==> dmesg <==

	[  +0.976717] systemd-fstab-generator[3821]: Ignoring "noauto" option for root device

	[Aug31 22:21] kauditd_printk_skb: 199 callbacks suppressed

	[  +7.368538] kauditd_printk_skb: 33 callbacks suppressed

	[  +7.739079] systemd-fstab-generator[4736]: Ignoring "noauto" option for root device

	[ +11.036452] systemd-fstab-generator[5170]: Ignoring "noauto" option for root device

	[  +0.057824] kauditd_printk_skb: 12 callbacks suppressed

	[  +0.144055] systemd-fstab-generator[5207]: Ignoring "noauto" option for root device

	[  +0.118559] systemd-fstab-generator[5219]: Ignoring "noauto" option for root device

	[  +0.145101] systemd-fstab-generator[5235]: Ignoring "noauto" option for root device

	[  +5.101613] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.340477] systemd-fstab-generator[5869]: Ignoring "noauto" option for root device

	[  +0.095791] systemd-fstab-generator[5881]: Ignoring "noauto" option for root device

	[  +0.084011] systemd-fstab-generator[5893]: Ignoring "noauto" option for root device

	[  +0.082390] systemd-fstab-generator[5908]: Ignoring "noauto" option for root device

	[  +0.208689] systemd-fstab-generator[6076]: Ignoring "noauto" option for root device

	[  +0.938179] systemd-fstab-generator[6199]: Ignoring "noauto" option for root device

	[  +4.427081] kauditd_printk_skb: 199 callbacks suppressed

	[  +9.627841] systemd-fstab-generator[7215]: Ignoring "noauto" option for root device

	[  +0.054022] kauditd_printk_skb: 35 callbacks suppressed

	[Aug31 22:22] kauditd_printk_skb: 16 callbacks suppressed

	[  +5.442440] kauditd_printk_skb: 15 callbacks suppressed

	[  +5.086066] kauditd_printk_skb: 12 callbacks suppressed

	[  +5.047478] kauditd_printk_skb: 21 callbacks suppressed

	[ +11.709189] kauditd_printk_skb: 38 callbacks suppressed

	[ +17.487585] kauditd_printk_skb: 21 callbacks suppressed

	==> etcd [06cb2ffdfa93] <==

	{"level":"info","ts":"2024-08-31T22:21:00.505997Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-08-31T22:21:00.506078Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-08-31T22:21:00.506118Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:00.506136Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:00.506229Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:00.506384Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:00.509416Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:21:00.509991Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:21:00.509406Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-221000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-31T22:21:00.510904Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-31T22:21:00.511153Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-31T22:21:00.512508Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:21:00.513696Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:21:00.514743Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-08-31T22:21:00.515536Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-08-31T22:21:28.631365Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-08-31T22:21:28.631409Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-221000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-08-31T22:21:28.631452Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-31T22:21:28.631499Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-31T22:21:28.639856Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-08-31T22:21:28.639880Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"info","ts":"2024-08-31T22:21:28.641141Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-08-31T22:21:28.642519Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-31T22:21:28.642563Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-31T22:21:28.642568Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-221000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> etcd [9d8f2158731e] <==

	{"level":"info","ts":"2024-08-31T22:21:43.324939Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}

	{"level":"info","ts":"2024-08-31T22:21:43.324950Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2024-08-31T22:21:43.324954Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2024-08-31T22:21:43.329144Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-31T22:21:43.329700Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-08-31T22:21:43.329223Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}

	{"level":"info","ts":"2024-08-31T22:21:43.329786Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-08-31T22:21:43.329840Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-31T22:21:43.329889Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-08-31T22:21:44.982632Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:44.982795Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:44.982859Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-08-31T22:21:44.982892Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-08-31T22:21:44.983318Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-08-31T22:21:44.983352Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-08-31T22:21:44.983378Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-08-31T22:21:44.988061Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:21:44.988513Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-08-31T22:21:44.988067Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-221000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-08-31T22:21:44.989247Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-08-31T22:21:44.989429Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-08-31T22:21:44.990647Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:21:44.990647Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-08-31T22:21:44.992612Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-08-31T22:21:44.993837Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	==> kernel <==

	 22:22:51 up 2 min,  0 users,  load average: 0.60, 0.33, 0.13

	Linux functional-221000 5.10.207 #1 SMP PREEMPT Wed Aug 28 18:03:56 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [74edd28a348e] <==

	I0831 22:21:45.580211       1 shared_informer.go:320] Caches are synced for configmaps

	I0831 22:21:45.580456       1 aggregator.go:171] initial CRD sync complete...

	I0831 22:21:45.580469       1 autoregister_controller.go:144] Starting autoregister controller

	I0831 22:21:45.580472       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0831 22:21:45.580475       1 cache.go:39] Caches are synced for autoregister controller

	I0831 22:21:45.580570       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0831 22:21:45.581056       1 shared_informer.go:320] Caches are synced for cluster_authentication_trust_controller

	I0831 22:21:45.581104       1 apf_controller.go:382] Running API Priority and Fairness config worker

	I0831 22:21:45.581125       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process

	I0831 22:21:45.586596       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	I0831 22:21:45.606815       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0831 22:21:46.497225       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	W0831 22:21:46.691012       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.105.4]

	I0831 22:21:46.691774       1 controller.go:615] quota admission added evaluator for: endpoints

	I0831 22:21:46.694001       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0831 22:21:47.129403       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0831 22:21:47.133265       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0831 22:21:47.146811       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0831 22:21:47.153966       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0831 22:21:47.155920       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0831 22:22:01.477717       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.111.60.174"}

	I0831 22:22:07.222151       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0831 22:22:07.264553       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.109.234.247"}

	I0831 22:22:12.352665       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.107.104.181"}

	I0831 22:22:22.784147       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.98.151.127"}

	==> kube-controller-manager [11d628f3793d] <==

	I0831 22:21:49.109822       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="75.582µs"

	I0831 22:21:49.365710       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="4.321975ms"

	I0831 22:21:49.365997       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="262.621µs"

	I0831 22:21:49.469250       1 shared_informer.go:320] Caches are synced for garbage collector

	I0831 22:21:49.504593       1 shared_informer.go:320] Caches are synced for garbage collector

	I0831 22:21:49.504618       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0831 22:22:07.233892       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="10.684252ms"

	I0831 22:22:07.242405       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="8.489094ms"

	I0831 22:22:07.242435       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="10.417µs"

	I0831 22:22:12.834699       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="23.084µs"

	I0831 22:22:13.873833       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="38.458µs"

	I0831 22:22:14.881346       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="25.25µs"

	I0831 22:22:16.292639       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-221000"

	I0831 22:22:22.750013       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="6.930098ms"

	I0831 22:22:22.755516       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="5.45952ms"

	I0831 22:22:22.755550       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="13.292µs"

	I0831 22:22:22.759550       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="26.792µs"

	I0831 22:22:24.017765       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="20.333µs"

	I0831 22:22:25.045770       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="28.583µs"

	I0831 22:22:27.081140       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="38.833µs"

	I0831 22:22:36.511500       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="83.875µs"

	I0831 22:22:37.221073       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="88.458µs"

	I0831 22:22:38.511290       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="24.917µs"

	I0831 22:22:46.932639       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-221000"

	I0831 22:22:48.520382       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="49.958µs"

	==> kube-controller-manager [f5619c13909c] <==

	I0831 22:21:04.461096       1 shared_informer.go:320] Caches are synced for attach detach

	I0831 22:21:04.462237       1 shared_informer.go:320] Caches are synced for PVC protection

	I0831 22:21:04.463337       1 shared_informer.go:320] Caches are synced for legacy-service-account-token-cleaner

	I0831 22:21:04.469639       1 shared_informer.go:320] Caches are synced for daemon sets

	I0831 22:21:04.482187       1 shared_informer.go:320] Caches are synced for taint

	I0831 22:21:04.482206       1 shared_informer.go:320] Caches are synced for taint-eviction-controller

	I0831 22:21:04.482212       1 shared_informer.go:320] Caches are synced for ephemeral

	I0831 22:21:04.482346       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""

	I0831 22:21:04.482407       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-221000"

	I0831 22:21:04.482216       1 shared_informer.go:320] Caches are synced for job

	I0831 22:21:04.482473       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"

	I0831 22:21:04.537022       1 shared_informer.go:320] Caches are synced for deployment

	I0831 22:21:04.559222       1 shared_informer.go:320] Caches are synced for disruption

	I0831 22:21:04.568767       1 shared_informer.go:320] Caches are synced for resource quota

	I0831 22:21:04.582421       1 shared_informer.go:320] Caches are synced for ReplicaSet

	I0831 22:21:04.582497       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="20.291µs"

	I0831 22:21:04.583913       1 shared_informer.go:320] Caches are synced for resource quota

	I0831 22:21:04.997601       1 shared_informer.go:320] Caches are synced for garbage collector

	I0831 22:21:05.048934       1 shared_informer.go:320] Caches are synced for garbage collector

	I0831 22:21:05.049089       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0831 22:21:09.307232       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="32.646679ms"

	I0831 22:21:09.326261       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="14.062926ms"

	I0831 22:21:09.326929       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="20.083µs"

	I0831 22:21:09.855700       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="7.974965ms"

	I0831 22:21:09.857805       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="30.833µs"

	==> kube-proxy [b8822ec23867] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0831 22:21:02.151827       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0831 22:21:02.166944       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0831 22:21:02.166983       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0831 22:21:02.192260       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0831 22:21:02.192283       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0831 22:21:02.192301       1 server_linux.go:169] "Using iptables Proxier"

	I0831 22:21:02.196022       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0831 22:21:02.196139       1 server.go:483] "Version info" version="v1.31.0"

	I0831 22:21:02.196224       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0831 22:21:02.196740       1 config.go:197] "Starting service config controller"

	I0831 22:21:02.196750       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0831 22:21:02.196760       1 config.go:104] "Starting endpoint slice config controller"

	I0831 22:21:02.196762       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0831 22:21:02.197045       1 config.go:326] "Starting node config controller"

	I0831 22:21:02.197048       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0831 22:21:02.297145       1 shared_informer.go:320] Caches are synced for node config

	I0831 22:21:02.297174       1 shared_informer.go:320] Caches are synced for service config

	I0831 22:21:02.297185       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-proxy [c9c4970098a7] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0831 22:21:47.023669       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0831 22:21:47.027849       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0831 22:21:47.027877       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0831 22:21:47.093540       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0831 22:21:47.093561       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0831 22:21:47.093577       1 server_linux.go:169] "Using iptables Proxier"

	I0831 22:21:47.094322       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0831 22:21:47.094535       1 server.go:483] "Version info" version="v1.31.0"

	I0831 22:21:47.094707       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0831 22:21:47.095435       1 config.go:197] "Starting service config controller"

	I0831 22:21:47.095489       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0831 22:21:47.095521       1 config.go:104] "Starting endpoint slice config controller"

	I0831 22:21:47.095537       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0831 22:21:47.095933       1 config.go:326] "Starting node config controller"

	I0831 22:21:47.096794       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0831 22:21:47.196103       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0831 22:21:47.196155       1 shared_informer.go:320] Caches are synced for service config

	I0831 22:21:47.196878       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [697c74fffc2e] <==

	I0831 22:21:43.516627       1 serving.go:386] Generated self-signed cert in-memory

	W0831 22:21:45.501330       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0831 22:21:45.501372       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0831 22:21:45.501400       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0831 22:21:45.501408       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0831 22:21:45.524105       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0831 22:21:45.525059       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0831 22:21:45.531206       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0831 22:21:45.531271       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0831 22:21:45.531288       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0831 22:21:45.531310       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0831 22:21:45.634904       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kube-scheduler [89ce027c7209] <==

	I0831 22:20:58.992162       1 serving.go:386] Generated self-signed cert in-memory

	W0831 22:21:01.028055       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0831 22:21:01.028105       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0831 22:21:01.028120       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0831 22:21:01.028127       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0831 22:21:01.046473       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0831 22:21:01.046514       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0831 22:21:01.047511       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0831 22:21:01.047552       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0831 22:21:01.047774       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0831 22:21:01.047900       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0831 22:21:01.150061       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0831 22:21:28.636385       1 run.go:72] "command failed" err="finished without leader elect"

	==> kubelet <==

	Aug 31 22:22:37 functional-221000 kubelet[6206]: E0831 22:22:37.278597    6206 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="1a39d87e-9892-4cf4-91d0-f7023dfd0c17" containerName="myfrontend"

	Aug 31 22:22:37 functional-221000 kubelet[6206]: I0831 22:22:37.278716    6206 memory_manager.go:354] "RemoveStaleState removing state" podUID="1a39d87e-9892-4cf4-91d0-f7023dfd0c17" containerName="myfrontend"

	Aug 31 22:22:37 functional-221000 kubelet[6206]: I0831 22:22:37.393775    6206 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d864w\" (UniqueName: \"kubernetes.io/projected/c31e88bc-5f56-468e-bd84-bf76f5cc4274-kube-api-access-d864w\") pod \"sp-pod\" (UID: \"c31e88bc-5f56-468e-bd84-bf76f5cc4274\") " pod="default/sp-pod"

	Aug 31 22:22:37 functional-221000 kubelet[6206]: I0831 22:22:37.393814    6206 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a\" (UniqueName: \"kubernetes.io/host-path/c31e88bc-5f56-468e-bd84-bf76f5cc4274-pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a\") pod \"sp-pod\" (UID: \"c31e88bc-5f56-468e-bd84-bf76f5cc4274\") " pod="default/sp-pod"

	Aug 31 22:22:38 functional-221000 kubelet[6206]: I0831 22:22:38.503729    6206 scope.go:117] "RemoveContainer" containerID="bcb4ea034533bdf3aa1cab189f93f4e6bd4bc20f3ff255de83acda4dd220ad0e"

	Aug 31 22:22:38 functional-221000 kubelet[6206]: E0831 22:22:38.503821    6206 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-rmffc_default(154dd718-9dfb-4b9c-b955-928c716c875d)\"" pod="default/hello-node-64b4f8f9ff-rmffc" podUID="154dd718-9dfb-4b9c-b955-928c716c875d"

	Aug 31 22:22:38 functional-221000 kubelet[6206]: I0831 22:22:38.514523    6206 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a39d87e-9892-4cf4-91d0-f7023dfd0c17" path="/var/lib/kubelet/pods/1a39d87e-9892-4cf4-91d0-f7023dfd0c17/volumes"

	Aug 31 22:22:39 functional-221000 kubelet[6206]: I0831 22:22:39.277548    6206 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/sp-pod" podStartSLOduration=1.527452524 podStartE2EDuration="2.277524383s" podCreationTimestamp="2024-08-31 22:22:37 +0000 UTC" firstStartedPulling="2024-08-31 22:22:37.696060752 +0000 UTC m=+55.269661722" lastFinishedPulling="2024-08-31 22:22:38.44613257 +0000 UTC m=+56.019733581" observedRunningTime="2024-08-31 22:22:39.277479383 +0000 UTC m=+56.851080395" watchObservedRunningTime="2024-08-31 22:22:39.277524383 +0000 UTC m=+56.851125353"

	Aug 31 22:22:42 functional-221000 kubelet[6206]: E0831 22:22:42.513578    6206 iptables.go:577] "Could not set up iptables canary" err=<

	Aug 31 22:22:42 functional-221000 kubelet[6206]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Aug 31 22:22:42 functional-221000 kubelet[6206]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Aug 31 22:22:42 functional-221000 kubelet[6206]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Aug 31 22:22:42 functional-221000 kubelet[6206]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Aug 31 22:22:42 functional-221000 kubelet[6206]: I0831 22:22:42.568347    6206 scope.go:117] "RemoveContainer" containerID="04b7ad0da85fe50245b6bfee6e7ccd476b7458e6a4736a64f6df7eea80ac3828"

	Aug 31 22:22:46 functional-221000 kubelet[6206]: I0831 22:22:46.378522    6206 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-test-volume\") pod \"busybox-mount\" (UID: \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\") " pod="default/busybox-mount"

	Aug 31 22:22:46 functional-221000 kubelet[6206]: I0831 22:22:46.378551    6206 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxvt\" (UniqueName: \"kubernetes.io/projected/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-kube-api-access-wgxvt\") pod \"busybox-mount\" (UID: \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\") " pod="default/busybox-mount"

	Aug 31 22:22:48 functional-221000 kubelet[6206]: I0831 22:22:48.504279    6206 scope.go:117] "RemoveContainer" containerID="40ade4d986c9365751cfc873885d3efc044bfb1df0757ab5abd4bee0a531797e"

	Aug 31 22:22:48 functional-221000 kubelet[6206]: E0831 22:22:48.504477    6206 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-v99wv_default(7b164e4b-4dc7-4c3e-9604-070e8d2cf984)\"" pod="default/hello-node-connect-65d86f57f4-v99wv" podUID="7b164e4b-4dc7-4c3e-9604-070e8d2cf984"

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.719338    6206 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-test-volume" (OuterVolumeSpecName: "test-volume") pod "05265cce-6cbb-4b51-b5dd-82c7c3475f7d" (UID: "05265cce-6cbb-4b51-b5dd-82c7c3475f7d"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.719377    6206 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-test-volume\") pod \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\" (UID: \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\") "

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.719398    6206 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxvt\" (UniqueName: \"kubernetes.io/projected/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-kube-api-access-wgxvt\") pod \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\" (UID: \"05265cce-6cbb-4b51-b5dd-82c7c3475f7d\") "

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.719422    6206 reconciler_common.go:288] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-test-volume\") on node \"functional-221000\" DevicePath \"\""

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.723147    6206 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-kube-api-access-wgxvt" (OuterVolumeSpecName: "kube-api-access-wgxvt") pod "05265cce-6cbb-4b51-b5dd-82c7c3475f7d" (UID: "05265cce-6cbb-4b51-b5dd-82c7c3475f7d"). InnerVolumeSpecName "kube-api-access-wgxvt". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Aug 31 22:22:49 functional-221000 kubelet[6206]: I0831 22:22:49.821414    6206 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-wgxvt\" (UniqueName: \"kubernetes.io/projected/05265cce-6cbb-4b51-b5dd-82c7c3475f7d-kube-api-access-wgxvt\") on node \"functional-221000\" DevicePath \"\""

	Aug 31 22:22:50 functional-221000 kubelet[6206]: I0831 22:22:50.435837    6206 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6db1063482efd4642c539550fbaa581d758703d51a976bbbe60f48d2043f5d3"

	==> storage-provisioner [4ba37f35ef49] <==

	I0831 22:21:02.137830       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0831 22:21:02.148020       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0831 22:21:02.148067       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0831 22:21:02.160037       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0831 22:21:02.160120       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-221000_d299c7c8-54a7-4cec-8494-1fff197c3aaf!

	I0831 22:21:02.160165       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1ca52204-899a-41c6-a66a-bca85838d6e1", APIVersion:"v1", ResourceVersion:"396", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-221000_d299c7c8-54a7-4cec-8494-1fff197c3aaf became leader

	I0831 22:21:02.260924       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-221000_d299c7c8-54a7-4cec-8494-1fff197c3aaf!

	==> storage-provisioner [d8b4a7df5661] <==

	I0831 22:21:46.995609       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0831 22:21:47.001293       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0831 22:21:47.001313       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0831 22:22:04.417689       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0831 22:22:04.418035       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-221000_f32a3a0c-64be-4dfa-bf0a-e584f3200e8c!

	I0831 22:22:04.419484       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1ca52204-899a-41c6-a66a-bca85838d6e1", APIVersion:"v1", ResourceVersion:"619", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-221000_f32a3a0c-64be-4dfa-bf0a-e584f3200e8c became leader

	I0831 22:22:04.519019       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-221000_f32a3a0c-64be-4dfa-bf0a-e584f3200e8c!

	I0831 22:22:23.939151       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0831 22:22:23.939411       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"32f7029b-e8cc-40db-bb36-e8db7fe67a1a", APIVersion:"v1", ResourceVersion:"721", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0831 22:22:23.939212       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    56339d57-510d-485d-9f94-de301b83c6d3 306 0 2024-08-31 22:20:36 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-08-31 22:20:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a &PersistentVolumeClaim{ObjectMeta:{myclaim  default  32f7029b-e8cc-40db-bb36-e8db7fe67a1a 721 0 2024-08-31 22:22:23 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-08-31 22:22:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-08-31 22:22:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0831 22:22:23.939836       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a" provisioned

	I0831 22:22:23.939851       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0831 22:22:23.939858       1 volume_store.go:212] Trying to save persistentvolume "pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a"

	I0831 22:22:23.944102       1 volume_store.go:219] persistentvolume "pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a" saved

	I0831 22:22:23.944225       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"32f7029b-e8cc-40db-bb36-e8db7fe67a1a", APIVersion:"v1", ResourceVersion:"721", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-32f7029b-e8cc-40db-bb36-e8db7fe67a1a

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-221000 -n functional-221000

helpers_test.go:262: (dbg) Run:  kubectl --context functional-221000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:273: non-running pods: busybox-mount

helpers_test.go:275: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:278: (dbg) Run:  kubectl --context functional-221000 describe pod busybox-mount

helpers_test.go:283: (dbg) kubectl --context functional-221000 describe pod busybox-mount:

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-221000/192.168.105.4

	Start Time:       Sat, 31 Aug 2024 15:22:46 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.11

	IPs:

	  IP:  10.244.0.11

	Containers:

	  mount-munger:

	    Container ID:  docker://7dce4e3095d87843366bdb638383319174514893be217ab6f734e539939d5aed

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Sat, 31 Aug 2024 15:22:48 -0700

	      Finished:     Sat, 31 Aug 2024 15:22:48 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wgxvt (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-wgxvt:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  5s    default-scheduler  Successfully assigned default/busybox-mount to functional-221000

	  Normal  Pulling    6s    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     4s    kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.411s (1.411s including waiting). Image size: 3547125 bytes.

	  Normal  Created    4s    kubelet            Created container mount-munger

	  Normal  Started    4s    kubelet            Started container mount-munger

-- /stdout --

helpers_test.go:286: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<

helpers_test.go:287: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (29.49s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 node stop m02 -v=7 --alsologtostderr

E0831 15:27:09.833431    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:27:12.396870    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:27:17.520302    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-166000 node stop m02 -v=7 --alsologtostderr: (12.189765375s)

ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr

E0831 15:27:27.763109    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:27:32.449374    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:27:48.246219    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:28:00.173468    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:28:29.208705    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:29:51.130134    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr: exit status 7 (2m55.977931s)

-- stdout --

	ha-166000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-166000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-166000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0831 15:27:21.234903    2716 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:27:21.235092    2716 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:27:21.235096    2716 out.go:358] Setting ErrFile to fd 2...

	I0831 15:27:21.235098    2716 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:27:21.235230    2716 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:27:21.235367    2716 out.go:352] Setting JSON to false

	I0831 15:27:21.235389    2716 mustload.go:65] Loading cluster: ha-166000

	I0831 15:27:21.235443    2716 notify.go:220] Checking for updates...

	I0831 15:27:21.235635    2716 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:27:21.235643    2716 status.go:255] checking status of ha-166000 ...

	I0831 15:27:21.236361    2716 status.go:330] ha-166000 host status = "Running" (err=<nil>)

	I0831 15:27:21.236371    2716 host.go:66] Checking if "ha-166000" exists ...

	I0831 15:27:21.236485    2716 host.go:66] Checking if "ha-166000" exists ...

	I0831 15:27:21.236604    2716 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:27:21.236613    2716 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/id_rsa Username:docker}

	W0831 15:27:47.161110    2716 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0831 15:27:47.161248    2716 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0831 15:27:47.161268    2716 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0831 15:27:47.161292    2716 status.go:257] ha-166000 status: &{Name:ha-166000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:27:47.161315    2716 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0831 15:27:47.161326    2716 status.go:255] checking status of ha-166000-m02 ...

	I0831 15:27:47.161769    2716 status.go:330] ha-166000-m02 host status = "Stopped" (err=<nil>)

	I0831 15:27:47.161780    2716 status.go:343] host is not running, skipping remaining checks

	I0831 15:27:47.161785    2716 status.go:257] ha-166000-m02 status: &{Name:ha-166000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:27:47.161795    2716 status.go:255] checking status of ha-166000-m03 ...

	I0831 15:27:47.163007    2716 status.go:330] ha-166000-m03 host status = "Running" (err=<nil>)

	I0831 15:27:47.163018    2716 host.go:66] Checking if "ha-166000-m03" exists ...

	I0831 15:27:47.163244    2716 host.go:66] Checking if "ha-166000-m03" exists ...

	I0831 15:27:47.163495    2716 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:27:47.163507    2716 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m03/id_rsa Username:docker}

	W0831 15:29:02.163914    2716 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0831 15:29:02.163965    2716 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0831 15:29:02.163973    2716 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0831 15:29:02.163977    2716 status.go:257] ha-166000-m03 status: &{Name:ha-166000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:29:02.163998    2716 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0831 15:29:02.164001    2716 status.go:255] checking status of ha-166000-m04 ...

	I0831 15:29:02.164674    2716 status.go:330] ha-166000-m04 host status = "Running" (err=<nil>)

	I0831 15:29:02.164681    2716 host.go:66] Checking if "ha-166000-m04" exists ...

	I0831 15:29:02.164786    2716 host.go:66] Checking if "ha-166000-m04" exists ...

	I0831 15:29:02.164906    2716 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:29:02.164912    2716 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m04/id_rsa Username:docker}

	W0831 15:30:17.164297    2716 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0831 15:30:17.164347    2716 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0831 15:30:17.164355    2716 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0831 15:30:17.164387    2716 status.go:257] ha-166000-m04 status: &{Name:ha-166000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:30:17.164397    2716 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-166000-m04

type: Worker

host: Error

kubelet: Nonexistent

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 3 (25.961523542s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0831 15:30:43.125360    3051 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0831 15:30:43.125370    3051 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:240: status error: exit status 3 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (214.13s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m18.430113417s)

ha_test.go:413: expected profile "ha-166000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-166000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-166000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-166000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\

":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docke

r\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

E0831 15:32:07.247803    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 3 (25.959326041s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0831 15:32:27.512696    3092 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0831 15:32:27.512712    3092 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:240: status error: exit status 3 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (104.39s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 node start m02 -v=7 --alsologtostderr

E0831 15:32:32.441905    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.082600125s)

-- stdout --

	* Starting "ha-166000-m02" control-plane node in "ha-166000" cluster

	* Restarting existing qemu2 VM for "ha-166000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-166000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:32:27.546625    3098 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:32:27.547056    3098 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:32:27.547062    3098 out.go:358] Setting ErrFile to fd 2...

	I0831 15:32:27.547065    3098 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:32:27.547183    3098 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:32:27.547585    3098 mustload.go:65] Loading cluster: ha-166000

	I0831 15:32:27.547831    3098 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0831 15:32:27.548065    3098 host.go:58] "ha-166000-m02" host status: Stopped

	I0831 15:32:27.551800    3098 out.go:177] * Starting "ha-166000-m02" control-plane node in "ha-166000" cluster

	I0831 15:32:27.554809    3098 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:32:27.554821    3098 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:32:27.554835    3098 cache.go:56] Caching tarball of preloaded images

	I0831 15:32:27.554907    3098 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:32:27.554912    3098 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:32:27.554973    3098 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/ha-166000/config.json ...

	I0831 15:32:27.556679    3098 start.go:360] acquireMachinesLock for ha-166000-m02: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:32:27.556725    3098 start.go:364] duration metric: took 31.75µs to acquireMachinesLock for "ha-166000-m02"

	I0831 15:32:27.556734    3098 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:32:27.556740    3098 fix.go:54] fixHost starting: m02

	I0831 15:32:27.556889    3098 fix.go:112] recreateIfNeeded on ha-166000-m02: state=Stopped err=<nil>

	W0831 15:32:27.556894    3098 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:32:27.560810    3098 out.go:177] * Restarting existing qemu2 VM for "ha-166000-m02" ...

	I0831 15:32:27.563781    3098 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:32:27.563816    3098 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=fe:ff:3f:40:0e:05 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/disk.qcow2

	I0831 15:32:27.566106    3098 main.go:141] libmachine: STDOUT: 

	I0831 15:32:27.566126    3098 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:32:27.566151    3098 fix.go:56] duration metric: took 9.412042ms for fixHost

	I0831 15:32:27.566155    3098 start.go:83] releasing machines lock for "ha-166000-m02", held for 9.425417ms

	W0831 15:32:27.566185    3098 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:32:27.566216    3098 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:32:27.566219    3098 start.go:729] Will try again in 5 seconds ...

	I0831 15:32:32.568140    3098 start.go:360] acquireMachinesLock for ha-166000-m02: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:32:32.568235    3098 start.go:364] duration metric: took 80.208µs to acquireMachinesLock for "ha-166000-m02"

	I0831 15:32:32.568260    3098 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:32:32.568264    3098 fix.go:54] fixHost starting: m02

	I0831 15:32:32.568426    3098 fix.go:112] recreateIfNeeded on ha-166000-m02: state=Stopped err=<nil>

	W0831 15:32:32.568431    3098 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:32:32.572760    3098 out.go:177] * Restarting existing qemu2 VM for "ha-166000-m02" ...

	I0831 15:32:32.575721    3098 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:32:32.575766    3098 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=fe:ff:3f:40:0e:05 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/disk.qcow2

	I0831 15:32:32.577965    3098 main.go:141] libmachine: STDOUT: 

	I0831 15:32:32.577982    3098 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:32:32.578001    3098 fix.go:56] duration metric: took 9.737708ms for fixHost

	I0831 15:32:32.578004    3098 start.go:83] releasing machines lock for "ha-166000-m02", held for 9.764083ms

	W0831 15:32:32.578069    3098 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:32:32.581719    3098 out.go:201] 

	W0831 15:32:32.585778    3098 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:32:32.585784    3098 out.go:270] * 

	* 

	W0831 15:32:32.588096    3098 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:32:32.591725    3098 out.go:201] 

** /stderr **

ha_test.go:422: I0831 15:32:27.546625    3098 out.go:345] Setting OutFile to fd 1 ...

I0831 15:32:27.547056    3098 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0831 15:32:27.547062    3098 out.go:358] Setting ErrFile to fd 2...

I0831 15:32:27.547065    3098 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0831 15:32:27.547183    3098 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

I0831 15:32:27.547585    3098 mustload.go:65] Loading cluster: ha-166000

I0831 15:32:27.547831    3098 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

W0831 15:32:27.548065    3098 host.go:58] "ha-166000-m02" host status: Stopped

I0831 15:32:27.551800    3098 out.go:177] * Starting "ha-166000-m02" control-plane node in "ha-166000" cluster

I0831 15:32:27.554809    3098 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

I0831 15:32:27.554821    3098 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

I0831 15:32:27.554835    3098 cache.go:56] Caching tarball of preloaded images

I0831 15:32:27.554907    3098 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

I0831 15:32:27.554912    3098 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

I0831 15:32:27.554973    3098 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/ha-166000/config.json ...

I0831 15:32:27.556679    3098 start.go:360] acquireMachinesLock for ha-166000-m02: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0831 15:32:27.556725    3098 start.go:364] duration metric: took 31.75µs to acquireMachinesLock for "ha-166000-m02"

I0831 15:32:27.556734    3098 start.go:96] Skipping create...Using existing machine configuration

I0831 15:32:27.556740    3098 fix.go:54] fixHost starting: m02

I0831 15:32:27.556889    3098 fix.go:112] recreateIfNeeded on ha-166000-m02: state=Stopped err=<nil>

W0831 15:32:27.556894    3098 fix.go:138] unexpected machine state, will restart: <nil>

I0831 15:32:27.560810    3098 out.go:177] * Restarting existing qemu2 VM for "ha-166000-m02" ...

I0831 15:32:27.563781    3098 qemu.go:418] Using hvf for hardware acceleration

I0831 15:32:27.563816    3098 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=fe:ff:3f:40:0e:05 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/disk.qcow2

I0831 15:32:27.566106    3098 main.go:141] libmachine: STDOUT: 

I0831 15:32:27.566126    3098 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0831 15:32:27.566151    3098 fix.go:56] duration metric: took 9.412042ms for fixHost

I0831 15:32:27.566155    3098 start.go:83] releasing machines lock for "ha-166000-m02", held for 9.425417ms

W0831 15:32:27.566185    3098 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0831 15:32:27.566216    3098 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0831 15:32:27.566219    3098 start.go:729] Will try again in 5 seconds ...

I0831 15:32:32.568140    3098 start.go:360] acquireMachinesLock for ha-166000-m02: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0831 15:32:32.568235    3098 start.go:364] duration metric: took 80.208µs to acquireMachinesLock for "ha-166000-m02"

I0831 15:32:32.568260    3098 start.go:96] Skipping create...Using existing machine configuration

I0831 15:32:32.568264    3098 fix.go:54] fixHost starting: m02

I0831 15:32:32.568426    3098 fix.go:112] recreateIfNeeded on ha-166000-m02: state=Stopped err=<nil>

W0831 15:32:32.568431    3098 fix.go:138] unexpected machine state, will restart: <nil>

I0831 15:32:32.572760    3098 out.go:177] * Restarting existing qemu2 VM for "ha-166000-m02" ...

I0831 15:32:32.575721    3098 qemu.go:418] Using hvf for hardware acceleration

I0831 15:32:32.575766    3098 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=fe:ff:3f:40:0e:05 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m02/disk.qcow2

I0831 15:32:32.577965    3098 main.go:141] libmachine: STDOUT: 

I0831 15:32:32.577982    3098 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0831 15:32:32.578001    3098 fix.go:56] duration metric: took 9.737708ms for fixHost

I0831 15:32:32.578004    3098 start.go:83] releasing machines lock for "ha-166000-m02", held for 9.764083ms

W0831 15:32:32.578069    3098 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

* Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0831 15:32:32.581719    3098 out.go:201] 

W0831 15:32:32.585778    3098 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0831 15:32:32.585784    3098 out.go:270] * 

* 

W0831 15:32:32.588096    3098 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0831 15:32:32.591725    3098 out.go:201] 

ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-166000 node start m02 -v=7 --alsologtostderr": exit status 80

ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr

E0831 15:32:34.969352    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr: exit status 7 (2m31.794791625s)

-- stdout --

	ha-166000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-166000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-166000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0831 15:32:32.628234    3102 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:32:32.628601    3102 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:32:32.628613    3102 out.go:358] Setting ErrFile to fd 2...

	I0831 15:32:32.628616    3102 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:32:32.628765    3102 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:32:32.628877    3102 out.go:352] Setting JSON to false

	I0831 15:32:32.628891    3102 mustload.go:65] Loading cluster: ha-166000

	I0831 15:32:32.628938    3102 notify.go:220] Checking for updates...

	I0831 15:32:32.629129    3102 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:32:32.629138    3102 status.go:255] checking status of ha-166000 ...

	I0831 15:32:32.629829    3102 status.go:330] ha-166000 host status = "Running" (err=<nil>)

	I0831 15:32:32.629839    3102 host.go:66] Checking if "ha-166000" exists ...

	I0831 15:32:32.629943    3102 host.go:66] Checking if "ha-166000" exists ...

	I0831 15:32:32.630054    3102 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:32:32.630061    3102 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/id_rsa Username:docker}

	W0831 15:32:32.630231    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:32.630246    3102 retry.go:31] will retry after 171.6762ms: dial tcp 192.168.105.5:22: connect: host is down

	W0831 15:32:32.802794    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:32.802816    3102 retry.go:31] will retry after 199.559596ms: dial tcp 192.168.105.5:22: connect: host is down

	W0831 15:32:33.003736    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:33.003758    3102 retry.go:31] will retry after 577.182194ms: dial tcp 192.168.105.5:22: connect: host is down

	W0831 15:32:33.582425    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:33.582452    3102 retry.go:31] will retry after 788.45475ms: dial tcp 192.168.105.5:22: connect: host is down

	W0831 15:32:34.373073    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	W0831 15:32:34.373154    3102 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: host is down

	E0831 15:32:34.373165    3102 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:34.373169    3102 status.go:257] ha-166000 status: &{Name:ha-166000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:32:34.373186    3102 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: host is down

	I0831 15:32:34.373190    3102 status.go:255] checking status of ha-166000-m02 ...

	I0831 15:32:34.373352    3102 status.go:330] ha-166000-m02 host status = "Stopped" (err=<nil>)

	I0831 15:32:34.373358    3102 status.go:343] host is not running, skipping remaining checks

	I0831 15:32:34.373360    3102 status.go:257] ha-166000-m02 status: &{Name:ha-166000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:32:34.373364    3102 status.go:255] checking status of ha-166000-m03 ...

	I0831 15:32:34.374072    3102 status.go:330] ha-166000-m03 host status = "Running" (err=<nil>)

	I0831 15:32:34.374081    3102 host.go:66] Checking if "ha-166000-m03" exists ...

	I0831 15:32:34.374214    3102 host.go:66] Checking if "ha-166000-m03" exists ...

	I0831 15:32:34.374345    3102 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:32:34.374353    3102 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m03/id_rsa Username:docker}

	W0831 15:33:49.374897    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0831 15:33:49.375075    3102 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0831 15:33:49.375114    3102 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0831 15:33:49.375136    3102 status.go:257] ha-166000-m03 status: &{Name:ha-166000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:33:49.375178    3102 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0831 15:33:49.375198    3102 status.go:255] checking status of ha-166000-m04 ...

	I0831 15:33:49.378319    3102 status.go:330] ha-166000-m04 host status = "Running" (err=<nil>)

	I0831 15:33:49.378348    3102 host.go:66] Checking if "ha-166000-m04" exists ...

	I0831 15:33:49.379004    3102 host.go:66] Checking if "ha-166000-m04" exists ...

	I0831 15:33:49.379619    3102 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0831 15:33:49.379652    3102 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000-m04/id_rsa Username:docker}

	W0831 15:35:04.381184    3102 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0831 15:35:04.381378    3102 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0831 15:35:04.381421    3102 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0831 15:35:04.381445    3102 status.go:257] ha-166000-m04 status: &{Name:ha-166000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0831 15:35:04.381497    3102 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 3 (25.998857542s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0831 15:35:30.382044    3147 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0831 15:35:30.382079    3147 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:240: status error: exit status 3 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (182.88s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-166000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-166000 -v=7 --alsologtostderr

E0831 15:37:07.240581    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:37:32.434793    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:38:55.519620    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-166000 -v=7 --alsologtostderr: (3m49.027649375s)

ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-166000 --wait=true -v=7 --alsologtostderr

ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-166000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.228967917s)

-- stdout --

	* [ha-166000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-166000" primary control-plane node in "ha-166000" cluster

	* Restarting existing qemu2 VM for "ha-166000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-166000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:40:38.408430    3277 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:40:38.408614    3277 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:38.408619    3277 out.go:358] Setting ErrFile to fd 2...

	I0831 15:40:38.408622    3277 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:38.408795    3277 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:40:38.410110    3277 out.go:352] Setting JSON to false

	I0831 15:40:38.429697    3277 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2402,"bootTime":1725141636,"procs":475,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:40:38.429771    3277 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:40:38.435038    3277 out.go:177] * [ha-166000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:40:38.442981    3277 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:40:38.443022    3277 notify.go:220] Checking for updates...

	I0831 15:40:38.451937    3277 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:40:38.454906    3277 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:40:38.457894    3277 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:40:38.461015    3277 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:40:38.462096    3277 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:40:38.465265    3277 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:40:38.465330    3277 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:40:38.469909    3277 out.go:177] * Using the qemu2 driver based on existing profile

	I0831 15:40:38.474931    3277 start.go:297] selected driver: qemu2

	I0831 15:40:38.474940    3277 start.go:901] validating driver "qemu2" against &{Name:ha-166000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-166000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:

false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mou

nt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:40:38.475033    3277 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:40:38.477761    3277 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:40:38.477788    3277 cni.go:84] Creating CNI manager for ""

	I0831 15:40:38.477796    3277 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0831 15:40:38.477856    3277 start.go:340] cluster config:

	{Name:ha-166000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-166000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:40:38.481965    3277 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:40:38.490897    3277 out.go:177] * Starting "ha-166000" primary control-plane node in "ha-166000" cluster

	I0831 15:40:38.494930    3277 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:40:38.494945    3277 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:40:38.494957    3277 cache.go:56] Caching tarball of preloaded images

	I0831 15:40:38.495013    3277 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:40:38.495018    3277 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:40:38.495089    3277 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/ha-166000/config.json ...

	I0831 15:40:38.495568    3277 start.go:360] acquireMachinesLock for ha-166000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:40:38.495605    3277 start.go:364] duration metric: took 30.833µs to acquireMachinesLock for "ha-166000"

	I0831 15:40:38.495614    3277 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:40:38.495619    3277 fix.go:54] fixHost starting: 

	I0831 15:40:38.495742    3277 fix.go:112] recreateIfNeeded on ha-166000: state=Stopped err=<nil>

	W0831 15:40:38.495751    3277 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:40:38.499901    3277 out.go:177] * Restarting existing qemu2 VM for "ha-166000" ...

	I0831 15:40:38.507915    3277 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:40:38.507952    3277 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:fd:e4:89:24:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/disk.qcow2

	I0831 15:40:38.510060    3277 main.go:141] libmachine: STDOUT: 

	I0831 15:40:38.510087    3277 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:40:38.510119    3277 fix.go:56] duration metric: took 14.501666ms for fixHost

	I0831 15:40:38.510123    3277 start.go:83] releasing machines lock for "ha-166000", held for 14.514083ms

	W0831 15:40:38.510130    3277 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:40:38.510160    3277 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:40:38.510165    3277 start.go:729] Will try again in 5 seconds ...

	I0831 15:40:43.512193    3277 start.go:360] acquireMachinesLock for ha-166000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:40:43.512668    3277 start.go:364] duration metric: took 358.708µs to acquireMachinesLock for "ha-166000"

	I0831 15:40:43.512932    3277 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:40:43.512951    3277 fix.go:54] fixHost starting: 

	I0831 15:40:43.513713    3277 fix.go:112] recreateIfNeeded on ha-166000: state=Stopped err=<nil>

	W0831 15:40:43.513739    3277 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:40:43.517213    3277 out.go:177] * Restarting existing qemu2 VM for "ha-166000" ...

	I0831 15:40:43.525218    3277 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:40:43.525453    3277 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:fd:e4:89:24:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/disk.qcow2

	I0831 15:40:43.534536    3277 main.go:141] libmachine: STDOUT: 

	I0831 15:40:43.534615    3277 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:40:43.534687    3277 fix.go:56] duration metric: took 21.737375ms for fixHost

	I0831 15:40:43.534709    3277 start.go:83] releasing machines lock for "ha-166000", held for 21.932083ms

	W0831 15:40:43.534905    3277 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:40:43.543199    3277 out.go:201] 

	W0831 15:40:43.547187    3277 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:40:43.547211    3277 out.go:270] * 

	* 

	W0831 15:40:43.550037    3277 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:40:43.554182    3277 out.go:201] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-166000 -v=7 --alsologtostderr" : exit status 80

ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-166000

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (32.248583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (234.39s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 node delete m03 -v=7 --alsologtostderr: exit status 83 (40.089375ms)

-- stdout --

	* The control-plane node ha-166000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-166000"

-- /stdout --

** stderr ** 

	I0831 15:40:43.695958    3290 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:40:43.696189    3290 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:43.696193    3290 out.go:358] Setting ErrFile to fd 2...

	I0831 15:40:43.696195    3290 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:43.696314    3290 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:40:43.696522    3290 mustload.go:65] Loading cluster: ha-166000

	I0831 15:40:43.696750    3290 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0831 15:40:43.697045    3290 out.go:270] ! The control-plane node ha-166000 host is not running (will try others): state=Stopped

	! The control-plane node ha-166000 host is not running (will try others): state=Stopped

	W0831 15:40:43.697148    3290 out.go:270] ! The control-plane node ha-166000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-166000-m02 host is not running (will try others): state=Stopped

	I0831 15:40:43.701196    3290 out.go:177] * The control-plane node ha-166000-m03 host is not running: state=Stopped

	I0831 15:40:43.704379    3290 out.go:177]   To start a cluster, run: "minikube start -p ha-166000"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-166000 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr: exit status 7 (29.904583ms)

-- stdout --

	ha-166000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0831 15:40:43.736173    3292 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:40:43.736332    3292 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:43.736336    3292 out.go:358] Setting ErrFile to fd 2...

	I0831 15:40:43.736338    3292 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:40:43.736457    3292 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:40:43.736571    3292 out.go:352] Setting JSON to false

	I0831 15:40:43.736582    3292 mustload.go:65] Loading cluster: ha-166000

	I0831 15:40:43.736625    3292 notify.go:220] Checking for updates...

	I0831 15:40:43.736798    3292 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:40:43.736805    3292 status.go:255] checking status of ha-166000 ...

	I0831 15:40:43.737008    3292 status.go:330] ha-166000 host status = "Stopped" (err=<nil>)

	I0831 15:40:43.737011    3292 status.go:343] host is not running, skipping remaining checks

	I0831 15:40:43.737014    3292 status.go:257] ha-166000 status: &{Name:ha-166000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:40:43.737023    3292 status.go:255] checking status of ha-166000-m02 ...

	I0831 15:40:43.737110    3292 status.go:330] ha-166000-m02 host status = "Stopped" (err=<nil>)

	I0831 15:40:43.737113    3292 status.go:343] host is not running, skipping remaining checks

	I0831 15:40:43.737115    3292 status.go:257] ha-166000-m02 status: &{Name:ha-166000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:40:43.737119    3292 status.go:255] checking status of ha-166000-m03 ...

	I0831 15:40:43.737203    3292 status.go:330] ha-166000-m03 host status = "Stopped" (err=<nil>)

	I0831 15:40:43.737205    3292 status.go:343] host is not running, skipping remaining checks

	I0831 15:40:43.737207    3292 status.go:257] ha-166000-m03 status: &{Name:ha-166000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:40:43.737211    3292 status.go:255] checking status of ha-166000-m04 ...

	I0831 15:40:43.737307    3292 status.go:330] ha-166000-m04 host status = "Stopped" (err=<nil>)

	I0831 15:40:43.737312    3292 status.go:343] host is not running, skipping remaining checks

	I0831 15:40:43.737314    3292 status.go:257] ha-166000-m04 status: &{Name:ha-166000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (29.488667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1.184235792s)

ha_test.go:413: expected profile "ha-166000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-166000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-166000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-166000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (51.63575ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (1.24s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 stop -v=7 --alsologtostderr

E0831 15:42:07.233079    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:42:32.426956    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

E0831 15:43:30.316003    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-166000 stop -v=7 --alsologtostderr: (5m0.140782s)

ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr: exit status 7 (67.777125ms)

-- stdout --

	ha-166000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-166000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0831 15:45:45.203027    3421 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:45:45.203260    3421 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:45.203265    3421 out.go:358] Setting ErrFile to fd 2...

	I0831 15:45:45.203268    3421 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:45.203453    3421 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:45:45.203633    3421 out.go:352] Setting JSON to false

	I0831 15:45:45.203646    3421 mustload.go:65] Loading cluster: ha-166000

	I0831 15:45:45.203682    3421 notify.go:220] Checking for updates...

	I0831 15:45:45.203980    3421 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:45:45.203992    3421 status.go:255] checking status of ha-166000 ...

	I0831 15:45:45.204268    3421 status.go:330] ha-166000 host status = "Stopped" (err=<nil>)

	I0831 15:45:45.204273    3421 status.go:343] host is not running, skipping remaining checks

	I0831 15:45:45.204276    3421 status.go:257] ha-166000 status: &{Name:ha-166000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:45:45.204290    3421 status.go:255] checking status of ha-166000-m02 ...

	I0831 15:45:45.204422    3421 status.go:330] ha-166000-m02 host status = "Stopped" (err=<nil>)

	I0831 15:45:45.204427    3421 status.go:343] host is not running, skipping remaining checks

	I0831 15:45:45.204430    3421 status.go:257] ha-166000-m02 status: &{Name:ha-166000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:45:45.204435    3421 status.go:255] checking status of ha-166000-m03 ...

	I0831 15:45:45.204562    3421 status.go:330] ha-166000-m03 host status = "Stopped" (err=<nil>)

	I0831 15:45:45.204566    3421 status.go:343] host is not running, skipping remaining checks

	I0831 15:45:45.204568    3421 status.go:257] ha-166000-m03 status: &{Name:ha-166000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0831 15:45:45.204573    3421 status.go:255] checking status of ha-166000-m04 ...

	I0831 15:45:45.204691    3421 status.go:330] ha-166000-m04 host status = "Stopped" (err=<nil>)

	I0831 15:45:45.204695    3421 status.go:343] host is not running, skipping remaining checks

	I0831 15:45:45.204697    3421 status.go:257] ha-166000-m04 status: &{Name:ha-166000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-166000 status -v=7 --alsologtostderr": ha-166000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-166000-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (32.956791ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (300.24s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-166000 --wait=true -v=7 --alsologtostderr --driver=qemu2 

ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-166000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.186378625s)

-- stdout --

	* [ha-166000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-166000" primary control-plane node in "ha-166000" cluster

	* Restarting existing qemu2 VM for "ha-166000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-166000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:45:45.267435    3425 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:45:45.267586    3425 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:45.267589    3425 out.go:358] Setting ErrFile to fd 2...

	I0831 15:45:45.267591    3425 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:45.267726    3425 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:45:45.268776    3425 out.go:352] Setting JSON to false

	I0831 15:45:45.284940    3425 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2709,"bootTime":1725141636,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:45:45.285005    3425 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:45:45.290653    3425 out.go:177] * [ha-166000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:45:45.297598    3425 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:45:45.297652    3425 notify.go:220] Checking for updates...

	I0831 15:45:45.305473    3425 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:45:45.308604    3425 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:45:45.312573    3425 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:45:45.313852    3425 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:45:45.316566    3425 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:45:45.319910    3425 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:45:45.320158    3425 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:45:45.324477    3425 out.go:177] * Using the qemu2 driver based on existing profile

	I0831 15:45:45.331641    3425 start.go:297] selected driver: qemu2

	I0831 15:45:45.331648    3425 start.go:901] validating driver "qemu2" against &{Name:ha-166000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.0 ClusterName:ha-166000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storage

class:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho

st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:45:45.331767    3425 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:45:45.334041    3425 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:45:45.334082    3425 cni.go:84] Creating CNI manager for ""

	I0831 15:45:45.334088    3425 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0831 15:45:45.334141    3425 start.go:340] cluster config:

	{Name:ha-166000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-166000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:45:45.337687    3425 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:45:45.346570    3425 out.go:177] * Starting "ha-166000" primary control-plane node in "ha-166000" cluster

	I0831 15:45:45.350586    3425 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:45:45.350599    3425 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:45:45.350608    3425 cache.go:56] Caching tarball of preloaded images

	I0831 15:45:45.350657    3425 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:45:45.350663    3425 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:45:45.350733    3425 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/ha-166000/config.json ...

	I0831 15:45:45.351217    3425 start.go:360] acquireMachinesLock for ha-166000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:45:45.351254    3425 start.go:364] duration metric: took 31.166µs to acquireMachinesLock for "ha-166000"

	I0831 15:45:45.351263    3425 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:45:45.351273    3425 fix.go:54] fixHost starting: 

	I0831 15:45:45.351390    3425 fix.go:112] recreateIfNeeded on ha-166000: state=Stopped err=<nil>

	W0831 15:45:45.351400    3425 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:45:45.355597    3425 out.go:177] * Restarting existing qemu2 VM for "ha-166000" ...

	I0831 15:45:45.363575    3425 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:45:45.363619    3425 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:fd:e4:89:24:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/disk.qcow2

	I0831 15:45:45.365789    3425 main.go:141] libmachine: STDOUT: 

	I0831 15:45:45.365811    3425 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:45:45.365840    3425 fix.go:56] duration metric: took 14.568125ms for fixHost

	I0831 15:45:45.365846    3425 start.go:83] releasing machines lock for "ha-166000", held for 14.58675ms

	W0831 15:45:45.365851    3425 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:45:45.365893    3425 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:45:45.365898    3425 start.go:729] Will try again in 5 seconds ...

	I0831 15:45:50.367692    3425 start.go:360] acquireMachinesLock for ha-166000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:45:50.368133    3425 start.go:364] duration metric: took 336.709µs to acquireMachinesLock for "ha-166000"

	I0831 15:45:50.368280    3425 start.go:96] Skipping create...Using existing machine configuration

	I0831 15:45:50.368302    3425 fix.go:54] fixHost starting: 

	I0831 15:45:50.369065    3425 fix.go:112] recreateIfNeeded on ha-166000: state=Stopped err=<nil>

	W0831 15:45:50.369091    3425 fix.go:138] unexpected machine state, will restart: <nil>

	I0831 15:45:50.372551    3425 out.go:177] * Restarting existing qemu2 VM for "ha-166000" ...

	I0831 15:45:50.380419    3425 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:45:50.380659    3425 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:fd:e4:89:24:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/ha-166000/disk.qcow2

	I0831 15:45:50.390222    3425 main.go:141] libmachine: STDOUT: 

	I0831 15:45:50.390317    3425 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:45:50.390422    3425 fix.go:56] duration metric: took 22.12175ms for fixHost

	I0831 15:45:50.390466    3425 start.go:83] releasing machines lock for "ha-166000", held for 22.288417ms

	W0831 15:45:50.390670    3425 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-166000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:45:50.399507    3425 out.go:201] 

	W0831 15:45:50.403554    3425 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:45:50.403578    3425 out.go:270] * 

	* 

	W0831 15:45:50.406068    3425 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:45:50.413522    3425 out.go:201] 

** /stderr **

ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-166000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (71.224042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.26s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-166000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-166000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-166000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-166000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (52.274333ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (1.03s)

=== RUN   TestMultiControlPlane/serial/AddSecondaryNode

ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-166000 --control-plane -v=7 --alsologtostderr

ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-166000 --control-plane -v=7 --alsologtostderr: exit status 83 (63.424375ms)

-- stdout --

	* The control-plane node ha-166000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-166000"

-- /stdout --

** stderr ** 

	I0831 15:45:51.568542    3467 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:45:51.568692    3467 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:51.568696    3467 out.go:358] Setting ErrFile to fd 2...

	I0831 15:45:51.568698    3467 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:45:51.568843    3467 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:45:51.569089    3467 mustload.go:65] Loading cluster: ha-166000

	I0831 15:45:51.569312    3467 config.go:182] Loaded profile config "ha-166000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0831 15:45:51.569644    3467 out.go:270] ! The control-plane node ha-166000 host is not running (will try others): state=Stopped

	! The control-plane node ha-166000 host is not running (will try others): state=Stopped

	W0831 15:45:51.569755    3467 out.go:270] ! The control-plane node ha-166000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-166000-m02 host is not running (will try others): state=Stopped

	I0831 15:45:51.575034    3467 out.go:177] * The control-plane node ha-166000-m03 host is not running: state=Stopped

	I0831 15:45:51.583003    3467 out.go:177]   To start a cluster, run: "minikube start -p ha-166000"

** /stderr **

ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-166000 --control-plane -v=7 --alsologtostderr" : exit status 83

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-166000 -n ha-166000: exit status 7 (33.732ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "ha-166000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.10s)

=== RUN   TestImageBuild/serial/Setup

image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-215000 --driver=qemu2 

image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-215000 --driver=qemu2 : exit status 80 (10.036298167s)

-- stdout --

	* [image-215000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "image-215000" primary control-plane node in "image-215000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "image-215000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p image-215000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-215000 --driver=qemu2 " : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-215000 -n image-215000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-215000 -n image-215000: exit status 7 (67.8405ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "image-215000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestImageBuild/serial/Setup (10.10s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-629000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-629000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.867029333s)

-- stdout --

	{"specversion":"1.0","id":"64855923-9711-4178-be27-310c46ae214b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-629000] minikube v1.33.1 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"4bddb91b-04be-472a-820f-c2e5c73b2ad2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18943"}}

	{"specversion":"1.0","id":"e64162cf-b477-4d44-8a00-5e84b07ebed4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig"}}

	{"specversion":"1.0","id":"b374ba80-2ce3-494c-8951-5949ae8ea6a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"8a84eb29-204c-4bc3-ba12-ad768730bf1c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"357ea8d8-3e5f-44e2-8513-0f060027adbf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube"}}

	{"specversion":"1.0","id":"7811229d-df8b-4693-aca8-d859539d1517","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"fe4641bb-36b7-4465-8b7f-136671118df1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"98cdcd90-7163-4827-9568-33f5a4430f0c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"797d439c-a148-4469-beb5-e6424a55f2d8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-629000\" primary control-plane node in \"json-output-629000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"367909df-a7d5-4eec-be8b-e26046843e5e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"16c30572-6a66-47c1-ae10-4f6284e00ba4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-629000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"09adba59-d01e-4fff-b222-390d4f292415","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"a8042c2f-a0f8-4587-bb4f-a8fd915b304a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"83ca862e-5bac-48ff-bba5-e3ac982966b3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-629000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"a384a755-31f8-4547-ab0c-fbf155a95849","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}

	{"specversion":"1.0","id":"d04c5b32-ee02-4253-b52c-94ec176d2a0d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-629000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80

json_output_test.go:213: unable to marshal output: OUTPUT: 

json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value

--- FAIL: TestJSONOutput/start/Command (9.87s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-629000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-629000 --output=json --user=testUser: exit status 83 (78.338209ms)

-- stdout --

	{"specversion":"1.0","id":"ce5d752a-30bc-47f7-a4d2-513bcf6668b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-629000 host is not running: state=Stopped"}}

	{"specversion":"1.0","id":"fa6bc18e-344c-4b27-b0c2-104bd18de1ce","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-629000\""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-629000 --output=json --user=testUser": exit status 83

--- FAIL: TestJSONOutput/pause/Command (0.08s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-629000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-629000 --output=json --user=testUser: exit status 83 (45.240917ms)

-- stdout --

	* The control-plane node json-output-629000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p json-output-629000"

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-629000 --output=json --user=testUser": exit status 83

json_output_test.go:213: unable to marshal output: * The control-plane node json-output-629000 host is not running: state=Stopped

json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value

--- FAIL: TestJSONOutput/unpause/Command (0.05s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-391000 --driver=qemu2 

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-391000 --driver=qemu2 : exit status 80 (9.975824209s)

-- stdout --

	* [first-391000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "first-391000" primary control-plane node in "first-391000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "first-391000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p first-391000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-391000 --driver=qemu2 ": exit status 80

panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-31 15:46:26.23838 -0700 PDT m=+2493.173538626

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-393000 -n second-393000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-393000 -n second-393000: exit status 85 (81.380417ms)

-- stdout --

	* Profile "second-393000" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p second-393000"

-- /stdout --

helpers_test.go:240: status error: exit status 85 (may be ok)

helpers_test.go:242: "second-393000" host is not running, skipping log retrieval (state="* Profile \"second-393000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-393000\"")

helpers_test.go:176: Cleaning up "second-393000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-393000

panic.go:626: *** TestMinikubeProfile FAILED at 2024-08-31 15:46:26.424679 -0700 PDT m=+2493.359842001

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-391000 -n first-391000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-391000 -n first-391000: exit status 7 (30.781583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "first-391000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:176: Cleaning up "first-391000" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-391000

--- FAIL: TestMinikubeProfile (10.27s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-675000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-675000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.972077083s)

-- stdout --

	* [mount-start-1-675000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-675000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-675000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-675000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-675000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-675000 -n mount-start-1-675000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-675000 -n mount-start-1-675000: exit status 7 (66.0195ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "mount-start-1-675000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.04s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-334000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-334000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.969477958s)

-- stdout --

	* [multinode-334000] minikube v1.33.1 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=18943

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-334000" primary control-plane node in "multinode-334000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-334000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0831 15:46:36.783873    3616 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:46:36.784012    3616 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:46:36.784015    3616 out.go:358] Setting ErrFile to fd 2...

	I0831 15:46:36.784018    3616 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:46:36.784156    3616 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:46:36.785177    3616 out.go:352] Setting JSON to false

	I0831 15:46:36.801232    3616 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2760,"bootTime":1725141636,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0831 15:46:36.801299    3616 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0831 15:46:36.805982    3616 out.go:177] * [multinode-334000] minikube v1.33.1 on Darwin 14.5 (arm64)

	I0831 15:46:36.814493    3616 out.go:177]   - MINIKUBE_LOCATION=18943

	I0831 15:46:36.814541    3616 notify.go:220] Checking for updates...

	I0831 15:46:36.821434    3616 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18943-972/kubeconfig

	I0831 15:46:36.824507    3616 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0831 15:46:36.827471    3616 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0831 15:46:36.830500    3616 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18943-972/.minikube

	I0831 15:46:36.833500    3616 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0831 15:46:36.835068    3616 driver.go:392] Setting default libvirt URI to qemu:///system

	I0831 15:46:36.839429    3616 out.go:177] * Using the qemu2 driver based on user configuration

	I0831 15:46:36.846350    3616 start.go:297] selected driver: qemu2

	I0831 15:46:36.846356    3616 start.go:901] validating driver "qemu2" against <nil>

	I0831 15:46:36.846364    3616 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0831 15:46:36.848588    3616 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0831 15:46:36.852427    3616 out.go:177] * Automatically selected the socket_vmnet network

	I0831 15:46:36.855523    3616 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0831 15:46:36.855555    3616 cni.go:84] Creating CNI manager for ""

	I0831 15:46:36.855559    3616 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0831 15:46:36.855567    3616 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0831 15:46:36.855603    3616 start.go:340] cluster config:

	{Name:multinode-334000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-334000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm

net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0831 15:46:36.859360    3616 iso.go:125] acquiring lock: {Name:mk8ceb0a45bdb16b7cc1f947d1ec201f47666698 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0831 15:46:36.867454    3616 out.go:177] * Starting "multinode-334000" primary control-plane node in "multinode-334000" cluster

	I0831 15:46:36.871506    3616 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0831 15:46:36.871520    3616 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0831 15:46:36.871529    3616 cache.go:56] Caching tarball of preloaded images

	I0831 15:46:36.871593    3616 preload.go:172] Found /Users/jenkins/minikube-integration/18943-972/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0831 15:46:36.871598    3616 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0831 15:46:36.871802    3616 profile.go:143] Saving config to /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/multinode-334000/config.json ...

	I0831 15:46:36.871814    3616 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/multinode-334000/config.json: {Name:mkd203d425b4085e7d6d8573e17b41a9700ddd5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0831 15:46:36.872037    3616 start.go:360] acquireMachinesLock for multinode-334000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:46:36.872074    3616 start.go:364] duration metric: took 29.792µs to acquireMachinesLock for "multinode-334000"

	I0831 15:46:36.872085    3616 start.go:93] Provisioning new machine with config: &{Name:multinode-334000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-334000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:46:36.872116    3616 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:46:36.880468    3616 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0831 15:46:36.898549    3616 start.go:159] libmachine.API.Create for "multinode-334000" (driver="qemu2")

	I0831 15:46:36.898579    3616 client.go:168] LocalClient.Create starting

	I0831 15:46:36.898644    3616 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:46:36.898674    3616 main.go:141] libmachine: Decoding PEM data...

	I0831 15:46:36.898684    3616 main.go:141] libmachine: Parsing certificate...

	I0831 15:46:36.898719    3616 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:46:36.898745    3616 main.go:141] libmachine: Decoding PEM data...

	I0831 15:46:36.898756    3616 main.go:141] libmachine: Parsing certificate...

	I0831 15:46:36.899108    3616 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:46:37.055289    3616 main.go:141] libmachine: Creating SSH key...

	I0831 15:46:37.255519    3616 main.go:141] libmachine: Creating Disk image...

	I0831 15:46:37.255525    3616 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:46:37.255753    3616 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:37.265191    3616 main.go:141] libmachine: STDOUT: 

	I0831 15:46:37.265210    3616 main.go:141] libmachine: STDERR: 

	I0831 15:46:37.265274    3616 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2 +20000M

	I0831 15:46:37.273075    3616 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:46:37.273090    3616 main.go:141] libmachine: STDERR: 

	I0831 15:46:37.273105    3616 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:37.273110    3616 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:46:37.273124    3616 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:46:37.273149    3616 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2e:a5:5b:9e:65:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:37.274703    3616 main.go:141] libmachine: STDOUT: 

	I0831 15:46:37.274721    3616 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:46:37.274742    3616 client.go:171] duration metric: took 376.166125ms to LocalClient.Create

	I0831 15:46:39.276909    3616 start.go:128] duration metric: took 2.404830375s to createHost

	I0831 15:46:39.276951    3616 start.go:83] releasing machines lock for "multinode-334000", held for 2.404928583s

	W0831 15:46:39.277008    3616 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:46:39.290072    3616 out.go:177] * Deleting "multinode-334000" in qemu2 ...

	W0831 15:46:39.320025    3616 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:46:39.320046    3616 start.go:729] Will try again in 5 seconds ...

	I0831 15:46:44.321195    3616 start.go:360] acquireMachinesLock for multinode-334000: {Name:mk7d928f36022e2d5b6e6a0b65f96bf3d1fc002a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0831 15:46:44.321669    3616 start.go:364] duration metric: took 368.792µs to acquireMachinesLock for "multinode-334000"

	I0831 15:46:44.321831    3616 start.go:93] Provisioning new machine with config: &{Name:multinode-334000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19530/minikube-v1.33.1-1724862017-19530-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724862063-19530@sha256:fd0f41868bf20a720502cce04c5201bfb064f3c267161af6fd5265d69c85c9f0 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.0 ClusterName:multinode-334000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0831 15:46:44.322117    3616 start.go:125] createHost starting for "" (driver="qemu2")

	I0831 15:46:44.331878    3616 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0831 15:46:44.382112    3616 start.go:159] libmachine.API.Create for "multinode-334000" (driver="qemu2")

	I0831 15:46:44.382155    3616 client.go:168] LocalClient.Create starting

	I0831 15:46:44.382267    3616 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/ca.pem

	I0831 15:46:44.382354    3616 main.go:141] libmachine: Decoding PEM data...

	I0831 15:46:44.382369    3616 main.go:141] libmachine: Parsing certificate...

	I0831 15:46:44.382425    3616 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18943-972/.minikube/certs/cert.pem

	I0831 15:46:44.382470    3616 main.go:141] libmachine: Decoding PEM data...

	I0831 15:46:44.382484    3616 main.go:141] libmachine: Parsing certificate...

	I0831 15:46:44.383204    3616 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/18943-972/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18943-972/.minikube/cache/iso/arm64/minikube-v1.33.1-1724862017-19530-arm64.iso...

	I0831 15:46:44.550508    3616 main.go:141] libmachine: Creating SSH key...

	I0831 15:46:44.657776    3616 main.go:141] libmachine: Creating Disk image...

	I0831 15:46:44.657782    3616 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0831 15:46:44.657967    3616 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2.raw /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:44.667044    3616 main.go:141] libmachine: STDOUT: 

	I0831 15:46:44.667063    3616 main.go:141] libmachine: STDERR: 

	I0831 15:46:44.667110    3616 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2 +20000M

	I0831 15:46:44.675001    3616 main.go:141] libmachine: STDOUT: Image resized.

	I0831 15:46:44.675018    3616 main.go:141] libmachine: STDERR: 

	I0831 15:46:44.675030    3616 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2.raw and /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:44.675035    3616 main.go:141] libmachine: Starting QEMU VM...

	I0831 15:46:44.675045    3616 qemu.go:418] Using hvf for hardware acceleration

	I0831 15:46:44.675076    3616 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c2:9e:82:74:59:1b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/18943-972/.minikube/machines/multinode-334000/disk.qcow2

	I0831 15:46:44.676628    3616 main.go:141] libmachine: STDOUT: 

	I0831 15:46:44.676645    3616 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0831 15:46:44.676657    3616 client.go:171] duration metric: took 294.505292ms to LocalClient.Create

	I0831 15:46:46.678766    3616 start.go:128] duration metric: took 2.356682333s to createHost

	I0831 15:46:46.678868    3616 start.go:83] releasing machines lock for "multinode-334000", held for 2.357173167s

	W0831 15:46:46.679138    3616 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-334000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-334000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0831 15:46:46.688671    3616 out.go:201] 

	W0831 15:46:46.698792    3616 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0831 15:46:46.698833    3616 out.go:270] * 

	* 

	W0831 15:46:46.700859    3616 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0831 15:46:46.710645    3616 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-334000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000: exit status 7 (66.8895ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "multinode-334000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (10.04s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (130.728333ms)

** stderr ** 

	error: cluster "multinode-334000" does not exist

** /stderr **

multinode_test.go:495: failed to create busybox deployment to multinode cluster

multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- rollout status deployment/busybox

multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- rollout status deployment/busybox: exit status 1 (58.769917ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:500: failed to deploy busybox to multinode cluster

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (57.709875ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.745334ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.895375ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.383084ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.001833ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.749834ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

E0831 15:47:07.225491    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/functional-221000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.410291ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.291167ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

E0831 15:47:32.418970    1432 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/18943-972/.minikube/profiles/addons-492000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.917125ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.887666ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.657125ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.346125ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:530: failed get Pod names

multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.io

multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.io: exit status 1 (57.337416ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.default

multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.default: exit status 1 (57.674042ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (56.807041ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000: exit status 7 (30.251292ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "multinode-334000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (109.10s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-334000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.02575ms)

** stderr ** 

	error: no server found for cluster "multinode-334000"

** /stderr **

multinode_test.go:566: failed to get Pod names: exit status 1

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000: exit status 7 (29.80375ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "multinode-334000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-334000 -v 3 --alsologtostderr

multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-334000 -v 3 --alsologtostderr: exit status 83 (41.982833ms)

-- stdout --

	* The control-plane node multinode-334000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-334000"

-- /stdout --

** stderr ** 

	I0831 15:48:36.002996    3724 out.go:345] Setting OutFile to fd 1 ...

	I0831 15:48:36.003362    3724 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:48:36.003366    3724 out.go:358] Setting ErrFile to fd 2...

	I0831 15:48:36.003369    3724 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0831 15:48:36.003557    3724 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18943-972/.minikube/bin

	I0831 15:48:36.003839    3724 mustload.go:65] Loading cluster: multinode-334000

	I0831 15:48:36.004199    3724 config.go:182] Loaded profile config "multinode-334000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0831 15:48:36.008797    3724 out.go:177] * The control-plane node multinode-334000 host is not running: state=Stopped

	I0831 15:48:36.011741    3724 out.go:177]   To start a cluster, run: "minikube start -p multinode-334000"

** /stderr **

multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-334000 -v 3 --alsologtostderr" : exit status 83

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000

helpers_test.go:240: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-334000 -n multinode-334000: exit status 7 (30.015209ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:240: status error: exit status 7 (may be ok)

helpers_test.go:242: "multinode-334000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.07s)